-- Logs begin at Sat 2022-06-04 07:36:23 UTC, end at Sat 2022-06-04 08:41:40 UTC. -- Jun 04 08:08:22.666299 dv-cinder-836996-29-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 04 08:08:22.676902 dv-cinder-836996-29-iscsi devstack@keystone.service[80159]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 04 08:08:22.680063 dv-cinder-836996-29-iscsi devstack@keystone.service[80159]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jun 4 08:08:22 2022] *** Jun 04 08:08:22.680063 dv-cinder-836996-29-iscsi devstack@keystone.service[80159]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 04 08:08:22.680063 dv-cinder-836996-29-iscsi devstack@keystone.service[80159]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 04 08:08:22.680063 dv-cinder-836996-29-iscsi devstack@keystone.service[80159]: nodename: dv-cinder-836996-29-iscsi Jun 04 08:08:22.680063 dv-cinder-836996-29-iscsi devstack@keystone.service[80159]: machine: x86_64 Jun 04 08:08:22.680063 dv-cinder-836996-29-iscsi devstack@keystone.service[80159]: clock source: unix Jun 04 08:08:22.680063 dv-cinder-836996-29-iscsi devstack@keystone.service[80159]: pcre jit disabled Jun 04 08:08:22.680063 dv-cinder-836996-29-iscsi devstack@keystone.service[80159]: detected number of CPU cores: 4 Jun 04 08:08:22.680063 dv-cinder-836996-29-iscsi devstack@keystone.service[80159]: current working directory: / Jun 04 08:08:22.680063 dv-cinder-836996-29-iscsi devstack@keystone.service[80159]: detected binary path: /usr/bin/uwsgi-core Jun 04 08:08:22.680063 dv-cinder-836996-29-iscsi devstack@keystone.service[80159]: your processes number limit is 47680 Jun 04 08:08:22.680063 dv-cinder-836996-29-iscsi devstack@keystone.service[80159]: your memory page size is 4096 bytes Jun 04 08:08:22.680063 dv-cinder-836996-29-iscsi devstack@keystone.service[80159]: detected max file descriptor number: 2048 Jun 04 08:08:22.680063 dv-cinder-836996-29-iscsi devstack@keystone.service[80159]: lock engine: pthread robust mutexes Jun 04 08:08:22.680063 dv-cinder-836996-29-iscsi devstack@keystone.service[80159]: thunder lock: enabled Jun 04 08:08:22.680063 dv-cinder-836996-29-iscsi devstack@keystone.service[80159]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 04 08:08:22.680063 dv-cinder-836996-29-iscsi devstack@keystone.service[80159]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 04 08:08:22.726257 dv-cinder-836996-29-iscsi devstack@keystone.service[80159]: Python main interpreter initialized at 0x55750ef9a9c0 Jun 04 08:08:22.726257 dv-cinder-836996-29-iscsi devstack@keystone.service[80159]: python threads support enabled Jun 04 08:08:22.726257 dv-cinder-836996-29-iscsi devstack@keystone.service[80159]: your server socket listen backlog is limited to 100 connections Jun 04 08:08:22.726257 dv-cinder-836996-29-iscsi devstack@keystone.service[80159]: your mercy for graceful operations on workers is 90 seconds Jun 04 08:08:22.726584 dv-cinder-836996-29-iscsi devstack@keystone.service[80159]: mapped 403077 bytes (393 KB) for 2 cores Jun 04 08:08:22.726667 dv-cinder-836996-29-iscsi devstack@keystone.service[80159]: *** Operational MODE: preforking *** Jun 04 08:08:22.726944 dv-cinder-836996-29-iscsi devstack@keystone.service[80159]: *** uWSGI is running in multiple interpreter mode *** Jun 04 08:08:22.726944 dv-cinder-836996-29-iscsi devstack@keystone.service[80159]: spawned uWSGI master process (pid: 80159) Jun 04 08:08:22.727145 dv-cinder-836996-29-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 04 08:08:22.727883 dv-cinder-836996-29-iscsi devstack@keystone.service[80159]: spawned uWSGI worker 1 (pid: 80163, cores: 1) Jun 04 08:08:22.728045 dv-cinder-836996-29-iscsi devstack@keystone.service[80159]: spawned uWSGI worker 2 (pid: 80164, cores: 1) Jun 04 08:08:22.728177 dv-cinder-836996-29-iscsi devstack@keystone.service[80159]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 04 08:08:28.429495 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 08:08:28.429495 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: from cryptography.utils import int_from_bytes Jun 04 08:08:28.430300 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 08:08:28.430300 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: from cryptography.utils import int_from_bytes Jun 04 08:08:28.430719 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 08:08:28.430719 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: from cryptography.utils import int_from_bytes Jun 04 08:08:28.430829 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 08:08:28.430829 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: from cryptography.utils import int_from_bytes Jun 04 08:08:28.478948 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 04 08:08:28.479145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 04 08:08:28.479238 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 04 08:08:28.479381 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 04 08:08:28.479576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] command line args: [] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 04 08:08:28.479663 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] command line args: [] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 04 08:08:28.479849 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 04 08:08:28.479937 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 04 08:08:28.480010 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ================================================================================ {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 04 08:08:28.480081 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ================================================================================ {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 04 08:08:28.480268 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] admin_token = **** {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.480354 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] admin_token = **** {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.480517 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] config_dir = [] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.480597 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] config_dir = [] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.480703 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.480782 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.480885 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] config_source = [] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.480970 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] config_source = [] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.481053 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] debug = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.481126 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] debug = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.481248 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.481562 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.481709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.481813 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.481962 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.482066 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.482168 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.482272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.482375 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.482486 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.482584 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] list_limit = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.482686 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] list_limit = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.482787 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] log_config_append = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.482891 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] log_config_append = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.482999 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.483102 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.483203 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] log_dir = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.483305 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] log_dir = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.483305 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] log_file = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.483514 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] log_file = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.483514 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.483712 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.483794 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.483867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.483934 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.484011 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.484136 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.484216 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.484342 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.484426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.484426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.484628 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.484712 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.484786 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.484909 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.484986 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.485113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.485195 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.485319 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.485406 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.485550 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.485635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.485781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.485893 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.486051 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.486135 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.486298 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.486376 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.486571 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.486655 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.487593 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.487687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.487769 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] publish_errors = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.487887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] publish_errors = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.488000 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.488080 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.488232 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.488307 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.488410 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.488536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.488656 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.488810 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.488899 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.488978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.489111 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] standard_threads = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.489197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] standard_threads = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.489344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.489430 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.489584 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.489668 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.489762 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.489859 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.489962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] use_journal = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.490056 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] use_journal = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.490132 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] use_json = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.490250 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] use_json = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.490332 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] use_stderr = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.490405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] use_stderr = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.490476 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] use_syslog = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.490558 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] use_syslog = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.490686 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.490764 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 08:08:28.490941 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.491027 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.491177 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.491263 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.491432 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.491517 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.491672 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.491756 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.491917 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.491996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.492153 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.492231 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.492398 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.492482 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.492627 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.492702 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.492881 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.492962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.493125 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.493205 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.493374 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.493454 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.493609 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.493692 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.493880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.493962 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.494123 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.494208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.494369 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.494448 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.494616 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.494700 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.494850 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.494929 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.495103 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.495188 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.495353 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.495432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.495598 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.495678 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.495831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.495915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.496083 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.496166 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.496341 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.496426 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.496590 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.496667 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.496833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.496911 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.497064 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.497144 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.497292 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.497376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.497522 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.497600 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.497755 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.497918 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.498011 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.498085 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.498264 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.498341 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.498488 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.498562 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.498713 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.498791 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.498968 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.499111 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.499189 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.499261 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.499421 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.499501 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.499666 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.499752 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.499894 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.499971 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.500129 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.500206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.500360 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.500448 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.500589 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.500673 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.500816 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.500894 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.501043 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.501129 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.501270 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.501348 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.501505 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.501584 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.501748 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.501913 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.502019 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.502121 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.502218 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.502318 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.502439 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.502590 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.502729 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.503332 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.503565 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.503645 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.503905 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.503997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.504150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.504262 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.504392 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.504516 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.504628 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.504716 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.504862 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.504947 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.505097 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.505176 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.505331 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.505417 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.505561 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.505646 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.505806 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.505909 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.506065 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.506166 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.506301 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.506423 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.506530 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.506622 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.506786 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.506867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.507019 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.507106 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.507232 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.507307 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.507472 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.507552 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.507703 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.507790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.507968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.508046 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.508203 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.508283 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.508449 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.508535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.508689 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.508768 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.508925 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.509004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.509157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.509247 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.509391 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.509469 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.509638 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.509764 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.509900 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.510048 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.510128 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.510211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.510371 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.510451 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.510610 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.510767 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.510851 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.510924 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.511067 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.511149 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.511302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.511390 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.511536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.511616 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.511793 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.511871 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.512033 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.512113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.512273 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.512351 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.512510 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.512588 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.512750 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.512830 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.512985 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.513065 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.513220 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.513303 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.513455 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.513543 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.513683 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.513769 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.513938 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.514021 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.514169 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.514255 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.514403 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.514484 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.514630 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.514710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.514869 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.514948 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.515102 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.515182 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.515347 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.515433 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.515580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.515659 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.515833 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.515913 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.516087 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.516166 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.516328 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.516413 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.516557 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] auth.external = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.516636 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] auth.external = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.516784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.516862 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.517079 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.517192 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.517313 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.517400 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.517541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] auth.password = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.517622 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] auth.password = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.517769 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] auth.token = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.517873 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] auth.token = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.518031 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.518123 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.518292 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.518372 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.518534 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.518613 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.518763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.518852 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.519005 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.519084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.519250 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.519330 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.519477 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.519569 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.519711 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] credential.caching = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.519790 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] credential.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.519952 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.520035 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.520200 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.520289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.520447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.520526 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.520679 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.520758 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.520921 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.521008 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.521151 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.521230 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.521414 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.521502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.521666 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.521754 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.521922 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.522006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.522176 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.522256 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.522464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.522556 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.522708 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.522788 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.522972 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.523053 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.523211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.523299 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.523466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.523546 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.523700 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] federation.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.523791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] federation.caching = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.523935 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.524022 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.524178 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.524258 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.524422 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.524510 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.524652 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.524805 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.524884 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.524957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.525118 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.525199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.525369 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.525457 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.525604 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.525685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.525872 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.525957 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.526113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.526206 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.526359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.526446 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.526590 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.526676 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity.caching = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.526836 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.526924 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.527079 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.527159 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.527314 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.527393 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.527545 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.527633 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.529263 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.529353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.529525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.529606 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.529790 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.529953 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.530086 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.530168 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.530355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.530434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.530605 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.530687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.530846 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.530926 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.531092 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.531172 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.531344 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.531426 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.531599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.531679 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.531850 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.531929 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.532111 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.532195 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.532363 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.532446 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.532641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.532720 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.532883 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.532964 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.533127 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.533206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.533360 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.533439 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.533600 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.533681 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.533881 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.533964 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.534127 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.534206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.534368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.534450 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.534611 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.534692 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.534863 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.534942 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.535096 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.535178 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.535345 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.535428 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.535591 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.535671 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.535829 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.535910 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.536075 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.536155 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.536323 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.536404 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.536574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.536662 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.536789 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.536869 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.537012 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.537130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.537240 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.537322 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.537469 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.537550 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.537710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.537789 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.537969 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.538051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.538208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.538289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.538456 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.538536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.538704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.538785 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.538932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.539013 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.539163 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.539242 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.539409 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.539490 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.539655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.539736 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.539893 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.539974 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.540131 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.540212 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.540365 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.540443 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.540594 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.540674 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.540831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.540911 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.541088 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.541167 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.541317 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.541397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.541564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.541644 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.541809 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.541931 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.542081 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.542173 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.542316 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.542396 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.542546 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.542625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.542780 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.542867 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.543014 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.543093 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.543246 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.543326 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.543478 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.543565 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.543719 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.543798 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.543964 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.544050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.544206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.544332 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.544451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.544531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.544692 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.544770 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.544922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.545009 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.545164 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.545243 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.545399 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.545479 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.545630 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.545717 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.545887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.545970 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.546125 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.546205 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.546370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.546463 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.546618 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.546700 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.546851 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.546930 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.547105 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.547197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.547332 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.547411 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.547575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.547655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.547809 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.547896 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.548044 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.548125 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.548278 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.548358 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.548520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.548607 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.548761 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.548841 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.548989 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.549068 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.549226 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.549892 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.550003 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] resource.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.550082 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] resource.caching = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.550255 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.550336 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.550502 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.550595 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.550740 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.550820 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.551242 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.551327 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.551493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.551582 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.551729 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.551809 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.551972 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.552052 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.552208 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.552296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.552444 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.552524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.552678 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] role.caching = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.552757 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] role.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.552921 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] role.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.553008 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] role.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.553151 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.553230 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.553397 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.553475 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.553641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.553732 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.553907 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.553990 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.554158 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.554238 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.554406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.554498 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.554652 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.554732 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.554894 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.554974 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.555142 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.555223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.555372 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.555452 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.555618 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.555699 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.555865 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.555946 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.556108 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.556188 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.556353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.556433 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.556745 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.556825 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.556980 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.557059 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.557225 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.557305 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.557473 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.557554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.557716 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.557795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.557991 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.558072 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.558225 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.558307 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.558477 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.558557 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.558725 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.558804 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.558964 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.559083 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.559182 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.559280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.559412 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.559493 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.559644 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.559724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.559888 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.559968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.560142 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.560221 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.560387 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.560467 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.560622 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.560701 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.560853 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.560933 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.561083 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.561164 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.561317 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] token.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.561397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] token.caching = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.561551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.561638 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.561794 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.561931 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.562058 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.562139 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.562312 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.562405 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.562560 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.562639 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.562793 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.562876 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.563035 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.563123 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.563275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.563355 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.563520 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.563599 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.563753 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.563844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.563990 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.564069 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.564220 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.564299 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.564465 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.564552 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.564710 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.564790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.564940 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.565020 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.565740 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.565877 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.566058 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.566139 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.566317 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.connection = **** {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.566414 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.connection = **** {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.566560 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.566649 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.566806 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.566887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.567042 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.567123 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.567281 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.567360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.567516 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.567595 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.567750 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.567830 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.567982 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.568062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.568214 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.568299 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.568457 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.568539 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.568688 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.568768 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.568930 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.569009 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.569163 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.569244 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.569410 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.569489 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.569641 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.569721 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.569893 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.569972 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.570127 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.570207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.570367 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.570448 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.570603 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.570685 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 08:08:28.570760 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 04 08:08:28.570832 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 04 08:08:28.599306 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.599437 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.599535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.599614 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.599748 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.599834 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.608146 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.608247 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.636962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.637191 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.637363 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.637599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.691439 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.691697 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.740718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.740886 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.740978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.741122 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.810804 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.811031 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.811120 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.811258 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.811341 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.811479 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.811563 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.811699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.811780 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.811919 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.812009 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.812135 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.834899 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.835146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.835242 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.835356 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.835440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.835576 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.835657 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.835792 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.835881 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.836007 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.836088 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.836221 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.836301 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.836467 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.847795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.848070 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.860531 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.860791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.860886 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.860982 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.861060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.861198 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.861281 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.861412 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.861503 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.861625 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.861706 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.861859 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.862586 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.862680 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 08:08:28.879770 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.879984 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 04 08:08:28.880190 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.880320 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.880412 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 04 08:08:28.880503 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 04 08:08:28.880722 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.880814 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.880926 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 04 08:08:28.881027 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.881195 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.881287 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.881456 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.881545 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.881714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.882005 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.892340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.892630 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.892802 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.892908 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.893079 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.893219 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.893375 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.893655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.901518 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:28.901968 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:28.904827 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:28.905107 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.905215 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:28.905392 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.905498 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.905676 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.905766 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.905989 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.906071 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.906251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.906331 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.906519 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.906601 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.906789 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.906868 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.907058 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.907137 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.907330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.907412 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.907596 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.907674 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.907863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.935372 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.935593 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.936996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:28.937207 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:28.937313 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.937486 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.942757 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:28.942924 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:28.943008 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.943203 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.943295 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.943485 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.950544 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:28.950769 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:28.950851 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.951053 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.955304 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:28.955508 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:28.955591 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.955818 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.955911 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.956099 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.956181 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.956381 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.956462 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.956659 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.956749 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.956934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.957015 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.957201 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.957311 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.957582 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.976620 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.976774 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.976899 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.977064 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.981506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:28.981658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:28.985270 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.985405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.985567 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.985702 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.991195 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:28.991368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:28.994822 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:28.994968 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:28.998464 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.998608 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.998766 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.998904 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.999053 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.999187 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.999343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.999470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.999616 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.999757 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:28.999908 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.000046 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.019532 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:29.019627 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:29.019818 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.019899 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.020083 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.020168 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.020344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.020424 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.028230 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.028326 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.031498 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.031583 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.031791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.031871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.035449 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:29.035550 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:29.035729 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.035812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.036011 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.036091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.036289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.036371 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.036566 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.036648 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.049984 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:29.050095 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:29.050272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.050363 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.050554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.050636 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.050837 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.050919 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.051368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.051451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.051644 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.051734 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.051925 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.052005 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.069752 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:29.069859 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:29.073027 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:29.073112 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:29.076496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.076579 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.078124 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.078220 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.079767 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:29.079849 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:29.080044 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.080124 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.080325 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.080414 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.088229 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.088352 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.089864 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:29.089996 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:29.093236 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.093323 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.093527 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.093608 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.093811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.093917 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.094113 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.094196 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.103778 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:29.103870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:29.104070 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.104164 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.104351 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.104432 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.112359 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:29.112447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 08:08:29.112640 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.112722 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.112919 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.113000 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.113191 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.113271 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.113462 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.113543 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.113737 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.113817 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.114041 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.114133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.114315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.114404 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.114583 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.114675 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.114850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.114930 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.115116 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.115194 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.115379 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.115459 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.115654 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.115732 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.115912 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.115993 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 08:08:29.154050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55750ef9a9c0 pid: 80164 (default app) Jun 04 08:08:29.154353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55750ef9a9c0 pid: 80163 (default app) Jun 04 08:08:29.157399 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b87d5-1cd2-44ca-9972-14fbd1f771d3 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:29.157689 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b87d5-1cd2-44ca-9972-14fbd1f771d3 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:29.157999 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b87d5-1cd2-44ca-9972-14fbd1f771d3 None None] PATH_INFO: `/v3` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:29.162778 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 791 bytes} [Sat Jun 4 08:08:29 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:08:37.113460 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfbffd-0eaa-4167-8387-efb5919e33e9 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:37.114043 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfbffd-0eaa-4167-8387-efb5919e33e9 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:37.114043 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfbffd-0eaa-4167-8387-efb5919e33e9 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:37.120178 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1/2] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:08:37 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 08:08:37.125469 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba06dc-2aa2-4729-892b-77e6480cd4c0 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:37.125925 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba06dc-2aa2-4729-892b-77e6480cd4c0 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:37.126069 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba06dc-2aa2-4729-892b-77e6480cd4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:37.194661 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: INFO dbcounter [None req-71ba06dc-2aa2-4729-892b-77e6480cd4c0 None None] Registered counter for database keystone Jun 04 08:08:37.215893 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG oslo_db.sqlalchemy.engines [None req-71ba06dc-2aa2-4729-892b-77e6480cd4c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80164) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 08:08:37.222086 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writer thread running {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 08:08:37.500863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG passlib.handlers.bcrypt [None req-71ba06dc-2aa2-4729-892b-77e6480cd4c0 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80164) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 04 08:08:37.501280 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG passlib.handlers.bcrypt [None req-71ba06dc-2aa2-4729-892b-77e6480cd4c0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80164) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 04 08:08:37.556563 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-71ba06dc-2aa2-4729-892b-77e6480cd4c0 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:08:37.558194 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-71ba06dc-2aa2-4729-892b-77e6480cd4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:08:37.680524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 2/3] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:08:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 556 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 04 08:08:37.842184 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdfbffd-0eaa-4167-8387-efb5919e33e9 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:37.912335 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: INFO dbcounter [None req-6cdfbffd-0eaa-4167-8387-efb5919e33e9 None None] Registered counter for database keystone Jun 04 08:08:37.932351 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG oslo_db.sqlalchemy.engines [None req-6cdfbffd-0eaa-4167-8387-efb5919e33e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80163) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 08:08:37.938526 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writer thread running {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 08:08:38.166879 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdfbffd-0eaa-4167-8387-efb5919e33e9 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:38.171380 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb95f5a-e03e-4d58-b964-99d3989fd886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:38.172054 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb95f5a-e03e-4d58-b964-99d3989fd886 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:38.172338 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb95f5a-e03e-4d58-b964-99d3989fd886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:38.172611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb95f5a-e03e-4d58-b964-99d3989fd886 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:38.181630 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb95f5a-e03e-4d58-b964-99d3989fd886 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:38.232187 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9fb95f5a-e03e-4d58-b964-99d3989fd886 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 04 08:08:38.232520 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb95f5a-e03e-4d58-b964-99d3989fd886 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:38.242347 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 2/4] 10.222.0.57 () {58 vars in 1324 bytes} [Sat Jun 4 08:08:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 08:08:38.248382 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba06dc-2aa2-4729-892b-77e6480cd4c0 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:38.263921 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba06dc-2aa2-4729-892b-77e6480cd4c0 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:38.268282 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2f797-eafb-433a-ac44-f344fcec11f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:38.269437 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2f797-eafb-433a-ac44-f344fcec11f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:38.269718 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2f797-eafb-433a-ac44-f344fcec11f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:38.270020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2f797-eafb-433a-ac44-f344fcec11f2 admin admin] PATH_INFO: `/v3/projects/51efa731295b432199d02f2f22ada384` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:38.271509 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2f797-eafb-433a-ac44-f344fcec11f2 admin admin] RBAC: Authorizing `identity:get_project(project_id=51efa731295b432199d02f2f22ada384)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:38.322188 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e2b2f797-eafb-433a-ac44-f344fcec11f2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 04 08:08:38.322528 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2f797-eafb-433a-ac44-f344fcec11f2 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:38.328234 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 3/5] 10.222.0.57 () {56 vars in 1207 bytes} [Sat Jun 4 08:08:38 2022] GET /identity/v3/projects/51efa731295b432199d02f2f22ada384 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:08:40.508486 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8be93-7230-4b7b-8681-a550f3a73288 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:40.509007 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8be93-7230-4b7b-8681-a550f3a73288 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:40.509109 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8be93-7230-4b7b-8681-a550f3a73288 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:40.513130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 3/6] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:08:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:08:40.518485 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c73cc-37f3-4ef4-86cb-9d0dfb88d522 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:40.519417 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c73cc-37f3-4ef4-86cb-9d0dfb88d522 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:40.519564 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c73cc-37f3-4ef4-86cb-9d0dfb88d522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:40.538545 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-a34c73cc-37f3-4ef4-86cb-9d0dfb88d522 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:08:40.540064 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a34c73cc-37f3-4ef4-86cb-9d0dfb88d522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:08:40.547919 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 4/7] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:08:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 04 08:08:40.570230 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8be93-7230-4b7b-8681-a550f3a73288 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:40.582855 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8be93-7230-4b7b-8681-a550f3a73288 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:40.587131 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129d0f2-7df7-4bec-9c0d-688d595882f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:40.587756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129d0f2-7df7-4bec-9c0d-688d595882f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:40.588043 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129d0f2-7df7-4bec-9c0d-688d595882f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:40.588336 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129d0f2-7df7-4bec-9c0d-688d595882f9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:40.595958 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129d0f2-7df7-4bec-9c0d-688d595882f9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:40.598357 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129d0f2-7df7-4bec-9c0d-688d595882f9 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:40.607022 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 4/8] 10.222.0.57 () {58 vars in 1324 bytes} [Sat Jun 4 08:08:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 08:08:40.612013 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c73cc-37f3-4ef4-86cb-9d0dfb88d522 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:40.620832 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c73cc-37f3-4ef4-86cb-9d0dfb88d522 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:40.625225 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29019c87-3e4f-4d1b-8eef-3059c2873cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:40.626120 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29019c87-3e4f-4d1b-8eef-3059c2873cce admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:40.626419 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29019c87-3e4f-4d1b-8eef-3059c2873cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:40.626699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29019c87-3e4f-4d1b-8eef-3059c2873cce admin admin] PATH_INFO: `/v3/users/1757b5d7af48479b9e3aef95e06a280d` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:40.628621 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29019c87-3e4f-4d1b-8eef-3059c2873cce admin admin] RBAC: Authorizing `identity:get_user(user_id=1757b5d7af48479b9e3aef95e06a280d)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:40.630489 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29019c87-3e4f-4d1b-8eef-3059c2873cce admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:40.632053 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 5/9] 10.222.0.57 () {56 vars in 1198 bytes} [Sat Jun 4 08:08:40 2022] GET /identity/v3/users/1757b5d7af48479b9e3aef95e06a280d => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:08:42.922261 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb67b68-a699-47c5-aa3f-62f4975cd6f2 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:42.922681 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb67b68-a699-47c5-aa3f-62f4975cd6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:42.922827 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb67b68-a699-47c5-aa3f-62f4975cd6f2 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:42.923354 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9a65a-8d1b-41b7-88f3-c0c7f9550242 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:42.923713 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9a65a-8d1b-41b7-88f3-c0c7f9550242 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:42.923926 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9a65a-8d1b-41b7-88f3-c0c7f9550242 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:42.924188 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 5/10] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:08:42.926072 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 6/11] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:08:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 08:08:42.929768 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334e1cf-433e-40c8-9a2a-4b02ba36a7d5 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:42.930083 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334e1cf-433e-40c8-9a2a-4b02ba36a7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:42.930363 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334e1cf-433e-40c8-9a2a-4b02ba36a7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:42.933620 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba47bf-55be-42fe-a467-60310766c566 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:42.934016 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba47bf-55be-42fe-a467-60310766c566 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:42.934304 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba47bf-55be-42fe-a467-60310766c566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:42.950432 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-71ba47bf-55be-42fe-a467-60310766c566 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:08:42.951608 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-71ba47bf-55be-42fe-a467-60310766c566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:08:42.969914 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG passlib.handlers.bcrypt [None req-0334e1cf-433e-40c8-9a2a-4b02ba36a7d5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80163) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 04 08:08:42.970332 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG passlib.handlers.bcrypt [None req-0334e1cf-433e-40c8-9a2a-4b02ba36a7d5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80163) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 04 08:08:43.017089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-0334e1cf-433e-40c8-9a2a-4b02ba36a7d5 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:08:43.018690 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0334e1cf-433e-40c8-9a2a-4b02ba36a7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:08:43.030081 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 7/12] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:08:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 08:08:43.053354 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba47bf-55be-42fe-a467-60310766c566 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:43.076280 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:43.121035 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 6/13] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:08:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:08:43.143396 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334e1cf-433e-40c8-9a2a-4b02ba36a7d5 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:43.155909 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba47bf-55be-42fe-a467-60310766c566 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:43.189913 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ab5fb-fbf0-4495-afb8-9ada293a85d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:43.190593 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ab5fb-fbf0-4495-afb8-9ada293a85d1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:43.190890 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ab5fb-fbf0-4495-afb8-9ada293a85d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:43.191174 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ab5fb-fbf0-4495-afb8-9ada293a85d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:43.244739 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334e1cf-433e-40c8-9a2a-4b02ba36a7d5 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:43.247070 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:43.256429 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ab5fb-fbf0-4495-afb8-9ada293a85d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:43.257983 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ab5fb-fbf0-4495-afb8-9ada293a85d1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:43.284084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0dfc7d-b54a-451c-90da-207e3059154b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:43.284635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:43.285719 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dfc7d-b54a-451c-90da-207e3059154b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:43.286040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dfc7d-b54a-451c-90da-207e3059154b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:43.286320 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dfc7d-b54a-451c-90da-207e3059154b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:43.298510 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0dfc7d-b54a-451c-90da-207e3059154b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:08:43.310106 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-ca0dfc7d-b54a-451c-90da-207e3059154b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:08:43.310106 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:08:43.310106 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:08:43.310106 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:08:43.310106 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:08:43.310106 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:08:43.310106 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:08:43.310106 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:08:43.310106 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:08:43.310106 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:08:43.310106 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:08:43.310106 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:08:43.310106 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:08:43.310106 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:08:43.310106 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:08:43.310106 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:08:43.311122 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:08:43.311122 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:08:43.311122 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:08:43.311122 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:08:43.311122 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:08:43.311122 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:08:43.311122 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:08:43.311122 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:08:43.311122 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:08:43.311122 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:08:43.311122 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:08:43.311122 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:08:43.311122 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:08:43.311122 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:08:43.311122 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:08:43.311122 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:08:43.312130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:08:43.312130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:08:43.312130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:08:43.312130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:08:43.312130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:08:43.312130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:08:43.312130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:08:43.312130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:08:43.312130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:08:43.312130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:08:43.312130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:08:43.312130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:08:43.312130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 7/14] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:08:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:08:43.316987 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0dfc7d-b54a-451c-90da-207e3059154b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:43.367638 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 8/15] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:08:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 08:08:43.373087 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ab5fb-fbf0-4495-afb8-9ada293a85d1 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:43.421065 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0dfc7d-b54a-451c-90da-207e3059154b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:43.458291 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce5a0b-d100-4862-b80b-85e9aef3549c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:43.458867 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce5a0b-d100-4862-b80b-85e9aef3549c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:43.459148 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce5a0b-d100-4862-b80b-85e9aef3549c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:43.459419 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce5a0b-d100-4862-b80b-85e9aef3549c None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:43.460160 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce5a0b-d100-4862-b80b-85e9aef3549c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:08:43.460461 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce5a0b-d100-4862-b80b-85e9aef3549c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:43.461907 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce5a0b-d100-4862-b80b-85e9aef3549c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:43.470696 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ab5fb-fbf0-4495-afb8-9ada293a85d1 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:43.473489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 8/16] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:08:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:08:43.478914 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce5a0b-d100-4862-b80b-85e9aef3549c None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:43.494735 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:43.505307 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:43.506726 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd63aae-a602-4696-9d2b-52de2ea4f3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:43.507624 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd63aae-a602-4696-9d2b-52de2ea4f3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:43.508060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd63aae-a602-4696-9d2b-52de2ea4f3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:43.508344 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd63aae-a602-4696-9d2b-52de2ea4f3a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:43.518151 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd63aae-a602-4696-9d2b-52de2ea4f3a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:43.520403 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd63aae-a602-4696-9d2b-52de2ea4f3a9 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:43.541150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-ffd63aae-a602-4696-9d2b-52de2ea4f3a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:08:43.541150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:08:43.541150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:08:43.541150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:08:43.541150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:08:43.541150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:08:43.541150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:08:43.541150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:08:43.541150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:08:43.541150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:08:43.541150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:08:43.541150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:08:43.541150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:08:43.541150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:08:43.541150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:08:43.542168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:08:43.542168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:08:43.542168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:08:43.542168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:08:43.542168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:08:43.542168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:08:43.542168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:08:43.542168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:08:43.542168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:08:43.542168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:08:43.542168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:08:43.542168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:08:43.542168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:08:43.542168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:08:43.542168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:08:43.542168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:08:43.542168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:08:43.543197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:08:43.543197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:08:43.543197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:08:43.543197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:08:43.543197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 9/17] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:08:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:08:43.549304 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd63aae-a602-4696-9d2b-52de2ea4f3a9 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:43.580218 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce5a0b-d100-4862-b80b-85e9aef3549c None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:43.613904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd739a-3f3a-4a7d-a2d0-e9165fcc36a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:43.614776 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd739a-3f3a-4a7d-a2d0-e9165fcc36a7 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:43.615062 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd739a-3f3a-4a7d-a2d0-e9165fcc36a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:43.615338 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd739a-3f3a-4a7d-a2d0-e9165fcc36a7 None admin] PATH_INFO: `/v3/users/1757b5d7af48479b9e3aef95e06a280d` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:43.616924 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd739a-3f3a-4a7d-a2d0-e9165fcc36a7 None admin] RBAC: Authorizing `identity:get_user(user_id=1757b5d7af48479b9e3aef95e06a280d)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:43.618432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd739a-3f3a-4a7d-a2d0-e9165fcc36a7 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:43.620069 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 9/18] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:08:43 2022] GET /identity/v3/users/1757b5d7af48479b9e3aef95e06a280d => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:08:43.625389 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd739a-3f3a-4a7d-a2d0-e9165fcc36a7 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:43.648201 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd63aae-a602-4696-9d2b-52de2ea4f3a9 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:43.680574 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f8326-d3a2-4e2d-b1e8-586922bd5e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:43.681230 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f8326-d3a2-4e2d-b1e8-586922bd5e1f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:43.681521 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f8326-d3a2-4e2d-b1e8-586922bd5e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:43.681792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f8326-d3a2-4e2d-b1e8-586922bd5e1f None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:43.682530 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f8326-d3a2-4e2d-b1e8-586922bd5e1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:08:43.682831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f8326-d3a2-4e2d-b1e8-586922bd5e1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:43.684203 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f8326-d3a2-4e2d-b1e8-586922bd5e1f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:43.701295 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 10/19] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:08:43.719098 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:43.727103 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd739a-3f3a-4a7d-a2d0-e9165fcc36a7 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:43.764452 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16526241-35b7-43ea-929e-d3406d38bd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:43.765268 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16526241-35b7-43ea-929e-d3406d38bd7c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:43.765548 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16526241-35b7-43ea-929e-d3406d38bd7c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:43.765848 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16526241-35b7-43ea-929e-d3406d38bd7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:43.767148 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16526241-35b7-43ea-929e-d3406d38bd7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:43.769309 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16526241-35b7-43ea-929e-d3406d38bd7c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:43.771086 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 10/20] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:08:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:08:43.777096 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f8326-d3a2-4e2d-b1e8-586922bd5e1f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:43.814180 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:43.882715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f8326-d3a2-4e2d-b1e8-586922bd5e1f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:43.918093 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbe2fc-19d8-4cd7-bcc5-84c6331380b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:43.918755 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbe2fc-19d8-4cd7-bcc5-84c6331380b4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:43.919040 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbe2fc-19d8-4cd7-bcc5-84c6331380b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:43.919315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbe2fc-19d8-4cd7-bcc5-84c6331380b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:43.920157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbe2fc-19d8-4cd7-bcc5-84c6331380b4 None admin] RBAC: Adding query filter params (role.id=431cef539cfb476aad50d2470e763b5f, scope.domain.id=default, user.id=1757b5d7af48479b9e3aef95e06a280d) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:08:43.920459 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbe2fc-19d8-4cd7-bcc5-84c6331380b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:43.921979 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbe2fc-19d8-4cd7-bcc5-84c6331380b4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:43.929882 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 11/21] 10.222.0.57 () {56 vars in 1322 bytes} [Sat Jun 4 08:08:43 2022] GET /identity/v3/role_assignments?user.id=1757b5d7af48479b9e3aef95e06a280d&scope.domain.id=default&role.id=431cef539cfb476aad50d2470e763b5f => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:08:46.711393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f507503-3954-4a11-b62a-462a31d9dff8 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:46.711905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f507503-3954-4a11-b62a-462a31d9dff8 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:46.712008 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f507503-3954-4a11-b62a-462a31d9dff8 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:46.713349 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 11/22] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:08:46.717216 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4903ca-5ace-4150-8039-1eadf44b268f None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:46.719280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee27c7-d687-419f-8a86-da4de16591c8 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:46.719882 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee27c7-d687-419f-8a86-da4de16591c8 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:46.720374 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee27c7-d687-419f-8a86-da4de16591c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:46.723612 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4903ca-5ace-4150-8039-1eadf44b268f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:46.724630 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4903ca-5ace-4150-8039-1eadf44b268f None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:46.735492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 12/23] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:08:46 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:08:46.741471 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f796b8b-f8fe-4f3d-b92e-15bce15cad84 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:46.742049 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f796b8b-f8fe-4f3d-b92e-15bce15cad84 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:46.742523 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f796b8b-f8fe-4f3d-b92e-15bce15cad84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:46.749843 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-00ee27c7-d687-419f-8a86-da4de16591c8 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:08:46.752203 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-00ee27c7-d687-419f-8a86-da4de16591c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:08:46.771370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-5f796b8b-f8fe-4f3d-b92e-15bce15cad84 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:08:46.772900 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-5f796b8b-f8fe-4f3d-b92e-15bce15cad84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:08:46.891230 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 12/24] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:08:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 08:08:46.894063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e3b12-9ea1-421e-a5da-a0dfc5836106 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:46.895237 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e3b12-9ea1-421e-a5da-a0dfc5836106 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:46.896341 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e3b12-9ea1-421e-a5da-a0dfc5836106 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:46.899442 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 13/25] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:08:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:08:46.907177 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78e157-96d6-4c89-81b4-054b73b34fbf None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:46.908311 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78e157-96d6-4c89-81b4-054b73b34fbf None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:46.908948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78e157-96d6-4c89-81b4-054b73b34fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:46.916366 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 13/26] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:08:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 08:08:46.931135 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f796b8b-f8fe-4f3d-b92e-15bce15cad84 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:46.951917 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-cb78e157-96d6-4c89-81b4-054b73b34fbf None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:08:46.953442 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-cb78e157-96d6-4c89-81b4-054b73b34fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:08:46.998608 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:47.085070 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 14/27] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:08:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:08:47.085950 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78e157-96d6-4c89-81b4-054b73b34fbf None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:47.092525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f796b8b-f8fe-4f3d-b92e-15bce15cad84 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:47.110031 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:47.141714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279e388-bf4c-4fff-af7c-33d05acda486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:47.143323 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279e388-bf4c-4fff-af7c-33d05acda486 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:47.144301 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279e388-bf4c-4fff-af7c-33d05acda486 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:47.144742 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279e388-bf4c-4fff-af7c-33d05acda486 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:47.146141 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279e388-bf4c-4fff-af7c-33d05acda486 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:47.148475 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279e388-bf4c-4fff-af7c-33d05acda486 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:47.213394 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78e157-96d6-4c89-81b4-054b73b34fbf None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:47.249662 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c71bfe-c920-4b16-9d12-61aa799da2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:47.250708 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c71bfe-c920-4b16-9d12-61aa799da2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:47.251180 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c71bfe-c920-4b16-9d12-61aa799da2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:47.251585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c71bfe-c920-4b16-9d12-61aa799da2d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:47.275853 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c71bfe-c920-4b16-9d12-61aa799da2d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:08:47.284143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-a2c71bfe-c920-4b16-9d12-61aa799da2d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:08:47.284143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:08:47.284143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:08:47.284143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:08:47.284143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:08:47.284143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:08:47.284143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:08:47.284143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:08:47.284143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:08:47.284143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:08:47.284143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:08:47.284143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:08:47.284143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:08:47.284143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:08:47.284143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:08:47.284143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:08:47.285199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:08:47.285199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:08:47.285199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:08:47.285199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:08:47.285199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:08:47.285199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:08:47.285199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:08:47.285199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:08:47.285199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:08:47.285199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:08:47.285199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:08:47.285199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:08:47.285199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:08:47.285199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:08:47.285199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:08:47.285199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:08:47.286179 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:08:47.286179 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:08:47.286179 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:08:47.286179 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:08:47.286179 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:08:47.286179 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:08:47.286179 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:08:47.286179 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:08:47.286179 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:08:47.286179 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:08:47.286179 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:08:47.286179 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:08:47.288060 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 15/28] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:08:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:08:47.289472 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6d858-97a5-4c66-b563-0cf8b44514c4 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:47.289918 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6d858-97a5-4c66-b563-0cf8b44514c4 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:47.290377 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6d858-97a5-4c66-b563-0cf8b44514c4 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:47.291867 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 16/29] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:08:47.292668 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6d858-97a5-4c66-b563-0cf8b44514c4 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:47.297355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 14/30] 10.222.0.57 () {60 vars in 1131 bytes} [Sat Jun 4 08:08:46 2022] POST /identity/v3/roles => generated 219 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:08:47.303028 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67cb5b-bbb8-4b79-bea2-7571294a091e None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:47.303367 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67cb5b-bbb8-4b79-bea2-7571294a091e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:47.303658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67cb5b-bbb8-4b79-bea2-7571294a091e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:47.343331 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-4f67cb5b-bbb8-4b79-bea2-7571294a091e None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:08:47.345215 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4f67cb5b-bbb8-4b79-bea2-7571294a091e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:08:47.394797 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:47.451576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 15/31] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:08:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:08:47.457848 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67cb5b-bbb8-4b79-bea2-7571294a091e None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:47.459403 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6d858-97a5-4c66-b563-0cf8b44514c4 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:47.493745 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:47.523683 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd70f9b-37c3-4d89-bfd2-f2d56efa85c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:47.524719 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd70f9b-37c3-4d89-bfd2-f2d56efa85c3 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:47.525235 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd70f9b-37c3-4d89-bfd2-f2d56efa85c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:47.525715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd70f9b-37c3-4d89-bfd2-f2d56efa85c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:47.526586 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd70f9b-37c3-4d89-bfd2-f2d56efa85c3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:47.528110 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd70f9b-37c3-4d89-bfd2-f2d56efa85c3 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:47.597873 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67cb5b-bbb8-4b79-bea2-7571294a091e None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:47.647340 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d450432-d4b5-436c-a37c-8fea09c36f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:47.648335 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d450432-d4b5-436c-a37c-8fea09c36f26 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:47.648830 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d450432-d4b5-436c-a37c-8fea09c36f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:47.649388 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d450432-d4b5-436c-a37c-8fea09c36f26 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:47.650418 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d450432-d4b5-436c-a37c-8fea09c36f26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:08:47.650962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d450432-d4b5-436c-a37c-8fea09c36f26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:47.652752 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d450432-d4b5-436c-a37c-8fea09c36f26 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:47.666555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 16/32] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:08:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:08:47.668257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4514085-1bcd-4b08-82e4-8eb334f23c1b None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:47.668748 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4514085-1bcd-4b08-82e4-8eb334f23c1b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:47.669237 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4514085-1bcd-4b08-82e4-8eb334f23c1b None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:47.674729 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 17/34] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:08:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:08:47.675952 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4514085-1bcd-4b08-82e4-8eb334f23c1b None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:47.677901 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 17/34] 10.222.0.57 () {60 vars in 1131 bytes} [Sat Jun 4 08:08:47 2022] POST /identity/v3/roles => generated 225 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:08:47.679415 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd70f9b-37c3-4d89-bfd2-f2d56efa85c3 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:47.781192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:47.802937 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd70f9b-37c3-4d89-bfd2-f2d56efa85c3 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:47.808655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4514085-1bcd-4b08-82e4-8eb334f23c1b None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:47.843816 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f2628-ca3a-4ea9-9ab9-e662be099bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:47.844712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f2628-ca3a-4ea9-9ab9-e662be099bdd None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:47.844999 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f2628-ca3a-4ea9-9ab9-e662be099bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:47.845277 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f2628-ca3a-4ea9-9ab9-e662be099bdd None admin] PATH_INFO: `/v3/users/1757b5d7af48479b9e3aef95e06a280d` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:47.846671 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f2628-ca3a-4ea9-9ab9-e662be099bdd None admin] RBAC: Authorizing `identity:get_user(user_id=1757b5d7af48479b9e3aef95e06a280d)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:47.848489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f2628-ca3a-4ea9-9ab9-e662be099bdd None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:47.850221 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 18/35] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:08:47 2022] GET /identity/v3/users/1757b5d7af48479b9e3aef95e06a280d => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:08:47.851548 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c1067-beb8-46f7-a568-53dfde22d169 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:47.851837 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c1067-beb8-46f7-a568-53dfde22d169 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:47.852116 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c1067-beb8-46f7-a568-53dfde22d169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:47.861491 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090304d-1272-4207-b758-a983a05428ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:47.862939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090304d-1272-4207-b758-a983a05428ec None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:47.863228 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090304d-1272-4207-b758-a983a05428ec None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:47.863505 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090304d-1272-4207-b758-a983a05428ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:47.871343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-4c1c1067-beb8-46f7-a568-53dfde22d169 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:08:47.872886 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4c1c1067-beb8-46f7-a568-53dfde22d169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:08:47.877165 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:47.877900 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090304d-1272-4207-b758-a983a05428ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:47.880140 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090304d-1272-4207-b758-a983a05428ec None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:47.906864 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-3090304d-1272-4207-b758-a983a05428ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:08:47.906864 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:08:47.906864 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:08:47.906864 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:08:47.906864 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:08:47.906864 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:08:47.906864 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:08:47.906864 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:08:47.906864 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:08:47.906864 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:08:47.906864 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:08:47.906864 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:08:47.906864 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:08:47.906864 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:08:47.906864 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:08:47.907747 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:08:47.907747 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:08:47.907747 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:08:47.907747 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:08:47.907747 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:08:47.907747 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:08:47.907747 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:08:47.907747 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:08:47.907747 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:08:47.907747 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:08:47.907747 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:08:47.907747 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:08:47.907747 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:08:47.907747 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:08:47.907747 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:08:47.907747 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:08:47.907747 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:08:47.908553 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:08:47.908553 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:08:47.908553 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:08:47.908553 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:08:47.909322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 18/36] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:08:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:08:47.910511 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090304d-1272-4207-b758-a983a05428ec None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:47.966879 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 19/37] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:08:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:08:47.968060 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c1067-beb8-46f7-a568-53dfde22d169 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:48.035299 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090304d-1272-4207-b758-a983a05428ec None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:48.065331 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:48.070777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf7235-a472-4df7-942b-e9ce00851c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:48.071577 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf7235-a472-4df7-942b-e9ce00851c4e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:48.071862 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf7235-a472-4df7-942b-e9ce00851c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:48.072139 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf7235-a472-4df7-942b-e9ce00851c4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:48.072901 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c1067-beb8-46f7-a568-53dfde22d169 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:48.073322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf7235-a472-4df7-942b-e9ce00851c4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:48.074811 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf7235-a472-4df7-942b-e9ce00851c4e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:48.076427 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 19/38] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:08:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:08:48.077596 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff9bfc-6060-4d5b-bc06-278806410c59 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:48.077903 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff9bfc-6060-4d5b-bc06-278806410c59 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:48.078185 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff9bfc-6060-4d5b-bc06-278806410c59 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:48.083711 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 20/39] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:08:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:08:48.083711 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff9bfc-6060-4d5b-bc06-278806410c59 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:48.111322 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a5a85-024e-4d9c-b879-72f42ea57934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:48.111990 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a5a85-024e-4d9c-b879-72f42ea57934 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:48.112281 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a5a85-024e-4d9c-b879-72f42ea57934 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:48.112560 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a5a85-024e-4d9c-b879-72f42ea57934 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:48.113292 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a5a85-024e-4d9c-b879-72f42ea57934 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:08:48.113611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a5a85-024e-4d9c-b879-72f42ea57934 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:48.115042 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a5a85-024e-4d9c-b879-72f42ea57934 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:48.132965 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:48.137455 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 20/40] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:08:48.138257 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a5a85-024e-4d9c-b879-72f42ea57934 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:48.187282 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff9bfc-6060-4d5b-bc06-278806410c59 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:48.220451 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34eedf0-40dc-4839-8832-4252ae380c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:48.221240 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34eedf0-40dc-4839-8832-4252ae380c36 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:48.221525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34eedf0-40dc-4839-8832-4252ae380c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:48.221843 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34eedf0-40dc-4839-8832-4252ae380c36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:48.223039 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34eedf0-40dc-4839-8832-4252ae380c36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:48.224511 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34eedf0-40dc-4839-8832-4252ae380c36 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:48.226159 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 21/41] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:08:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:08:48.227287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392f80c-381e-42ad-be42-1f4ecbecd2a5 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:48.227575 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392f80c-381e-42ad-be42-1f4ecbecd2a5 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:48.227857 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392f80c-381e-42ad-be42-1f4ecbecd2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:48.239333 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a5a85-024e-4d9c-b879-72f42ea57934 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:48.244255 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-b392f80c-381e-42ad-be42-1f4ecbecd2a5 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:08:48.245446 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b392f80c-381e-42ad-be42-1f4ecbecd2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:08:48.274052 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7817fe-385f-41b4-bf27-e727e79f7cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:48.274925 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7817fe-385f-41b4-bf27-e727e79f7cfb None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:48.275215 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7817fe-385f-41b4-bf27-e727e79f7cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:48.275499 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7817fe-385f-41b4-bf27-e727e79f7cfb None admin] PATH_INFO: `/v3/domains/default/users/1757b5d7af48479b9e3aef95e06a280d/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:48.277536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7817fe-385f-41b4-bf27-e727e79f7cfb None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1757b5d7af48479b9e3aef95e06a280d, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:48.279047 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7817fe-385f-41b4-bf27-e727e79f7cfb None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:48.295095 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 21/42] 10.222.0.57 () {58 vars in 1361 bytes} [Sat Jun 4 08:08:48 2022] PUT /identity/v3/domains/default/users/1757b5d7af48479b9e3aef95e06a280d/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:08:48.295836 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7817fe-385f-41b4-bf27-e727e79f7cfb None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:48.323987 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:48.332161 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 22/43] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:08:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:08:48.334720 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392f80c-381e-42ad-be42-1f4ecbecd2a5 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:48.372816 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:48.426153 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7817fe-385f-41b4-bf27-e727e79f7cfb None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:48.468682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb137e2-67ff-40c7-84ab-239b145580c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:48.469402 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb137e2-67ff-40c7-84ab-239b145580c0 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:48.469693 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb137e2-67ff-40c7-84ab-239b145580c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:48.470012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb137e2-67ff-40c7-84ab-239b145580c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:48.470747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb137e2-67ff-40c7-84ab-239b145580c0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:48.472287 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb137e2-67ff-40c7-84ab-239b145580c0 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:48.475373 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392f80c-381e-42ad-be42-1f4ecbecd2a5 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:48.513923 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 22/44] 10.222.0.57 () {60 vars in 1141 bytes} [Sat Jun 4 08:08:48 2022] POST /identity/v3/projects => generated 301 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:08:48.514967 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb137e2-67ff-40c7-84ab-239b145580c0 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:48.522320 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50511563-80c9-4652-96c0-007d188fd9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:48.523029 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50511563-80c9-4652-96c0-007d188fd9b2 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:48.523325 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50511563-80c9-4652-96c0-007d188fd9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:48.523608 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50511563-80c9-4652-96c0-007d188fd9b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:48.524381 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50511563-80c9-4652-96c0-007d188fd9b2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:48.526016 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50511563-80c9-4652-96c0-007d188fd9b2 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:48.560094 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 23/45] 10.222.0.57 () {60 vars in 1141 bytes} [Sat Jun 4 08:08:48 2022] POST /identity/v3/projects => generated 312 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:08:48.666903 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb137e2-67ff-40c7-84ab-239b145580c0 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:48.685485 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:48.712885 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143a05c-d45b-4457-a8af-76388901acf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:48.713894 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143a05c-d45b-4457-a8af-76388901acf7 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:48.714370 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143a05c-d45b-4457-a8af-76388901acf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:48.714849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143a05c-d45b-4457-a8af-76388901acf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:48.715790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143a05c-d45b-4457-a8af-76388901acf7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:48.717447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143a05c-d45b-4457-a8af-76388901acf7 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:48.737935 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 23/46] 10.222.0.57 () {60 vars in 1131 bytes} [Sat Jun 4 08:08:48 2022] POST /identity/v3/roles => generated 223 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:08:50.615843 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69674111-4ad7-4f55-bdba-ec51fdf1bd8b None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:50.616360 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69674111-4ad7-4f55-bdba-ec51fdf1bd8b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:50.616461 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69674111-4ad7-4f55-bdba-ec51fdf1bd8b None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:50.617761 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 24/47] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:08:50.623137 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07edf6-8bd4-44b9-9625-e3cd2a27a906 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:50.623538 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07edf6-8bd4-44b9-9625-e3cd2a27a906 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:50.623711 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07edf6-8bd4-44b9-9625-e3cd2a27a906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:50.644440 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-fd07edf6-8bd4-44b9-9625-e3cd2a27a906 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:08:50.645639 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-fd07edf6-8bd4-44b9-9625-e3cd2a27a906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:08:50.718928 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 24/48] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:08:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 08:08:50.742956 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69674111-4ad7-4f55-bdba-ec51fdf1bd8b None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:50.793674 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:50.844210 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69674111-4ad7-4f55-bdba-ec51fdf1bd8b None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:50.848240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df01fa-4d06-4d7f-af09-63755abc6ec6 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:50.848533 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df01fa-4d06-4d7f-af09-63755abc6ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:50.848815 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df01fa-4d06-4d7f-af09-63755abc6ec6 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:50.850395 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 25/49] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:08:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:08:50.854993 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1279b8-4046-4135-a136-af36bf1fa210 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:50.855285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1279b8-4046-4135-a136-af36bf1fa210 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:50.855571 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1279b8-4046-4135-a136-af36bf1fa210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:50.872178 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-7b1279b8-4046-4135-a136-af36bf1fa210 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:08:50.873317 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-7b1279b8-4046-4135-a136-af36bf1fa210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:08:50.878691 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a92dca-90e3-48ce-9999-8fca9d80e449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:50.879490 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a92dca-90e3-48ce-9999-8fca9d80e449 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:50.879777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a92dca-90e3-48ce-9999-8fca9d80e449 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:50.880057 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a92dca-90e3-48ce-9999-8fca9d80e449 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:50.894095 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a92dca-90e3-48ce-9999-8fca9d80e449 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:08:50.903020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-d1a92dca-90e3-48ce-9999-8fca9d80e449 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:08:50.903020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:08:50.903020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:08:50.903020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:08:50.903020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:08:50.903020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:08:50.903020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:08:50.903020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:08:50.903020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:08:50.903020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:08:50.903020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:08:50.903020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:08:50.903020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:08:50.903020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:08:50.903020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:08:50.903020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:08:50.903876 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:08:50.903876 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:08:50.903876 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:08:50.903876 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:08:50.903876 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:08:50.903876 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:08:50.903876 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:08:50.903876 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:08:50.903876 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:08:50.903876 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:08:50.903876 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:08:50.903876 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:08:50.903876 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:08:50.903876 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:08:50.903876 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:08:50.903876 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:08:50.904650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:08:50.904650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:08:50.904650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:08:50.904650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:08:50.904650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:08:50.904650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:08:50.904650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:08:50.904650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:08:50.904650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:08:50.904650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:08:50.904650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:08:50.904650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:08:50.904650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 25/50] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:08:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:08:50.910522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a92dca-90e3-48ce-9999-8fca9d80e449 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:50.943438 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 26/51] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:08:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 08:08:50.965958 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1279b8-4046-4135-a136-af36bf1fa210 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:50.995350 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:51.010284 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a92dca-90e3-48ce-9999-8fca9d80e449 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:51.020935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:51.045933 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641ebe4-6be0-434a-bc1d-29dbd807f89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:51.046605 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641ebe4-6be0-434a-bc1d-29dbd807f89a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:51.046891 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641ebe4-6be0-434a-bc1d-29dbd807f89a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:51.047180 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641ebe4-6be0-434a-bc1d-29dbd807f89a None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:51.047921 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641ebe4-6be0-434a-bc1d-29dbd807f89a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:08:51.048232 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641ebe4-6be0-434a-bc1d-29dbd807f89a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:51.049627 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641ebe4-6be0-434a-bc1d-29dbd807f89a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:51.057754 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 26/52] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:08:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:08:51.063226 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641ebe4-6be0-434a-bc1d-29dbd807f89a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:51.065566 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1279b8-4046-4135-a136-af36bf1fa210 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:51.100588 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693592b3-6e16-43e6-b768-5bafe63c4a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:51.101375 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693592b3-6e16-43e6-b768-5bafe63c4a98 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:51.101657 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693592b3-6e16-43e6-b768-5bafe63c4a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:51.101969 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693592b3-6e16-43e6-b768-5bafe63c4a98 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:51.103130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693592b3-6e16-43e6-b768-5bafe63c4a98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:51.104592 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693592b3-6e16-43e6-b768-5bafe63c4a98 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:51.106247 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 27/53] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:08:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:08:51.111738 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693592b3-6e16-43e6-b768-5bafe63c4a98 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:51.162239 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641ebe4-6be0-434a-bc1d-29dbd807f89a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:51.195394 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c102820-0c68-4d11-99ac-f9ca4a227b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:51.196271 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c102820-0c68-4d11-99ac-f9ca4a227b42 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:51.196556 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c102820-0c68-4d11-99ac-f9ca4a227b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:51.196832 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c102820-0c68-4d11-99ac-f9ca4a227b42 None admin] PATH_INFO: `/v3/users/1757b5d7af48479b9e3aef95e06a280d` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:51.198076 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c102820-0c68-4d11-99ac-f9ca4a227b42 None admin] RBAC: Authorizing `identity:get_user(user_id=1757b5d7af48479b9e3aef95e06a280d)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:51.199522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c102820-0c68-4d11-99ac-f9ca4a227b42 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:51.201140 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 27/54] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:08:51 2022] GET /identity/v3/users/1757b5d7af48479b9e3aef95e06a280d => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:08:51.207092 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c102820-0c68-4d11-99ac-f9ca4a227b42 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:51.207621 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:51.210934 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693592b3-6e16-43e6-b768-5bafe63c4a98 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:51.244075 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1620e-9c59-412e-a675-a3151402452e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:51.244731 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1620e-9c59-412e-a675-a3151402452e None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:51.245018 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1620e-9c59-412e-a675-a3151402452e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:51.245296 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1620e-9c59-412e-a675-a3151402452e None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:51.246034 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1620e-9c59-412e-a675-a3151402452e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:51.247466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1620e-9c59-412e-a675-a3151402452e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:51.247712 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:51.272364 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 28/55] 10.222.0.57 () {60 vars in 1140 bytes} [Sat Jun 4 08:08:51 2022] POST /identity/v3/projects => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:08:51.309372 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c102820-0c68-4d11-99ac-f9ca4a227b42 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:51.345955 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc3226-8dd9-45ae-ab8a-fb9bbf45ae22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:51.346797 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc3226-8dd9-45ae-ab8a-fb9bbf45ae22 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:51.347088 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc3226-8dd9-45ae-ab8a-fb9bbf45ae22 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:51.347368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc3226-8dd9-45ae-ab8a-fb9bbf45ae22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:51.348597 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc3226-8dd9-45ae-ab8a-fb9bbf45ae22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:51.350121 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc3226-8dd9-45ae-ab8a-fb9bbf45ae22 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:51.351991 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 28/56] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:08:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:08:51.357910 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1620e-9c59-412e-a675-a3151402452e None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:51.464231 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1620e-9c59-412e-a675-a3151402452e None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:51.499075 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018fa88-6af9-4b5e-879b-94975bad423d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:51.499746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018fa88-6af9-4b5e-879b-94975bad423d None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:51.500038 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018fa88-6af9-4b5e-879b-94975bad423d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:51.500322 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018fa88-6af9-4b5e-879b-94975bad423d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:51.501167 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018fa88-6af9-4b5e-879b-94975bad423d None admin] RBAC: Adding query filter params (role.id=431cef539cfb476aad50d2470e763b5f, scope.domain.id=default, user.id=1757b5d7af48479b9e3aef95e06a280d) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:08:51.501479 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018fa88-6af9-4b5e-879b-94975bad423d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:51.502988 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018fa88-6af9-4b5e-879b-94975bad423d None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:51.511652 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 29/57] 10.222.0.57 () {56 vars in 1322 bytes} [Sat Jun 4 08:08:51 2022] GET /identity/v3/role_assignments?user.id=1757b5d7af48479b9e3aef95e06a280d&scope.domain.id=default&role.id=431cef539cfb476aad50d2470e763b5f => generated 530 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:08:53.516389 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2f6e0-dfc7-4f61-9a0b-bde64146063a None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:53.516933 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2f6e0-dfc7-4f61-9a0b-bde64146063a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:53.516933 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2f6e0-dfc7-4f61-9a0b-bde64146063a None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:53.518358 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 29/58] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:08:53.523522 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866a7d5-9994-4ca3-9d41-27d8ad3e263e None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:53.523890 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866a7d5-9994-4ca3-9d41-27d8ad3e263e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:53.524083 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866a7d5-9994-4ca3-9d41-27d8ad3e263e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:53.540982 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-e866a7d5-9994-4ca3-9d41-27d8ad3e263e None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:08:53.542197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e866a7d5-9994-4ca3-9d41-27d8ad3e263e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:08:53.553338 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:53.607796 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 30/59] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:08:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:08:53.632494 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2f6e0-dfc7-4f61-9a0b-bde64146063a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:53.733909 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2f6e0-dfc7-4f61-9a0b-bde64146063a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:53.743049 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:53.767302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe1bdb-fc62-4c2a-be3f-f67fee647814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:53.768028 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe1bdb-fc62-4c2a-be3f-f67fee647814 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:53.768312 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe1bdb-fc62-4c2a-be3f-f67fee647814 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:53.769093 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe1bdb-fc62-4c2a-be3f-f67fee647814 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:53.770283 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe1bdb-fc62-4c2a-be3f-f67fee647814 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:53.771717 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe1bdb-fc62-4c2a-be3f-f67fee647814 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:53.773314 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 30/60] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:08:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:08:53.778792 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866a7d5-9994-4ca3-9d41-27d8ad3e263e None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:53.875030 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866a7d5-9994-4ca3-9d41-27d8ad3e263e None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:53.907578 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5f752-73d2-4be6-bcb0-beddf92798cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:53.908231 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5f752-73d2-4be6-bcb0-beddf92798cc None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:53.908516 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5f752-73d2-4be6-bcb0-beddf92798cc None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:53.908791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5f752-73d2-4be6-bcb0-beddf92798cc None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:53.910143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e5f752-73d2-4be6-bcb0-beddf92798cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:53.911613 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e5f752-73d2-4be6-bcb0-beddf92798cc None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:53.936385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 31/61] 10.222.0.57 () {60 vars in 1132 bytes} [Sat Jun 4 08:08:53 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:08:57.374512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5024b-f75e-4388-a6ba-9461a9f3e0ad None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:57.375591 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5024b-f75e-4388-a6ba-9461a9f3e0ad None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:57.376077 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5024b-f75e-4388-a6ba-9461a9f3e0ad None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:57.377745 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 31/62] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:08:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:08:57.395348 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35f38d-1d04-4b53-8da1-410a7f4e17a1 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:57.396426 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35f38d-1d04-4b53-8da1-410a7f4e17a1 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:57.396956 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35f38d-1d04-4b53-8da1-410a7f4e17a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:57.407938 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:57.427399 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-5d35f38d-1d04-4b53-8da1-410a7f4e17a1 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:08:57.428647 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-5d35f38d-1d04-4b53-8da1-410a7f4e17a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:08:57.520503 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 32/63] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:08:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:08:57.555754 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5024b-f75e-4388-a6ba-9461a9f3e0ad None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:57.596065 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab3adf-4532-41cf-94a6-f40d73a80fa7 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:57.597209 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab3adf-4532-41cf-94a6-f40d73a80fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:57.597694 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab3adf-4532-41cf-94a6-f40d73a80fa7 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:57.599745 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 33/64] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:08:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 08:08:57.608847 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93d249-85ba-4e95-9f7a-2898674dfa15 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:57.609419 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93d249-85ba-4e95-9f7a-2898674dfa15 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:57.609917 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93d249-85ba-4e95-9f7a-2898674dfa15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:57.637591 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-0b93d249-85ba-4e95-9f7a-2898674dfa15 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:08:57.638734 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0b93d249-85ba-4e95-9f7a-2898674dfa15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:08:57.717198 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5024b-f75e-4388-a6ba-9461a9f3e0ad None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:57.752529 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd801db-4092-4172-aace-64aaebb8b91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:57.754197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd801db-4092-4172-aace-64aaebb8b91d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:57.754727 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd801db-4092-4172-aace-64aaebb8b91d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:57.755176 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd801db-4092-4172-aace-64aaebb8b91d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:57.756387 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 34/65] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:08:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 08:08:57.759179 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ae5bc-8327-4584-bd28-9845b7b8fe8c None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:57.759611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ae5bc-8327-4584-bd28-9845b7b8fe8c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:57.760057 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ae5bc-8327-4584-bd28-9845b7b8fe8c None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:57.761498 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 35/66] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:08:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:08:57.769110 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45392d-4d73-4bd1-aaa3-2cedd9b0691f None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:57.769581 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45392d-4d73-4bd1-aaa3-2cedd9b0691f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:57.770043 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45392d-4d73-4bd1-aaa3-2cedd9b0691f None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:57.771590 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 36/67] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:08:57.772788 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7c802-f64a-494e-a5c4-3f99caed3602 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:57.773084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7c802-f64a-494e-a5c4-3f99caed3602 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:57.773339 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd801db-4092-4172-aace-64aaebb8b91d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:08:57.773451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7c802-f64a-494e-a5c4-3f99caed3602 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:57.774594 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 37/68] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:08:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:08:57.775690 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1991d80-fc1b-4296-b9cd-469d733db506 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:57.775981 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1991d80-fc1b-4296-b9cd-469d733db506 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:57.776326 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1991d80-fc1b-4296-b9cd-469d733db506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:57.782850 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-edd801db-4092-4172-aace-64aaebb8b91d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 08:08:57.782850 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:08:57.782850 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:08:57.782850 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:08:57.782850 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:08:57.782850 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:08:57.782850 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:08:57.782850 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:08:57.782850 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:08:57.782850 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:08:57.782850 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:08:57.782850 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:08:57.782850 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:08:57.782850 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:08:57.782850 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:08:57.782850 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:08:57.783904 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:08:57.783904 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:08:57.783904 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:08:57.783904 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:08:57.783904 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:08:57.783904 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:08:57.783904 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:08:57.783904 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:08:57.783904 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:08:57.783904 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:08:57.783904 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:08:57.783904 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:08:57.783904 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:08:57.783904 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:08:57.783904 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:08:57.783904 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:08:57.784769 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:08:57.784769 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:08:57.784769 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:08:57.784769 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:08:57.784769 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:08:57.784769 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:08:57.784769 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:08:57.784769 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:08:57.784769 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:08:57.784769 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:08:57.784769 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 08:08:57.784769 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:08:57.784769 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 32/69] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jun 4 08:08:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:08:57.785411 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410e3f8-7f28-444a-9971-7ff791400fbc None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:57.785849 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410e3f8-7f28-444a-9971-7ff791400fbc None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:57.786005 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410e3f8-7f28-444a-9971-7ff791400fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:57.794687 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-e1991d80-fc1b-4296-b9cd-469d733db506 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:08:57.795872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e1991d80-fc1b-4296-b9cd-469d733db506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:08:57.802938 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6410e3f8-7f28-444a-9971-7ff791400fbc None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:08:57.804115 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6410e3f8-7f28-444a-9971-7ff791400fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:08:57.832779 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:57.852243 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:57.863519 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 38/70] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:08:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:08:57.864766 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda68512-21e6-42e4-9c75-24c4c60dbfe0 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:57.865053 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda68512-21e6-42e4-9c75-24c4c60dbfe0 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:57.865339 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda68512-21e6-42e4-9c75-24c4c60dbfe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:57.876467 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 33/71] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:08:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:08:57.877315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410e3f8-7f28-444a-9971-7ff791400fbc None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:57.894787 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-dda68512-21e6-42e4-9c75-24c4c60dbfe0 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:08:57.895907 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-dda68512-21e6-42e4-9c75-24c4c60dbfe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:08:57.964221 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 39/72] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:08:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:08:57.965074 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda68512-21e6-42e4-9c75-24c4c60dbfe0 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:57.987434 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410e3f8-7f28-444a-9971-7ff791400fbc None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:58.021828 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82baa33-54fe-46a7-b13e-11fce9713e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:58.022654 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82baa33-54fe-46a7-b13e-11fce9713e2e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:58.022944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82baa33-54fe-46a7-b13e-11fce9713e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:58.023221 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82baa33-54fe-46a7-b13e-11fce9713e2e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:58.033146 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82baa33-54fe-46a7-b13e-11fce9713e2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:08:58.041579 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-d82baa33-54fe-46a7-b13e-11fce9713e2e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:08:58.041579 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:08:58.041579 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:08:58.041579 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:08:58.041579 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:08:58.041579 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:08:58.041579 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:08:58.041579 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:08:58.041579 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:08:58.041579 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:08:58.041579 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:08:58.041579 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:08:58.041579 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:08:58.041579 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:08:58.041579 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:08:58.041579 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:08:58.042588 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:08:58.042588 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:08:58.042588 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:08:58.042588 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:08:58.042588 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:08:58.042588 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:08:58.042588 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:08:58.042588 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:08:58.042588 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:08:58.042588 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:08:58.042588 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:08:58.042588 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:08:58.042588 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:08:58.042588 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:08:58.042588 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:08:58.042588 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:08:58.048276 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:08:58.048276 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:08:58.048276 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:08:58.048276 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:08:58.048276 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:08:58.048276 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:08:58.048276 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:08:58.048276 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:08:58.048276 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:08:58.048276 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:08:58.048276 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:08:58.048276 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:08:58.048276 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 34/73] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:08:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:08:58.048276 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82baa33-54fe-46a7-b13e-11fce9713e2e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:58.065514 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda68512-21e6-42e4-9c75-24c4c60dbfe0 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:58.074323 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:58.087899 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:58.100798 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b66ad6-e334-4f07-a0a7-a23ac5f21118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:58.101469 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b66ad6-e334-4f07-a0a7-a23ac5f21118 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:58.101764 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b66ad6-e334-4f07-a0a7-a23ac5f21118 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:58.102077 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b66ad6-e334-4f07-a0a7-a23ac5f21118 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:58.102830 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b66ad6-e334-4f07-a0a7-a23ac5f21118 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:08:58.103141 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b66ad6-e334-4f07-a0a7-a23ac5f21118 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:58.104541 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b66ad6-e334-4f07-a0a7-a23ac5f21118 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:58.112356 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 40/74] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:08:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:08:58.113701 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b66ad6-e334-4f07-a0a7-a23ac5f21118 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:58.155859 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82baa33-54fe-46a7-b13e-11fce9713e2e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:58.188590 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac7a9f-e9a0-4564-a090-c6d125137cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:58.189391 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac7a9f-e9a0-4564-a090-c6d125137cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:58.189685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac7a9f-e9a0-4564-a090-c6d125137cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:58.190002 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac7a9f-e9a0-4564-a090-c6d125137cd7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:58.191724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac7a9f-e9a0-4564-a090-c6d125137cd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:58.193259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac7a9f-e9a0-4564-a090-c6d125137cd7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:58.195110 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 35/75] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:08:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:08:58.195689 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac7a9f-e9a0-4564-a090-c6d125137cd7 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:58.218421 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b66ad6-e334-4f07-a0a7-a23ac5f21118 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:58.253219 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26c61e-56ff-4314-892b-52d607103886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:58.254541 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26c61e-56ff-4314-892b-52d607103886 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:58.254830 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26c61e-56ff-4314-892b-52d607103886 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:58.255107 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26c61e-56ff-4314-892b-52d607103886 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:58.265318 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26c61e-56ff-4314-892b-52d607103886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:08:58.273063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-af26c61e-56ff-4314-892b-52d607103886 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:08:58.273063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:08:58.273063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:08:58.273063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:08:58.273063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:08:58.273063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:08:58.273063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:08:58.273063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:08:58.273063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:08:58.273063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:08:58.273063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:08:58.273063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:08:58.273063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:08:58.273063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:08:58.273063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:08:58.273063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:08:58.273948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:08:58.273948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:08:58.273948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:08:58.273948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:08:58.273948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:08:58.273948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:08:58.273948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:08:58.273948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:08:58.273948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:08:58.273948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:08:58.273948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:08:58.273948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:08:58.273948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:08:58.273948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:08:58.273948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:08:58.273948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:08:58.274710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:08:58.274710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:08:58.274710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:08:58.274710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:08:58.274710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:08:58.274710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:08:58.274710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:08:58.274710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:08:58.274710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:08:58.274710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:08:58.274710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:08:58.274710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:08:58.274710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 41/76] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:08:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:08:58.275338 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26c61e-56ff-4314-892b-52d607103886 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:58.295123 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:58.302848 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac7a9f-e9a0-4564-a090-c6d125137cd7 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:58.321058 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:58.336377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534aca08-93d7-4f15-8ace-eabb941a5d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:58.337175 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534aca08-93d7-4f15-8ace-eabb941a5d25 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:58.337465 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534aca08-93d7-4f15-8ace-eabb941a5d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:58.337752 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534aca08-93d7-4f15-8ace-eabb941a5d25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:58.348362 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534aca08-93d7-4f15-8ace-eabb941a5d25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:08:58.355977 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-534aca08-93d7-4f15-8ace-eabb941a5d25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:08:58.355977 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:08:58.355977 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:08:58.355977 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:08:58.355977 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:08:58.355977 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:08:58.355977 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:08:58.355977 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:08:58.355977 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:08:58.355977 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:08:58.355977 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:08:58.355977 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:08:58.355977 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:08:58.355977 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:08:58.355977 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:08:58.355977 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:08:58.356825 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:08:58.356825 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:08:58.356825 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:08:58.356825 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:08:58.356825 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:08:58.356825 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:08:58.356825 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:08:58.356825 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:08:58.356825 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:08:58.356825 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:08:58.356825 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:08:58.356825 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:08:58.356825 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:08:58.356825 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:08:58.356825 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:08:58.356825 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:08:58.363322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:08:58.363322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:08:58.363322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:08:58.363322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:08:58.363322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:08:58.363322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:08:58.363322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:08:58.363322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:08:58.363322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:08:58.363322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:08:58.363322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:08:58.363322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:08:58.363322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 36/77] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:08:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:08:58.363322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534aca08-93d7-4f15-8ace-eabb941a5d25 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:58.377053 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26c61e-56ff-4314-892b-52d607103886 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:58.411181 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33822eb-a7b5-4139-9c9d-2c7296d8005b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:58.411783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33822eb-a7b5-4139-9c9d-2c7296d8005b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:58.412049 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33822eb-a7b5-4139-9c9d-2c7296d8005b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:58.412327 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33822eb-a7b5-4139-9c9d-2c7296d8005b None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:58.413065 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33822eb-a7b5-4139-9c9d-2c7296d8005b None admin] RBAC: Adding query filter params (name=member) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:08:58.413370 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33822eb-a7b5-4139-9c9d-2c7296d8005b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:58.414798 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33822eb-a7b5-4139-9c9d-2c7296d8005b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:58.428109 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 42/78] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jun 4 08:08:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:08:58.428109 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33822eb-a7b5-4139-9c9d-2c7296d8005b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:58.467452 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534aca08-93d7-4f15-8ace-eabb941a5d25 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:58.501939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442c8c9-58fb-4049-a76b-e12e4c33346b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:58.502808 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442c8c9-58fb-4049-a76b-e12e4c33346b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:58.503137 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442c8c9-58fb-4049-a76b-e12e4c33346b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:58.503415 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442c8c9-58fb-4049-a76b-e12e4c33346b None admin] PATH_INFO: `/v3/users/8de86eb101ea4d8ca7abd59c20dd7150` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:58.516623 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442c8c9-58fb-4049-a76b-e12e4c33346b None admin] RBAC: Authorizing `identity:get_user(user_id=8de86eb101ea4d8ca7abd59c20dd7150)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:58.518115 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442c8c9-58fb-4049-a76b-e12e4c33346b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:58.520278 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 37/79] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:08:58 2022] GET /identity/v3/users/8de86eb101ea4d8ca7abd59c20dd7150 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:08:58.522622 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442c8c9-58fb-4049-a76b-e12e4c33346b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:58.524791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33822eb-a7b5-4139-9c9d-2c7296d8005b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:58.531523 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:58.539351 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:58.560529 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567f4f9-6a2c-4e04-82c0-4de20ae30e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:58.561226 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567f4f9-6a2c-4e04-82c0-4de20ae30e77 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:58.561510 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567f4f9-6a2c-4e04-82c0-4de20ae30e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:58.561787 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567f4f9-6a2c-4e04-82c0-4de20ae30e77 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:58.562516 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567f4f9-6a2c-4e04-82c0-4de20ae30e77 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:58.563949 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567f4f9-6a2c-4e04-82c0-4de20ae30e77 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:58.583422 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 43/80] 10.222.0.57 () {60 vars in 1132 bytes} [Sat Jun 4 08:08:58 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:08:58.584216 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567f4f9-6a2c-4e04-82c0-4de20ae30e77 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:58.637589 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442c8c9-58fb-4049-a76b-e12e4c33346b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:58.678689 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f5e6d-e510-49ae-8f15-21fb80151823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:58.679445 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f5e6d-e510-49ae-8f15-21fb80151823 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:58.679581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f5e6d-e510-49ae-8f15-21fb80151823 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:58.679951 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f5e6d-e510-49ae-8f15-21fb80151823 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:58.680740 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f5e6d-e510-49ae-8f15-21fb80151823 None admin] RBAC: Adding query filter params (name=member) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:08:58.681004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f5e6d-e510-49ae-8f15-21fb80151823 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:58.682479 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f5e6d-e510-49ae-8f15-21fb80151823 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:58.697086 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 38/81] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jun 4 08:08:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:08:58.697086 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f5e6d-e510-49ae-8f15-21fb80151823 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:58.707785 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567f4f9-6a2c-4e04-82c0-4de20ae30e77 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:58.747292 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60697372-059d-4277-92fe-d7097eefd68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:58.747987 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60697372-059d-4277-92fe-d7097eefd68d None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:58.748272 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60697372-059d-4277-92fe-d7097eefd68d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:58.748675 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60697372-059d-4277-92fe-d7097eefd68d None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:58.749322 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60697372-059d-4277-92fe-d7097eefd68d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:08:58.749633 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60697372-059d-4277-92fe-d7097eefd68d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:58.751191 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60697372-059d-4277-92fe-d7097eefd68d None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:58.765457 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 44/82] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:08:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:08:58.765457 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60697372-059d-4277-92fe-d7097eefd68d None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:58.788341 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:58.795577 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:58.823077 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f5e6d-e510-49ae-8f15-21fb80151823 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:58.861461 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10a5e1-643d-445c-b712-34b8b9acbf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:58.861651 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10a5e1-643d-445c-b712-34b8b9acbf9b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:58.862129 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10a5e1-643d-445c-b712-34b8b9acbf9b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:58.862459 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10a5e1-643d-445c-b712-34b8b9acbf9b None admin] PATH_INFO: `/v3/users/8de86eb101ea4d8ca7abd59c20dd7150` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:58.864788 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10a5e1-643d-445c-b712-34b8b9acbf9b None admin] RBAC: Authorizing `identity:get_user(user_id=8de86eb101ea4d8ca7abd59c20dd7150)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:58.866349 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10a5e1-643d-445c-b712-34b8b9acbf9b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:58.868051 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 39/83] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:08:58 2022] GET /identity/v3/users/8de86eb101ea4d8ca7abd59c20dd7150 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:08:58.868911 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10a5e1-643d-445c-b712-34b8b9acbf9b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:58.887080 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60697372-059d-4277-92fe-d7097eefd68d None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:58.939146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbc843-9eed-4ab4-8538-8cd169ec388f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:58.939746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbc843-9eed-4ab4-8538-8cd169ec388f None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:58.940487 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbc843-9eed-4ab4-8538-8cd169ec388f None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:58.940809 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbc843-9eed-4ab4-8538-8cd169ec388f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:58.998778 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10a5e1-643d-445c-b712-34b8b9acbf9b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:59.036005 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdbc843-9eed-4ab4-8538-8cd169ec388f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:59.038572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdbc843-9eed-4ab4-8538-8cd169ec388f None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:59.042492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255f6c2-1eba-4de1-9a89-b6446b7ed4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:59.044296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255f6c2-1eba-4de1-9a89-b6446b7ed4ed None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:59.044585 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255f6c2-1eba-4de1-9a89-b6446b7ed4ed None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:59.044863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255f6c2-1eba-4de1-9a89-b6446b7ed4ed None admin] PATH_INFO: `/v3/users/8de86eb101ea4d8ca7abd59c20dd7150` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:59.046205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255f6c2-1eba-4de1-9a89-b6446b7ed4ed None admin] RBAC: Authorizing `identity:get_user(user_id=8de86eb101ea4d8ca7abd59c20dd7150)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:59.047735 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255f6c2-1eba-4de1-9a89-b6446b7ed4ed None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:59.050634 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 40/84] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:08:58 2022] GET /identity/v3/users/8de86eb101ea4d8ca7abd59c20dd7150 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:08:59.051433 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255f6c2-1eba-4de1-9a89-b6446b7ed4ed None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:59.068315 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:59.069799 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:59.171320 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 45/85] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:08:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 08:08:59.172276 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbc843-9eed-4ab4-8538-8cd169ec388f None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:59.184634 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255f6c2-1eba-4de1-9a89-b6446b7ed4ed None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:59.222548 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3ce15-9157-47a5-b2d9-b4fe900f0c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:59.223372 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3ce15-9157-47a5-b2d9-b4fe900f0c2e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:59.223714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3ce15-9157-47a5-b2d9-b4fe900f0c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:59.224126 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3ce15-9157-47a5-b2d9-b4fe900f0c2e None admin] PATH_INFO: `/v3/users/1757b5d7af48479b9e3aef95e06a280d` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:59.225478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3ce15-9157-47a5-b2d9-b4fe900f0c2e None admin] RBAC: Authorizing `identity:get_user(user_id=1757b5d7af48479b9e3aef95e06a280d)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:59.226990 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3ce15-9157-47a5-b2d9-b4fe900f0c2e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:59.228948 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 41/86] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:08:59 2022] GET /identity/v3/users/1757b5d7af48479b9e3aef95e06a280d => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:08:59.229516 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3ce15-9157-47a5-b2d9-b4fe900f0c2e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:59.275946 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbc843-9eed-4ab4-8538-8cd169ec388f None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:59.300861 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:59.312778 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264343df-bd3c-41d7-9151-2502800a89b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:59.313575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264343df-bd3c-41d7-9151-2502800a89b7 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:59.313989 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264343df-bd3c-41d7-9151-2502800a89b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:59.314331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264343df-bd3c-41d7-9151-2502800a89b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:59.323815 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:59.358585 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3ce15-9157-47a5-b2d9-b4fe900f0c2e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:59.389745 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264343df-bd3c-41d7-9151-2502800a89b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:59.391255 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264343df-bd3c-41d7-9151-2502800a89b7 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:59.408653 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735c978-02b7-4572-ad52-7e1e990c75b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:59.409977 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735c978-02b7-4572-ad52-7e1e990c75b0 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:59.410830 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735c978-02b7-4572-ad52-7e1e990c75b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:59.411318 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735c978-02b7-4572-ad52-7e1e990c75b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:59.505002 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 46/87] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:08:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 08:08:59.505002 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264343df-bd3c-41d7-9151-2502800a89b7 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:59.514125 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735c978-02b7-4572-ad52-7e1e990c75b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:59.515674 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735c978-02b7-4572-ad52-7e1e990c75b0 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:59.537754 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:59.606073 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:59.634090 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264343df-bd3c-41d7-9151-2502800a89b7 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:59.635524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 42/88] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:08:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 08:08:59.636664 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735c978-02b7-4572-ad52-7e1e990c75b0 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:59.676516 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d97b10-02dc-4033-8db5-2a1546fa78ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:59.677912 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d97b10-02dc-4033-8db5-2a1546fa78ce None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:59.678328 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d97b10-02dc-4033-8db5-2a1546fa78ce None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:59.678697 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d97b10-02dc-4033-8db5-2a1546fa78ce None admin] PATH_INFO: `/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:59.680279 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d97b10-02dc-4033-8db5-2a1546fa78ce None admin] RBAC: Authorizing `identity:get_project(project_id=a9d904b06eb24d5d8bce3f192f7927ca)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:59.682777 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d97b10-02dc-4033-8db5-2a1546fa78ce None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:59.684596 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 47/89] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:08:59 2022] GET /identity/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:08:59.685446 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d97b10-02dc-4033-8db5-2a1546fa78ce None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:59.753852 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735c978-02b7-4572-ad52-7e1e990c75b0 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:59.788587 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c44b66-c529-4236-aabd-6a84b9edb613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:59.789176 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c44b66-c529-4236-aabd-6a84b9edb613 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:59.789464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c44b66-c529-4236-aabd-6a84b9edb613 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:59.789748 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c44b66-c529-4236-aabd-6a84b9edb613 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:59.818395 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:59.831632 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d97b10-02dc-4033-8db5-2a1546fa78ce None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:08:59.837859 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:08:59.864616 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c44b66-c529-4236-aabd-6a84b9edb613 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:59.866145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c44b66-c529-4236-aabd-6a84b9edb613 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:59.881677 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6197a-8fb3-4f9c-b0cb-a63f4936f4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:08:59.882922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6197a-8fb3-4f9c-b0cb-a63f4936f4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:08:59.883273 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6197a-8fb3-4f9c-b0cb-a63f4936f4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:08:59.884044 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6197a-8fb3-4f9c-b0cb-a63f4936f4d0 None admin] PATH_INFO: `/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:08:59.885507 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6197a-8fb3-4f9c-b0cb-a63f4936f4d0 None admin] RBAC: Authorizing `identity:get_project(project_id=a9d904b06eb24d5d8bce3f192f7927ca)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:08:59.887711 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6197a-8fb3-4f9c-b0cb-a63f4936f4d0 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:08:59.889497 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 48/90] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:08:59 2022] GET /identity/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:08:59.894080 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6197a-8fb3-4f9c-b0cb-a63f4936f4d0 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:08:59.985613 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 43/91] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:08:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 08:08:59.986809 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c44b66-c529-4236-aabd-6a84b9edb613 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:00.036908 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6197a-8fb3-4f9c-b0cb-a63f4936f4d0 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:00.079207 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:00.084098 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793d2eb-46ad-4b1e-a04d-86413398d59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:00.085253 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793d2eb-46ad-4b1e-a04d-86413398d59b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:00.085731 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793d2eb-46ad-4b1e-a04d-86413398d59b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:00.086221 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793d2eb-46ad-4b1e-a04d-86413398d59b None admin] PATH_INFO: `/v3/projects/8231e2301d734c70a522035e3a4bf17a` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:00.087634 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793d2eb-46ad-4b1e-a04d-86413398d59b None admin] RBAC: Authorizing `identity:get_project(project_id=8231e2301d734c70a522035e3a4bf17a)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:00.089296 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793d2eb-46ad-4b1e-a04d-86413398d59b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:00.091241 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 49/92] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:08:59 2022] GET /identity/v3/projects/8231e2301d734c70a522035e3a4bf17a => generated 312 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:00.092197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793d2eb-46ad-4b1e-a04d-86413398d59b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:00.107077 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c44b66-c529-4236-aabd-6a84b9edb613 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:00.123253 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:00.159092 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb66b2a-9f5d-44de-abb8-21deb1020c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:00.159802 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb66b2a-9f5d-44de-abb8-21deb1020c64 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:00.160244 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb66b2a-9f5d-44de-abb8-21deb1020c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:00.160635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb66b2a-9f5d-44de-abb8-21deb1020c64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:00.161485 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb66b2a-9f5d-44de-abb8-21deb1020c64 None admin] RBAC: Adding query filter params (role.id=b6177706a26446d5b4c540a3e97dee2e, scope.project.id=a9d904b06eb24d5d8bce3f192f7927ca, user.id=8de86eb101ea4d8ca7abd59c20dd7150) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:00.161799 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb66b2a-9f5d-44de-abb8-21deb1020c64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:00.163951 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb66b2a-9f5d-44de-abb8-21deb1020c64 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:00.170869 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 44/93] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:08:59 2022] GET /identity/v3/role_assignments?user.id=8de86eb101ea4d8ca7abd59c20dd7150&scope.project.id=a9d904b06eb24d5d8bce3f192f7927ca&role.id=b6177706a26446d5b4c540a3e97dee2e => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:00.171581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb66b2a-9f5d-44de-abb8-21deb1020c64 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:00.205984 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793d2eb-46ad-4b1e-a04d-86413398d59b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:00.249431 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c92ac2-0c3f-4b9a-ad6c-b40c4232120c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:00.251796 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c92ac2-0c3f-4b9a-ad6c-b40c4232120c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:00.252455 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c92ac2-0c3f-4b9a-ad6c-b40c4232120c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:00.254834 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c92ac2-0c3f-4b9a-ad6c-b40c4232120c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:00.256664 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c92ac2-0c3f-4b9a-ad6c-b40c4232120c None admin] RBAC: Adding query filter params (role.id=314f0b44fb344a99bdda986e7b4ac3ab, scope.project.id=a9d904b06eb24d5d8bce3f192f7927ca, user.id=8de86eb101ea4d8ca7abd59c20dd7150) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:00.257872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c92ac2-0c3f-4b9a-ad6c-b40c4232120c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:00.261006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c92ac2-0c3f-4b9a-ad6c-b40c4232120c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:00.275360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 50/94] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:09:00 2022] GET /identity/v3/role_assignments?user.id=8de86eb101ea4d8ca7abd59c20dd7150&scope.project.id=a9d904b06eb24d5d8bce3f192f7927ca&role.id=314f0b44fb344a99bdda986e7b4ac3ab => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:00.277722 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c92ac2-0c3f-4b9a-ad6c-b40c4232120c None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:00.347296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb66b2a-9f5d-44de-abb8-21deb1020c64 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:00.415730 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e447a-7c38-4ed7-8c08-5d73c4be4905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:00.416502 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e447a-7c38-4ed7-8c08-5d73c4be4905 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:00.416793 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e447a-7c38-4ed7-8c08-5d73c4be4905 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:00.417074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e447a-7c38-4ed7-8c08-5d73c4be4905 None admin] PATH_INFO: `/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:00.418727 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e447a-7c38-4ed7-8c08-5d73c4be4905 None admin] RBAC: Authorizing `identity:get_project(project_id=a9d904b06eb24d5d8bce3f192f7927ca)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:00.420197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e447a-7c38-4ed7-8c08-5d73c4be4905 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:00.422235 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 45/95] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:00 2022] GET /identity/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:00.429949 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e447a-7c38-4ed7-8c08-5d73c4be4905 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:00.454427 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:00.474922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:00.480978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c92ac2-0c3f-4b9a-ad6c-b40c4232120c None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:00.545252 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c19d46-189c-4f06-bb87-192bde365b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:00.546061 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c19d46-189c-4f06-bb87-192bde365b01 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:00.546253 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c19d46-189c-4f06-bb87-192bde365b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:00.546538 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c19d46-189c-4f06-bb87-192bde365b01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:00.547403 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c19d46-189c-4f06-bb87-192bde365b01 None admin] RBAC: Adding query filter params (role.id=314f0b44fb344a99bdda986e7b4ac3ab, scope.project.id=8231e2301d734c70a522035e3a4bf17a, user.id=8de86eb101ea4d8ca7abd59c20dd7150) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:00.547724 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c19d46-189c-4f06-bb87-192bde365b01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:00.549217 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c19d46-189c-4f06-bb87-192bde365b01 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:00.566657 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 51/96] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:09:00 2022] GET /identity/v3/role_assignments?user.id=8de86eb101ea4d8ca7abd59c20dd7150&scope.project.id=8231e2301d734c70a522035e3a4bf17a&role.id=314f0b44fb344a99bdda986e7b4ac3ab => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:00.636734 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e447a-7c38-4ed7-8c08-5d73c4be4905 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:00.676046 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb290e-da5b-478b-875d-17ec8aed4be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:00.677353 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb290e-da5b-478b-875d-17ec8aed4be7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:00.677849 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb290e-da5b-478b-875d-17ec8aed4be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:00.678339 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb290e-da5b-478b-875d-17ec8aed4be7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:00.679402 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb290e-da5b-478b-875d-17ec8aed4be7 None admin] RBAC: Adding query filter params (role.id=431cef539cfb476aad50d2470e763b5f, scope.project.id=a9d904b06eb24d5d8bce3f192f7927ca, user.id=1757b5d7af48479b9e3aef95e06a280d) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:00.679917 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb290e-da5b-478b-875d-17ec8aed4be7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:00.681751 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb290e-da5b-478b-875d-17ec8aed4be7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:00.688731 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 46/97] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:09:00 2022] GET /identity/v3/role_assignments?user.id=1757b5d7af48479b9e3aef95e06a280d&scope.project.id=a9d904b06eb24d5d8bce3f192f7927ca&role.id=431cef539cfb476aad50d2470e763b5f => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:01.257466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d464e-285f-49c7-9296-da3d2978cc1a None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:01.257791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d464e-285f-49c7-9296-da3d2978cc1a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:01.258063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d464e-285f-49c7-9296-da3d2978cc1a None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:01.259602 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 52/98] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:01.264741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360ac6b-6b6e-416b-8106-f947d86a026c None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:01.265279 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360ac6b-6b6e-416b-8106-f947d86a026c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:01.265769 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360ac6b-6b6e-416b-8106-f947d86a026c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:01.283354 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-7360ac6b-6b6e-416b-8106-f947d86a026c None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:01.284879 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-7360ac6b-6b6e-416b-8106-f947d86a026c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:01.365628 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 47/99] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:01.397076 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d464e-285f-49c7-9296-da3d2978cc1a None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:01.520313 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d464e-285f-49c7-9296-da3d2978cc1a None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:01.564581 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41e495-3d3d-41d0-95a4-b70bfd0cacf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:01.566791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41e495-3d3d-41d0-95a4-b70bfd0cacf7 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:01.567268 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41e495-3d3d-41d0-95a4-b70bfd0cacf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:01.567753 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41e495-3d3d-41d0-95a4-b70bfd0cacf7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:01.569116 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41e495-3d3d-41d0-95a4-b70bfd0cacf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:01.570879 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41e495-3d3d-41d0-95a4-b70bfd0cacf7 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:01.572723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 53/100] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:09:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:01.578387 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360ac6b-6b6e-416b-8106-f947d86a026c None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:01.581910 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:01.619341 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da38e0d-573e-40bf-ba10-ffcb4db4264a None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:01.619950 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da38e0d-573e-40bf-ba10-ffcb4db4264a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:01.620436 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da38e0d-573e-40bf-ba10-ffcb4db4264a None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:01.622018 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 54/101] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 08:09:01.635236 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82849984-5e47-4cc2-84e4-acb4f5cd2764 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:01.635790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82849984-5e47-4cc2-84e4-acb4f5cd2764 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:01.636253 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82849984-5e47-4cc2-84e4-acb4f5cd2764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:01.661326 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-82849984-5e47-4cc2-84e4-acb4f5cd2764 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:01.663054 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-82849984-5e47-4cc2-84e4-acb4f5cd2764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:01.694470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360ac6b-6b6e-416b-8106-f947d86a026c None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:01.696090 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:01.744835 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25f2f4-d6fd-495f-8ff1-409505befaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:01.745628 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25f2f4-d6fd-495f-8ff1-409505befaf7 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:01.745969 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25f2f4-d6fd-495f-8ff1-409505befaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:01.746253 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25f2f4-d6fd-495f-8ff1-409505befaf7 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:01.746976 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25f2f4-d6fd-495f-8ff1-409505befaf7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:01.748445 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25f2f4-d6fd-495f-8ff1-409505befaf7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:01.793427 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 48/102] 10.222.0.57 () {60 vars in 1141 bytes} [Sat Jun 4 08:09:01 2022] POST /identity/v3/projects => generated 302 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:09:01.794707 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 55/103] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:01.819410 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25f2f4-d6fd-495f-8ff1-409505befaf7 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:01.886259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:01.954658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25f2f4-d6fd-495f-8ff1-409505befaf7 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:01.996824 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e61fa-2253-4658-9965-d5221fa29dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:01.997632 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e61fa-2253-4658-9965-d5221fa29dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:01.997943 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e61fa-2253-4658-9965-d5221fa29dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:01.998221 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e61fa-2253-4658-9965-d5221fa29dd8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:02.016534 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e61fa-2253-4658-9965-d5221fa29dd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:02.025249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-d38e61fa-2253-4658-9965-d5221fa29dd8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 08:09:02.025249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:02.025249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:02.025249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:02.025249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:02.025249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:02.025249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:02.025249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:02.025249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:02.025249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:02.025249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:02.025249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:02.025249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:02.025249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:02.025249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:02.025249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:02.026192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:02.026192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:02.026192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:02.026192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:02.026192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:02.026192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:02.026192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:02.026192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:02.026192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:02.026192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:02.026192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:02.026192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:02.026192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:02.026192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:02.026192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:02.026192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:02.026968 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:02.026968 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:02.026968 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:02.026968 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:02.026968 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:02.026968 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:02.026968 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:02.026968 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:02.026968 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:02.026968 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:02.026968 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 08:09:02.026968 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:02.026968 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 49/104] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:02.033111 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82849984-5e47-4cc2-84e4-acb4f5cd2764 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:02.185275 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82849984-5e47-4cc2-84e4-acb4f5cd2764 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:02.220447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404dab69-b937-4d5c-b08b-fa3adde43e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:02.221121 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dab69-b937-4d5c-b08b-fa3adde43e75 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:02.221403 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dab69-b937-4d5c-b08b-fa3adde43e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:02.221676 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dab69-b937-4d5c-b08b-fa3adde43e75 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:02.222490 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404dab69-b937-4d5c-b08b-fa3adde43e75 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:02.222797 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404dab69-b937-4d5c-b08b-fa3adde43e75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:02.224176 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404dab69-b937-4d5c-b08b-fa3adde43e75 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:02.232535 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 56/105] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jun 4 08:09:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:02.238974 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e61fa-2253-4658-9965-d5221fa29dd8 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:02.344505 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e61fa-2253-4658-9965-d5221fa29dd8 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:02.363186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:02.382298 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40291e95-ab85-4e1e-85de-f62f7e053a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:02.383177 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40291e95-ab85-4e1e-85de-f62f7e053a5a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:02.383460 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40291e95-ab85-4e1e-85de-f62f7e053a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:02.383738 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40291e95-ab85-4e1e-85de-f62f7e053a5a None admin] PATH_INFO: `/v3/users/2e3cf5de75894c17b1cc9bf0c4855c82` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:02.399160 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40291e95-ab85-4e1e-85de-f62f7e053a5a None admin] RBAC: Authorizing `identity:get_user(user_id=2e3cf5de75894c17b1cc9bf0c4855c82)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:02.400646 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40291e95-ab85-4e1e-85de-f62f7e053a5a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:02.402744 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 50/106] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:09:02 2022] GET /identity/v3/users/2e3cf5de75894c17b1cc9bf0c4855c82 => generated 289 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:02.411154 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404dab69-b937-4d5c-b08b-fa3adde43e75 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:02.439379 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:02.535013 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404dab69-b937-4d5c-b08b-fa3adde43e75 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:02.569496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a5f5a-92e2-4a08-b237-4d8bd12a0745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:02.570253 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a5f5a-92e2-4a08-b237-4d8bd12a0745 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:02.570457 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a5f5a-92e2-4a08-b237-4d8bd12a0745 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:02.570796 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a5f5a-92e2-4a08-b237-4d8bd12a0745 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:02.639928 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a5f5a-92e2-4a08-b237-4d8bd12a0745 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:02.641417 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a5f5a-92e2-4a08-b237-4d8bd12a0745 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:02.659104 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:02.744884 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 57/107] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:09:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 08:09:02.750148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40291e95-ab85-4e1e-85de-f62f7e053a5a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:02.852889 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40291e95-ab85-4e1e-85de-f62f7e053a5a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:02.887487 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a88267-bf86-45ff-b940-48c3b50181e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:02.888362 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a88267-bf86-45ff-b940-48c3b50181e7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:02.888646 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a88267-bf86-45ff-b940-48c3b50181e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:02.888921 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a88267-bf86-45ff-b940-48c3b50181e7 None admin] PATH_INFO: `/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:02.890138 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a88267-bf86-45ff-b940-48c3b50181e7 None admin] RBAC: Authorizing `identity:get_project(project_id=a9d904b06eb24d5d8bce3f192f7927ca)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:02.891576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a88267-bf86-45ff-b940-48c3b50181e7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:02.893268 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 51/108] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:02 2022] GET /identity/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:02.899635 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a5f5a-92e2-4a08-b237-4d8bd12a0745 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:03.015258 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a5f5a-92e2-4a08-b237-4d8bd12a0745 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:03.034105 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:03.055496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6538fe-b78e-4ff6-ab9b-e45616851c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:03.056772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6538fe-b78e-4ff6-ab9b-e45616851c79 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:03.057056 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6538fe-b78e-4ff6-ab9b-e45616851c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:03.057334 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6538fe-b78e-4ff6-ab9b-e45616851c79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:03.058213 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6538fe-b78e-4ff6-ab9b-e45616851c79 None admin] RBAC: Adding query filter params (role.id=c005105deb5849b9a6e5122b2efa9633, scope.project.id=a9d904b06eb24d5d8bce3f192f7927ca, user.id=2e3cf5de75894c17b1cc9bf0c4855c82) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:03.058524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6538fe-b78e-4ff6-ab9b-e45616851c79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:03.059975 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6538fe-b78e-4ff6-ab9b-e45616851c79 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:03.065670 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 58/109] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:09:02 2022] GET /identity/v3/role_assignments?user.id=2e3cf5de75894c17b1cc9bf0c4855c82&scope.project.id=a9d904b06eb24d5d8bce3f192f7927ca&role.id=c005105deb5849b9a6e5122b2efa9633 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:03.559741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496ad95-80c8-42fb-8e43-30465f62b850 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:03.560070 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496ad95-80c8-42fb-8e43-30465f62b850 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:03.560304 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496ad95-80c8-42fb-8e43-30465f62b850 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:03.561696 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 52/110] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:03.567627 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51171bb-75b7-4308-9889-38f3904310e5 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:03.567917 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51171bb-75b7-4308-9889-38f3904310e5 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:03.568193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51171bb-75b7-4308-9889-38f3904310e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:03.585308 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-a51171bb-75b7-4308-9889-38f3904310e5 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:03.586698 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a51171bb-75b7-4308-9889-38f3904310e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:03.655877 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 59/111] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 08:09:03.679003 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496ad95-80c8-42fb-8e43-30465f62b850 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:03.704473 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8a5a7-67a5-4c04-88da-9f01eb41585c None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:03.704786 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8a5a7-67a5-4c04-88da-9f01eb41585c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:03.705858 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8a5a7-67a5-4c04-88da-9f01eb41585c None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:03.706647 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 60/112] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 08:09:03.715591 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e4c41-0cfa-4eb9-8740-c0003d758f6b None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:03.716351 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e4c41-0cfa-4eb9-8740-c0003d758f6b None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:03.716945 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e4c41-0cfa-4eb9-8740-c0003d758f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:03.735441 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-439e4c41-0cfa-4eb9-8740-c0003d758f6b None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:03.736977 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-439e4c41-0cfa-4eb9-8740-c0003d758f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:03.750210 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:03.807825 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 61/113] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:03.851564 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496ad95-80c8-42fb-8e43-30465f62b850 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:03.871024 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e4c41-0cfa-4eb9-8740-c0003d758f6b None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:03.905857 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6cc61-2d62-4e95-a572-fa47ee1e368c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:03.905857 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6cc61-2d62-4e95-a572-fa47ee1e368c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:03.905857 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6cc61-2d62-4e95-a572-fa47ee1e368c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:03.905857 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6cc61-2d62-4e95-a572-fa47ee1e368c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:03.935340 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae6cc61-2d62-4e95-a572-fa47ee1e368c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:03.952256 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-3ae6cc61-2d62-4e95-a572-fa47ee1e368c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 08:09:03.952256 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:03.952256 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:03.952256 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:03.952256 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:03.952256 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:03.952256 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:03.952256 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:03.952256 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:03.952256 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:03.952256 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:03.952256 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:03.952256 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:03.952256 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:03.952256 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:03.952256 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:03.953252 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:03.953252 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:03.953252 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:03.953252 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:03.953252 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:03.953252 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:03.953252 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:03.953252 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:03.953252 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:03.953252 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:03.953252 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:03.953252 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:03.953252 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:03.953252 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:03.953252 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:03.953252 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:03.956580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:03.956580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:03.956580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:03.956580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:03.956580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:03.956580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:03.956580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:03.956580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:03.956580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:03.956580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:03.956580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 08:09:03.956580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:03.956580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 53/114] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jun 4 08:09:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:03.962491 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6cc61-2d62-4e95-a572-fa47ee1e368c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:03.988055 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:04.068714 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e4c41-0cfa-4eb9-8740-c0003d758f6b None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:04.153375 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e9e8f-8daa-454f-b586-c7abd4c19fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:04.154499 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e9e8f-8daa-454f-b586-c7abd4c19fdd None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:04.154932 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e9e8f-8daa-454f-b586-c7abd4c19fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:04.155369 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e9e8f-8daa-454f-b586-c7abd4c19fdd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:04.181179 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e9e8f-8daa-454f-b586-c7abd4c19fdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:04.183308 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6cc61-2d62-4e95-a572-fa47ee1e368c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:04.185259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:04.198753 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-116e9e8f-8daa-454f-b586-c7abd4c19fdd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:09:04.198753 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:04.198753 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:04.198753 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:04.198753 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:04.198753 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:04.198753 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:04.198753 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:04.198753 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:04.198753 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:04.198753 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:04.198753 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:04.198753 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:04.198753 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:04.198753 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:04.198753 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:04.199849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:04.199849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:04.199849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:04.199849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:04.199849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:04.199849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:04.199849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:04.199849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:04.199849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:04.199849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:04.199849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:04.199849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:04.199849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:04.199849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:04.199849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:04.199849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:04.200605 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:04.200605 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:04.200605 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:04.200605 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:04.200605 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:04.200605 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:04.200605 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:04.200605 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:04.200605 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:04.200605 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:04.200605 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:09:04.200605 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:04.200605 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 62/115] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:09:04.210823 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e9e8f-8daa-454f-b586-c7abd4c19fdd None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:04.298544 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09042660-d884-4c10-810d-4533ef00ebbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:04.299281 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09042660-d884-4c10-810d-4533ef00ebbc None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:04.299531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09042660-d884-4c10-810d-4533ef00ebbc None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:04.299817 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09042660-d884-4c10-810d-4533ef00ebbc None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:04.301128 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09042660-d884-4c10-810d-4533ef00ebbc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:04.301444 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09042660-d884-4c10-810d-4533ef00ebbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:04.303237 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09042660-d884-4c10-810d-4533ef00ebbc None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:04.312972 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 54/116] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:09:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:04.319979 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09042660-d884-4c10-810d-4533ef00ebbc None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:04.376860 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:04.382511 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e9e8f-8daa-454f-b586-c7abd4c19fdd None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:04.440302 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad1649-36c0-43d2-94d7-8109557236ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:04.441571 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad1649-36c0-43d2-94d7-8109557236ae None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:04.441878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad1649-36c0-43d2-94d7-8109557236ae None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:04.442166 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad1649-36c0-43d2-94d7-8109557236ae None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:04.443472 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad1649-36c0-43d2-94d7-8109557236ae None admin] RBAC: Adding query filter params (name=member) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:04.443791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad1649-36c0-43d2-94d7-8109557236ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:04.445732 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad1649-36c0-43d2-94d7-8109557236ae None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:04.461512 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 63/117] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jun 4 08:09:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:04.468078 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad1649-36c0-43d2-94d7-8109557236ae None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:04.567331 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09042660-d884-4c10-810d-4533ef00ebbc None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:04.621017 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e35ac0-f28d-4b6a-ac93-fa62ced04f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:04.621926 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e35ac0-f28d-4b6a-ac93-fa62ced04f1d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:04.622213 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e35ac0-f28d-4b6a-ac93-fa62ced04f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:04.622492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e35ac0-f28d-4b6a-ac93-fa62ced04f1d None admin] PATH_INFO: `/v3/users/8de86eb101ea4d8ca7abd59c20dd7150` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:04.626548 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e35ac0-f28d-4b6a-ac93-fa62ced04f1d None admin] RBAC: Authorizing `identity:get_user(user_id=8de86eb101ea4d8ca7abd59c20dd7150)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:04.628075 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e35ac0-f28d-4b6a-ac93-fa62ced04f1d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:04.629925 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 55/118] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:09:04 2022] GET /identity/v3/users/8de86eb101ea4d8ca7abd59c20dd7150 => generated 275 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:04.635876 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e35ac0-f28d-4b6a-ac93-fa62ced04f1d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:04.637096 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad1649-36c0-43d2-94d7-8109557236ae None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:04.678270 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:04.704954 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17215cc-51ad-40eb-942d-3fcc36591628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:04.705771 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17215cc-51ad-40eb-942d-3fcc36591628 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:04.706087 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17215cc-51ad-40eb-942d-3fcc36591628 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:04.706482 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17215cc-51ad-40eb-942d-3fcc36591628 None admin] PATH_INFO: `/v3/users/8de86eb101ea4d8ca7abd59c20dd7150` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:04.710743 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17215cc-51ad-40eb-942d-3fcc36591628 None admin] RBAC: Authorizing `identity:get_user(user_id=8de86eb101ea4d8ca7abd59c20dd7150)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:04.712324 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17215cc-51ad-40eb-942d-3fcc36591628 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:04.714160 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 64/119] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:09:04 2022] GET /identity/v3/users/8de86eb101ea4d8ca7abd59c20dd7150 => generated 275 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:04.735551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17215cc-51ad-40eb-942d-3fcc36591628 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:04.754862 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e35ac0-f28d-4b6a-ac93-fa62ced04f1d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:04.791348 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df36da8-875a-427f-b97b-97de9dc5784e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:04.792366 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df36da8-875a-427f-b97b-97de9dc5784e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:04.792656 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df36da8-875a-427f-b97b-97de9dc5784e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:04.792933 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df36da8-875a-427f-b97b-97de9dc5784e None admin] PATH_INFO: `/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:04.794317 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df36da8-875a-427f-b97b-97de9dc5784e None admin] RBAC: Authorizing `identity:get_project(project_id=a9d904b06eb24d5d8bce3f192f7927ca)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:04.795627 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:04.797387 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df36da8-875a-427f-b97b-97de9dc5784e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:04.799597 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 56/120] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:04 2022] GET /identity/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:04.802785 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6d69d-590a-432b-8e83-9d34e119af4d None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:04.803083 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6d69d-590a-432b-8e83-9d34e119af4d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:04.803365 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6d69d-590a-432b-8e83-9d34e119af4d None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:04.805919 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 57/121] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:04.806641 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6d69d-590a-432b-8e83-9d34e119af4d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:04.891879 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17215cc-51ad-40eb-942d-3fcc36591628 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:04.932614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:04.936831 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a2116-6fca-412d-8723-4fda31d468ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:04.937365 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6d69d-590a-432b-8e83-9d34e119af4d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:04.937714 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a2116-6fca-412d-8723-4fda31d468ce None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:04.938033 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a2116-6fca-412d-8723-4fda31d468ce None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:04.938318 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a2116-6fca-412d-8723-4fda31d468ce None admin] PATH_INFO: `/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:04.939641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a2116-6fca-412d-8723-4fda31d468ce None admin] RBAC: Authorizing `identity:get_project(project_id=a9d904b06eb24d5d8bce3f192f7927ca)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:04.942091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a2116-6fca-412d-8723-4fda31d468ce None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:04.943837 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 65/122] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:04 2022] GET /identity/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:04.945168 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc6de3-e368-4746-a57f-22415ab68c7f None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:04.945463 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc6de3-e368-4746-a57f-22415ab68c7f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:04.945747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc6de3-e368-4746-a57f-22415ab68c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:04.964432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-30bc6de3-e368-4746-a57f-22415ab68c7f None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:04.965572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-30bc6de3-e368-4746-a57f-22415ab68c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:04.981273 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9a75c-d6c8-4159-9ef0-53172acf948d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:04.982734 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9a75c-d6c8-4159-9ef0-53172acf948d None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:04.983235 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9a75c-d6c8-4159-9ef0-53172acf948d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:04.983766 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9a75c-d6c8-4159-9ef0-53172acf948d None admin] PATH_INFO: `/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca/users/8de86eb101ea4d8ca7abd59c20dd7150/roles/b6177706a26446d5b4c540a3e97dee2e` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:04.986443 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9a75c-d6c8-4159-9ef0-53172acf948d None admin] RBAC: Authorizing `identity:create_grant(project_id=a9d904b06eb24d5d8bce3f192f7927ca, user_id=8de86eb101ea4d8ca7abd59c20dd7150, role_id=b6177706a26446d5b4c540a3e97dee2e)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:04.988775 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9a75c-d6c8-4159-9ef0-53172acf948d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:05.007784 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 58/123] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jun 4 08:09:04 2022] PUT /identity/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca/users/8de86eb101ea4d8ca7abd59c20dd7150/roles/b6177706a26446d5b4c540a3e97dee2e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:09:05.009651 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ae2ad-32e7-4588-970c-71414091163e None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:05.010175 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ae2ad-32e7-4588-970c-71414091163e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:05.010789 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ae2ad-32e7-4588-970c-71414091163e None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:05.012481 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 59/124] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:05.013727 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ae2ad-32e7-4588-970c-71414091163e None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:05.041625 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 66/125] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:05.043003 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd09e47-efc7-41d9-b66a-b57c286d5380 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:05.043295 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd09e47-efc7-41d9-b66a-b57c286d5380 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:05.043575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd09e47-efc7-41d9-b66a-b57c286d5380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:05.061420 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-abd09e47-efc7-41d9-b66a-b57c286d5380 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:05.062701 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-abd09e47-efc7-41d9-b66a-b57c286d5380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:05.089747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:05.135759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ae2ad-32e7-4588-970c-71414091163e None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:05.140367 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 67/126] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:05.141242 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd09e47-efc7-41d9-b66a-b57c286d5380 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:05.173339 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226a62e-8250-4abf-a578-4d8ed9c1e7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:05.174657 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226a62e-8250-4abf-a578-4d8ed9c1e7c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:05.175701 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226a62e-8250-4abf-a578-4d8ed9c1e7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:05.176187 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226a62e-8250-4abf-a578-4d8ed9c1e7c2 None admin] PATH_INFO: `/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca/users/8de86eb101ea4d8ca7abd59c20dd7150/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:05.178868 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226a62e-8250-4abf-a578-4d8ed9c1e7c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=a9d904b06eb24d5d8bce3f192f7927ca, user_id=8de86eb101ea4d8ca7abd59c20dd7150, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:05.180710 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226a62e-8250-4abf-a578-4d8ed9c1e7c2 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:05.204196 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 60/127] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jun 4 08:09:05 2022] PUT /identity/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca/users/8de86eb101ea4d8ca7abd59c20dd7150/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:09:05.205626 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226a62e-8250-4abf-a578-4d8ed9c1e7c2 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:05.248657 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:05.333602 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd09e47-efc7-41d9-b66a-b57c286d5380 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:05.415225 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3bc80-2d46-4fc1-a787-cd83ebe784db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:05.416051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3bc80-2d46-4fc1-a787-cd83ebe784db None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:05.416340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3bc80-2d46-4fc1-a787-cd83ebe784db None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:05.416617 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3bc80-2d46-4fc1-a787-cd83ebe784db None admin] PATH_INFO: `/v3/roles/member` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:05.425467 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226a62e-8250-4abf-a578-4d8ed9c1e7c2 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:05.447431 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3bc80-2d46-4fc1-a787-cd83ebe784db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:05.456280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-e8d3bc80-2d46-4fc1-a787-cd83ebe784db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:09:05.456280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:05.456280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:05.456280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:05.456280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:05.456280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:05.456280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:05.456280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:05.456280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:05.456280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:05.456280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:05.456280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:05.456280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:05.456280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:05.456280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:05.456280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:05.457728 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:05.457728 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:05.457728 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:05.457728 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:05.457728 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:05.457728 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:05.457728 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:05.457728 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:05.457728 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:05.457728 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:05.457728 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:05.457728 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:05.457728 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:05.457728 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:05.457728 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:05.457728 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:05.458868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:05.458868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:05.458868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:05.458868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:05.458868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:05.458868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:05.458868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:05.458868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:05.458868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:05.458868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:05.458868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:09:05.458868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:05.458868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 68/128] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:05.464261 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3bc80-2d46-4fc1-a787-cd83ebe784db None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:05.485299 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f0fe7-b0cb-494e-b2ee-3c4f20aa116c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:05.486551 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f0fe7-b0cb-494e-b2ee-3c4f20aa116c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:05.487210 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f0fe7-b0cb-494e-b2ee-3c4f20aa116c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:05.487739 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f0fe7-b0cb-494e-b2ee-3c4f20aa116c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:05.502807 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:05.509286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f0fe7-b0cb-494e-b2ee-3c4f20aa116c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:05.517870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-776f0fe7-b0cb-494e-b2ee-3c4f20aa116c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:09:05.517870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:05.517870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:05.517870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:05.517870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:05.517870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:05.517870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:05.517870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:05.517870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:05.517870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:05.517870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:05.517870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:05.517870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:05.517870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:05.517870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:05.517870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:05.519383 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:05.519383 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:05.519383 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:05.519383 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:05.519383 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:05.519383 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:05.519383 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:05.519383 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:05.519383 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:05.519383 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:05.519383 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:05.519383 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:05.519383 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:05.519383 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:05.519383 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:05.519383 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:05.520153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:05.520153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:05.520153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:05.520153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:05.520153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:05.520153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:05.520153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:05.520153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:05.520153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:05.520153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:05.520153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:09:05.520153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:05.520153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 61/129] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:09:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:05.521597 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184440e-65e3-45c8-9a09-ec995b91493f None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:05.522015 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184440e-65e3-45c8-9a09-ec995b91493f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:05.522562 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184440e-65e3-45c8-9a09-ec995b91493f None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:05.523792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 62/130] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:05.530030 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffadfd-b5af-4318-9cc1-6ea111ac1207 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:05.530492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffadfd-b5af-4318-9cc1-6ea111ac1207 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:05.530787 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffadfd-b5af-4318-9cc1-6ea111ac1207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:05.550688 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f9ffadfd-b5af-4318-9cc1-6ea111ac1207 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:05.552836 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f9ffadfd-b5af-4318-9cc1-6ea111ac1207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:05.641256 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3bc80-2d46-4fc1-a787-cd83ebe784db None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:05.667893 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 63/131] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 08:09:05.668526 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffadfd-b5af-4318-9cc1-6ea111ac1207 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:05.700204 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:05.703802 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f39dd-8598-412e-bb86-05f3895a223f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:05.704548 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f39dd-8598-412e-bb86-05f3895a223f None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:05.704836 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f39dd-8598-412e-bb86-05f3895a223f None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:05.705115 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f39dd-8598-412e-bb86-05f3895a223f None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:05.705920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f39dd-8598-412e-bb86-05f3895a223f None admin] RBAC: Adding query filter params (name=member) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:05.706997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f39dd-8598-412e-bb86-05f3895a223f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:05.708923 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f39dd-8598-412e-bb86-05f3895a223f None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:05.724776 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 69/132] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jun 4 08:09:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:05.724776 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f39dd-8598-412e-bb86-05f3895a223f None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:05.843773 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:05.871709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f39dd-8598-412e-bb86-05f3895a223f None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:05.916565 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffadfd-b5af-4318-9cc1-6ea111ac1207 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:05.944283 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c649df-ab95-4132-a7e1-1f574d277d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:05.945092 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c649df-ab95-4132-a7e1-1f574d277d00 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:05.945374 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c649df-ab95-4132-a7e1-1f574d277d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:05.945648 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c649df-ab95-4132-a7e1-1f574d277d00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:05.949271 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c649df-ab95-4132-a7e1-1f574d277d00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:05.952812 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c649df-ab95-4132-a7e1-1f574d277d00 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:05.954522 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 70/133] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:09:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:05.961011 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c649df-ab95-4132-a7e1-1f574d277d00 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:05.992609 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00baf231-0b86-4d73-ae7f-a9502fcf412c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:05.993295 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baf231-0b86-4d73-ae7f-a9502fcf412c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:05.993577 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baf231-0b86-4d73-ae7f-a9502fcf412c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:05.993873 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baf231-0b86-4d73-ae7f-a9502fcf412c None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:05.994624 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00baf231-0b86-4d73-ae7f-a9502fcf412c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:05.996075 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00baf231-0b86-4d73-ae7f-a9502fcf412c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:05.997524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00baf231-0b86-4d73-ae7f-a9502fcf412c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:06.008494 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 64/134] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:06.009442 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00baf231-0b86-4d73-ae7f-a9502fcf412c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:06.092580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c649df-ab95-4132-a7e1-1f574d277d00 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:06.100729 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:06.135175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416988c-b22a-476d-b99a-b20da7fe1c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:06.136469 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416988c-b22a-476d-b99a-b20da7fe1c75 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:06.136970 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416988c-b22a-476d-b99a-b20da7fe1c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:06.137444 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416988c-b22a-476d-b99a-b20da7fe1c75 None admin] PATH_INFO: `/v3/users/8de86eb101ea4d8ca7abd59c20dd7150` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:06.137735 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00baf231-0b86-4d73-ae7f-a9502fcf412c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:06.139221 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416988c-b22a-476d-b99a-b20da7fe1c75 None admin] RBAC: Authorizing `identity:get_user(user_id=8de86eb101ea4d8ca7abd59c20dd7150)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:06.141039 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416988c-b22a-476d-b99a-b20da7fe1c75 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:06.142920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 71/135] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:09:05 2022] GET /identity/v3/users/8de86eb101ea4d8ca7abd59c20dd7150 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:06.144891 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f5b68-6d51-4c54-828f-87ad61f06a2b None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:06.145418 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f5b68-6d51-4c54-828f-87ad61f06a2b None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:06.145985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f5b68-6d51-4c54-828f-87ad61f06a2b None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:06.147482 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 72/136] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:06.152724 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f5b68-6d51-4c54-828f-87ad61f06a2b None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:06.172728 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:06.176472 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873972a8-d16d-4d42-abc3-6d727a94edf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:06.177493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873972a8-d16d-4d42-abc3-6d727a94edf1 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:06.177771 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873972a8-d16d-4d42-abc3-6d727a94edf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:06.178073 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873972a8-d16d-4d42-abc3-6d727a94edf1 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:06.178791 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873972a8-d16d-4d42-abc3-6d727a94edf1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:06.180228 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873972a8-d16d-4d42-abc3-6d727a94edf1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:06.213261 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 65/137] 10.222.0.57 () {60 vars in 1132 bytes} [Sat Jun 4 08:09:06 2022] POST /identity/v3/users => generated 283 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:09:06.218008 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873972a8-d16d-4d42-abc3-6d727a94edf1 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:06.337338 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873972a8-d16d-4d42-abc3-6d727a94edf1 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:06.349416 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f5b68-6d51-4c54-828f-87ad61f06a2b None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:06.369484 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:06.377802 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b32005-486e-41d8-8268-3bc0e56a4e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:06.379482 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b32005-486e-41d8-8268-3bc0e56a4e74 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:06.379766 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b32005-486e-41d8-8268-3bc0e56a4e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:06.380043 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b32005-486e-41d8-8268-3bc0e56a4e74 None admin] PATH_INFO: `/v3/projects/8231e2301d734c70a522035e3a4bf17a` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:06.381269 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b32005-486e-41d8-8268-3bc0e56a4e74 None admin] RBAC: Authorizing `identity:get_project(project_id=8231e2301d734c70a522035e3a4bf17a)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:06.383115 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b32005-486e-41d8-8268-3bc0e56a4e74 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:06.385560 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 66/138] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:06 2022] GET /identity/v3/projects/8231e2301d734c70a522035e3a4bf17a => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:06.387162 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84525e-cfcf-496c-acb8-f9197bf20aa0 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:06.387455 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84525e-cfcf-496c-acb8-f9197bf20aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:06.387733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84525e-cfcf-496c-acb8-f9197bf20aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:06.409578 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-fe84525e-cfcf-496c-acb8-f9197bf20aa0 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:06.411209 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-fe84525e-cfcf-496c-acb8-f9197bf20aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:06.466587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033b76e-28c7-4157-9580-79b5a79fd956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:06.467867 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033b76e-28c7-4157-9580-79b5a79fd956 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:06.468349 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033b76e-28c7-4157-9580-79b5a79fd956 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:06.468836 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033b76e-28c7-4157-9580-79b5a79fd956 None admin] PATH_INFO: `/v3/users/1757b5d7af48479b9e3aef95e06a280d` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:06.474708 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033b76e-28c7-4157-9580-79b5a79fd956 None admin] RBAC: Authorizing `identity:get_user(user_id=1757b5d7af48479b9e3aef95e06a280d)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:06.476530 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033b76e-28c7-4157-9580-79b5a79fd956 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:06.478486 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 73/139] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:09:06 2022] GET /identity/v3/users/1757b5d7af48479b9e3aef95e06a280d => generated 247 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:06.479872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033b76e-28c7-4157-9580-79b5a79fd956 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:06.497837 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 67/140] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:06.498857 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84525e-cfcf-496c-acb8-f9197bf20aa0 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:06.622677 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84525e-cfcf-496c-acb8-f9197bf20aa0 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:06.652541 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:06.653467 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:06.665739 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df6a93-3ef6-46f5-9172-4d43a85c8ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:06.666645 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df6a93-3ef6-46f5-9172-4d43a85c8ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:06.666929 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df6a93-3ef6-46f5-9172-4d43a85c8ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:06.667206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df6a93-3ef6-46f5-9172-4d43a85c8ca6 None admin] PATH_INFO: `/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:06.669172 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df6a93-3ef6-46f5-9172-4d43a85c8ca6 None admin] RBAC: Authorizing `identity:get_project(project_id=a9d904b06eb24d5d8bce3f192f7927ca)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:06.670666 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df6a93-3ef6-46f5-9172-4d43a85c8ca6 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:06.672905 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 68/141] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:06 2022] GET /identity/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:06.674013 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df6a93-3ef6-46f5-9172-4d43a85c8ca6 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:06.676367 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033b76e-28c7-4157-9580-79b5a79fd956 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:06.726574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eee1b3-3273-4690-9ff1-dec9b3cf525d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:06.727476 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eee1b3-3273-4690-9ff1-dec9b3cf525d None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:06.727760 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eee1b3-3273-4690-9ff1-dec9b3cf525d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:06.728036 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eee1b3-3273-4690-9ff1-dec9b3cf525d None admin] PATH_INFO: `/v3/projects/8231e2301d734c70a522035e3a4bf17a/users/8de86eb101ea4d8ca7abd59c20dd7150/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:06.733281 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eee1b3-3273-4690-9ff1-dec9b3cf525d None admin] RBAC: Authorizing `identity:create_grant(project_id=8231e2301d734c70a522035e3a4bf17a, user_id=8de86eb101ea4d8ca7abd59c20dd7150, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:06.734804 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eee1b3-3273-4690-9ff1-dec9b3cf525d None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:06.751548 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 74/142] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jun 4 08:09:06 2022] PUT /identity/v3/projects/8231e2301d734c70a522035e3a4bf17a/users/8de86eb101ea4d8ca7abd59c20dd7150/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:09:06.752349 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eee1b3-3273-4690-9ff1-dec9b3cf525d None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:06.816904 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df6a93-3ef6-46f5-9172-4d43a85c8ca6 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:06.870045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21603d-44bc-4ad1-8c96-85fa810c0cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:06.871198 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21603d-44bc-4ad1-8c96-85fa810c0cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:06.871706 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21603d-44bc-4ad1-8c96-85fa810c0cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:06.872191 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21603d-44bc-4ad1-8c96-85fa810c0cb3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:06.896102 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21603d-44bc-4ad1-8c96-85fa810c0cb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:06.902903 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eee1b3-3273-4690-9ff1-dec9b3cf525d None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:06.907832 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-8b21603d-44bc-4ad1-8c96-85fa810c0cb3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 08:09:06.907832 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:06.907832 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:06.907832 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:06.907832 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:06.907832 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:06.907832 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:06.907832 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:06.907832 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:06.907832 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:06.907832 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:06.907832 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:06.907832 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:06.907832 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:06.907832 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:06.907832 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:06.908718 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:06.908718 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:06.908718 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:06.908718 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:06.908718 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:06.908718 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:06.908718 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:06.908718 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:06.908718 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:06.908718 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:06.908718 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:06.908718 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:06.908718 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:06.908718 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:06.908718 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:06.908718 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:06.910186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:06.910186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:06.910186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:06.910186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:06.910186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:06.910186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:06.910186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:06.910186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:06.910186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:06.910186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:06.910186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 08:09:06.910186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:06.912285 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 69/143] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:06.918949 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21603d-44bc-4ad1-8c96-85fa810c0cb3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:06.957065 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9a388-d75a-4507-8150-fc3334236f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:06.958228 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9a388-d75a-4507-8150-fc3334236f5e None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:06.958599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9a388-d75a-4507-8150-fc3334236f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:06.959041 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9a388-d75a-4507-8150-fc3334236f5e None admin] PATH_INFO: `/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca/users/1757b5d7af48479b9e3aef95e06a280d/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:06.962266 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9a388-d75a-4507-8150-fc3334236f5e None admin] RBAC: Authorizing `identity:create_grant(project_id=a9d904b06eb24d5d8bce3f192f7927ca, user_id=1757b5d7af48479b9e3aef95e06a280d, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:06.963885 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9a388-d75a-4507-8150-fc3334236f5e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:06.992257 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 75/144] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jun 4 08:09:06 2022] PUT /identity/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca/users/1757b5d7af48479b9e3aef95e06a280d/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:09:07.056266 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:07.115424 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21603d-44bc-4ad1-8c96-85fa810c0cb3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:07.162039 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d2027-36aa-43fe-883c-1134f9e4ef4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:07.162647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d2027-36aa-43fe-883c-1134f9e4ef4b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:07.162940 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d2027-36aa-43fe-883c-1134f9e4ef4b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:07.163218 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d2027-36aa-43fe-883c-1134f9e4ef4b None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:07.163984 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d2027-36aa-43fe-883c-1134f9e4ef4b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:07.164299 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d2027-36aa-43fe-883c-1134f9e4ef4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:07.165763 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d2027-36aa-43fe-883c-1134f9e4ef4b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:07.175846 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 70/145] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jun 4 08:09:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:07.182371 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9a388-d75a-4507-8150-fc3334236f5e None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:07.186562 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:07.309671 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9a388-d75a-4507-8150-fc3334236f5e None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:07.348503 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5726a5f-623b-494e-aca2-bdf510bc92bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:07.349379 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5726a5f-623b-494e-aca2-bdf510bc92bf None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:07.349666 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5726a5f-623b-494e-aca2-bdf510bc92bf None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:07.349974 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5726a5f-623b-494e-aca2-bdf510bc92bf None admin] PATH_INFO: `/v3/users/2e3cf5de75894c17b1cc9bf0c4855c82` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:07.351309 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5726a5f-623b-494e-aca2-bdf510bc92bf None admin] RBAC: Authorizing `identity:get_user(user_id=2e3cf5de75894c17b1cc9bf0c4855c82)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:07.352893 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5726a5f-623b-494e-aca2-bdf510bc92bf None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:07.354702 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 76/146] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:09:07 2022] GET /identity/v3/users/2e3cf5de75894c17b1cc9bf0c4855c82 => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:07.361126 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d2027-36aa-43fe-883c-1134f9e4ef4b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:07.478869 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d2027-36aa-43fe-883c-1134f9e4ef4b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:07.499117 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:07.523719 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4378efa-7302-4e00-9745-a0887948b935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:07.524678 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4378efa-7302-4e00-9745-a0887948b935 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:07.524963 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4378efa-7302-4e00-9745-a0887948b935 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:07.525245 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4378efa-7302-4e00-9745-a0887948b935 None admin] PATH_INFO: `/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:07.526555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4378efa-7302-4e00-9745-a0887948b935 None admin] RBAC: Authorizing `identity:get_project(project_id=a9d904b06eb24d5d8bce3f192f7927ca)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:07.528238 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4378efa-7302-4e00-9745-a0887948b935 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:07.530367 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 71/147] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:07 2022] GET /identity/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:07.536824 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5726a5f-623b-494e-aca2-bdf510bc92bf None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:07.624943 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:07.664734 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5726a5f-623b-494e-aca2-bdf510bc92bf None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:07.704617 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab365f8-953b-42d2-b2ee-9a9e6e4d19d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:07.705530 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab365f8-953b-42d2-b2ee-9a9e6e4d19d7 None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:07.705813 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab365f8-953b-42d2-b2ee-9a9e6e4d19d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:07.706173 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab365f8-953b-42d2-b2ee-9a9e6e4d19d7 None admin] PATH_INFO: `/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca/users/2e3cf5de75894c17b1cc9bf0c4855c82/roles/c005105deb5849b9a6e5122b2efa9633` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:07.709643 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab365f8-953b-42d2-b2ee-9a9e6e4d19d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=a9d904b06eb24d5d8bce3f192f7927ca, user_id=2e3cf5de75894c17b1cc9bf0c4855c82, role_id=c005105deb5849b9a6e5122b2efa9633)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:07.711183 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab365f8-953b-42d2-b2ee-9a9e6e4d19d7 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:07.745660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 77/148] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jun 4 08:09:07 2022] PUT /identity/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca/users/2e3cf5de75894c17b1cc9bf0c4855c82/roles/c005105deb5849b9a6e5122b2efa9633 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:09:08.140733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c73d6f-0a7e-4a1f-a04b-2e2af75cc1cb None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:08.141220 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c73d6f-0a7e-4a1f-a04b-2e2af75cc1cb None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:08.141220 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c73d6f-0a7e-4a1f-a04b-2e2af75cc1cb None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:08.142908 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 72/149] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:08.148269 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0e21c-13e6-4ff1-b8f2-b7e6a0d43b9a None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:08.148569 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0e21c-13e6-4ff1-b8f2-b7e6a0d43b9a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:08.148854 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0e21c-13e6-4ff1-b8f2-b7e6a0d43b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:08.175405 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-79d0e21c-13e6-4ff1-b8f2-b7e6a0d43b9a None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:08.176645 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-79d0e21c-13e6-4ff1-b8f2-b7e6a0d43b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:08.255681 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 78/150] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:08.291853 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c73d6f-0a7e-4a1f-a04b-2e2af75cc1cb None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:08.417479 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c73d6f-0a7e-4a1f-a04b-2e2af75cc1cb None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:08.453194 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2629a-e667-42a4-a405-e71784e58a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:08.454383 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2629a-e667-42a4-a405-e71784e58a9b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:08.454888 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2629a-e667-42a4-a405-e71784e58a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:08.455355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2629a-e667-42a4-a405-e71784e58a9b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:08.473541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a2629a-e667-42a4-a405-e71784e58a9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:08.482081 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-46a2629a-e667-42a4-a405-e71784e58a9b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 08:09:08.482081 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:08.482081 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:08.482081 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:08.482081 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:08.482081 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:08.482081 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:08.482081 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:08.482081 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:08.482081 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:08.482081 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:08.482081 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:08.482081 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:08.482081 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:08.482081 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:08.482081 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:08.482946 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:08.482946 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:08.482946 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:08.482946 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:08.482946 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:08.482946 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:08.482946 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:08.482946 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:08.482946 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:08.482946 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:08.482946 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:08.482946 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:08.482946 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:08.482946 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:08.482946 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:08.482946 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:08.483728 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:08.483728 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:08.483728 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:08.483728 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:08.483728 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:08.483728 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:08.483728 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:08.483728 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:08.483728 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:08.483728 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:08.483728 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 08:09:08.483728 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:08.486095 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 73/151] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jun 4 08:09:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:08.492482 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0e21c-13e6-4ff1-b8f2-b7e6a0d43b9a None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:08.560173 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:08.609543 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0e21c-13e6-4ff1-b8f2-b7e6a0d43b9a None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:08.648537 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568291b3-1abf-4425-9dbd-6230e9ce45cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:08.649573 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568291b3-1abf-4425-9dbd-6230e9ce45cb None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:08.650071 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568291b3-1abf-4425-9dbd-6230e9ce45cb None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:08.650567 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568291b3-1abf-4425-9dbd-6230e9ce45cb None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:08.651514 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568291b3-1abf-4425-9dbd-6230e9ce45cb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:08.652029 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568291b3-1abf-4425-9dbd-6230e9ce45cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:08.653609 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568291b3-1abf-4425-9dbd-6230e9ce45cb None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:08.665806 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 79/152] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:09:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:08.672283 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b917e3d-27da-4f57-9066-397b4cccb38d None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:08.672796 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b917e3d-27da-4f57-9066-397b4cccb38d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:08.673277 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b917e3d-27da-4f57-9066-397b4cccb38d None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:08.677676 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 74/153] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:08.680872 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b917e3d-27da-4f57-9066-397b4cccb38d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:08.687261 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a791a7-e64e-42bf-8266-9a9d0bd8cbdb None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:08.690502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a791a7-e64e-42bf-8266-9a9d0bd8cbdb None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:08.691516 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a791a7-e64e-42bf-8266-9a9d0bd8cbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:08.726487 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-63a791a7-e64e-42bf-8266-9a9d0bd8cbdb None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:08.729050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-63a791a7-e64e-42bf-8266-9a9d0bd8cbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:08.779156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:08.944780 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 80/154] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:08.972966 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b917e3d-27da-4f57-9066-397b4cccb38d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:09.001415 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a791a7-e64e-42bf-8266-9a9d0bd8cbdb None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:09.072127 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4b869-e725-4c15-b33a-49b6acc15da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:09.073057 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4b869-e725-4c15-b33a-49b6acc15da1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:09.073340 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4b869-e725-4c15-b33a-49b6acc15da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:09.073613 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4b869-e725-4c15-b33a-49b6acc15da1 None admin] PATH_INFO: `/v3/users/8de86eb101ea4d8ca7abd59c20dd7150` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:09.075221 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb4b869-e725-4c15-b33a-49b6acc15da1 None admin] RBAC: Authorizing `identity:get_user(user_id=8de86eb101ea4d8ca7abd59c20dd7150)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:09.076713 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb4b869-e725-4c15-b33a-49b6acc15da1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:09.078562 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 75/155] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:09:08 2022] GET /identity/v3/users/8de86eb101ea4d8ca7abd59c20dd7150 => generated 275 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:09.085166 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4b869-e725-4c15-b33a-49b6acc15da1 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:09.157320 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:09.272130 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4b869-e725-4c15-b33a-49b6acc15da1 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:09.303720 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a791a7-e64e-42bf-8266-9a9d0bd8cbdb None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:09.314640 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:09.390530 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11750e6-83c0-406d-9d35-cd5324e2e14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:09.391186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11750e6-83c0-406d-9d35-cd5324e2e14f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:09.391465 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11750e6-83c0-406d-9d35-cd5324e2e14f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:09.391738 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11750e6-83c0-406d-9d35-cd5324e2e14f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:09.462551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae58de-8168-4c24-bccf-bbf3c9d25a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:09.463368 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae58de-8168-4c24-bccf-bbf3c9d25a10 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:09.463656 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae58de-8168-4c24-bccf-bbf3c9d25a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:09.463937 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae58de-8168-4c24-bccf-bbf3c9d25a10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:09.522509 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae58de-8168-4c24-bccf-bbf3c9d25a10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:09.530334 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-00ae58de-8168-4c24-bccf-bbf3c9d25a10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:09:09.530334 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:09.530334 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:09.530334 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:09.530334 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:09.530334 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:09.530334 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:09.530334 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:09.530334 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:09.530334 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:09.530334 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:09.530334 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:09.530334 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:09.530334 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:09.530334 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:09.530334 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:09.531397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:09.531397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:09.531397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:09.531397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:09.531397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:09.531397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:09.531397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:09.531397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:09.531397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:09.531397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:09.531397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:09.531397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:09.531397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:09.531397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:09.531397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:09.531397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:09.532259 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:09.532259 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:09.532259 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:09.532259 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:09.532259 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:09.532259 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:09.532259 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:09.532259 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:09.532259 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:09.532259 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:09.532259 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:09:09.532259 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:09.536910 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 81/156] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 531 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:09:09.537549 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11750e6-83c0-406d-9d35-cd5324e2e14f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:09.542776 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae58de-8168-4c24-bccf-bbf3c9d25a10 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:09.547280 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11750e6-83c0-406d-9d35-cd5324e2e14f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:09.729558 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae58de-8168-4c24-bccf-bbf3c9d25a10 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:09.755445 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:09.804839 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 76/157] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:09:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 720 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 08:09:09.806766 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3c276-b1d5-4ad9-aaa2-71bb2b39c9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:09.807469 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3c276-b1d5-4ad9-aaa2-71bb2b39c9dd None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:09.807758 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3c276-b1d5-4ad9-aaa2-71bb2b39c9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:09.808034 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3c276-b1d5-4ad9-aaa2-71bb2b39c9dd None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:09.810215 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11750e6-83c0-406d-9d35-cd5324e2e14f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:09.814143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3c276-b1d5-4ad9-aaa2-71bb2b39c9dd None admin] RBAC: Adding query filter params (name=member) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:09.814786 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3c276-b1d5-4ad9-aaa2-71bb2b39c9dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:09.816515 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3c276-b1d5-4ad9-aaa2-71bb2b39c9dd None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:09.826163 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 82/158] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jun 4 08:09:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:09.839138 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3c276-b1d5-4ad9-aaa2-71bb2b39c9dd None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:09.846476 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:09.972687 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3c276-b1d5-4ad9-aaa2-71bb2b39c9dd None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:10.009457 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbce908-318e-42cd-ad11-dc8e2e4a28fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:10.010657 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbce908-318e-42cd-ad11-dc8e2e4a28fa None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:10.011110 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbce908-318e-42cd-ad11-dc8e2e4a28fa None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:10.011531 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbce908-318e-42cd-ad11-dc8e2e4a28fa None admin] PATH_INFO: `/v3/users/8de86eb101ea4d8ca7abd59c20dd7150` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:10.012899 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbce908-318e-42cd-ad11-dc8e2e4a28fa None admin] RBAC: Authorizing `identity:get_user(user_id=8de86eb101ea4d8ca7abd59c20dd7150)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:10.014548 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbce908-318e-42cd-ad11-dc8e2e4a28fa None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:10.016456 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 83/159] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:09:09 2022] GET /identity/v3/users/8de86eb101ea4d8ca7abd59c20dd7150 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:10.022832 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbce908-318e-42cd-ad11-dc8e2e4a28fa None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:10.054636 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11750e6-83c0-406d-9d35-cd5324e2e14f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:10.074434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:10.130456 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbce908-318e-42cd-ad11-dc8e2e4a28fa None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:10.158343 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b63041-bce1-402b-b031-8e21246c4e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:10.159549 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b63041-bce1-402b-b031-8e21246c4e56 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:10.159971 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b63041-bce1-402b-b031-8e21246c4e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:10.160389 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b63041-bce1-402b-b031-8e21246c4e56 None admin] PATH_INFO: `/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:10.161756 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b63041-bce1-402b-b031-8e21246c4e56 None admin] RBAC: Authorizing `identity:get_project(project_id=a9d904b06eb24d5d8bce3f192f7927ca)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:10.165262 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b63041-bce1-402b-b031-8e21246c4e56 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:10.167368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 77/160] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:09 2022] GET /identity/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca => generated 298 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:10.169197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51f424-751b-44a5-bd14-485eedfc2375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:10.171110 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51f424-751b-44a5-bd14-485eedfc2375 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:10.171110 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51f424-751b-44a5-bd14-485eedfc2375 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:10.171110 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51f424-751b-44a5-bd14-485eedfc2375 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:10.173046 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b63041-bce1-402b-b031-8e21246c4e56 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:10.277850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51f424-751b-44a5-bd14-485eedfc2375 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:10.278491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51f424-751b-44a5-bd14-485eedfc2375 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:10.350284 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:10.358891 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:10.377595 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b63041-bce1-402b-b031-8e21246c4e56 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:10.426921 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 84/161] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:09:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 08:09:10.432757 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51f424-751b-44a5-bd14-485eedfc2375 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:10.433886 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342419b-1753-448d-8a79-2cd2451e29fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:10.434555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342419b-1753-448d-8a79-2cd2451e29fe None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:10.434835 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342419b-1753-448d-8a79-2cd2451e29fe None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:10.435108 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342419b-1753-448d-8a79-2cd2451e29fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:10.435941 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342419b-1753-448d-8a79-2cd2451e29fe None admin] RBAC: Adding query filter params (role.id=b6177706a26446d5b4c540a3e97dee2e, scope.project.id=a9d904b06eb24d5d8bce3f192f7927ca, user.id=8de86eb101ea4d8ca7abd59c20dd7150) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:10.436249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342419b-1753-448d-8a79-2cd2451e29fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:10.437696 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342419b-1753-448d-8a79-2cd2451e29fe None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:10.444168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 78/162] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:09:10 2022] GET /identity/v3/role_assignments?user.id=8de86eb101ea4d8ca7abd59c20dd7150&scope.project.id=a9d904b06eb24d5d8bce3f192f7927ca&role.id=b6177706a26446d5b4c540a3e97dee2e => generated 608 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:10.542971 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51f424-751b-44a5-bd14-485eedfc2375 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:10.581860 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5fa4c6-b783-45dc-a246-d72fdcb20d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:10.582764 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fa4c6-b783-45dc-a246-d72fdcb20d75 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:10.583051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fa4c6-b783-45dc-a246-d72fdcb20d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:10.583328 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fa4c6-b783-45dc-a246-d72fdcb20d75 None admin] PATH_INFO: `/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:10.584681 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5fa4c6-b783-45dc-a246-d72fdcb20d75 None admin] RBAC: Authorizing `identity:get_project(project_id=a9d904b06eb24d5d8bce3f192f7927ca)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:10.586231 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5fa4c6-b783-45dc-a246-d72fdcb20d75 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:10.588066 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 85/163] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:10 2022] GET /identity/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:10.594123 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342419b-1753-448d-8a79-2cd2451e29fe None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:10.722077 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342419b-1753-448d-8a79-2cd2451e29fe None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:10.765558 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8ba5f-8284-4370-a904-b61599c2a2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:10.766303 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8ba5f-8284-4370-a904-b61599c2a2f0 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:10.766590 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8ba5f-8284-4370-a904-b61599c2a2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:10.766870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8ba5f-8284-4370-a904-b61599c2a2f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:10.767713 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8ba5f-8284-4370-a904-b61599c2a2f0 None admin] RBAC: Adding query filter params (role.id=314f0b44fb344a99bdda986e7b4ac3ab, scope.project.id=a9d904b06eb24d5d8bce3f192f7927ca, user.id=8de86eb101ea4d8ca7abd59c20dd7150) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:10.768025 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8ba5f-8284-4370-a904-b61599c2a2f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:10.770073 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8ba5f-8284-4370-a904-b61599c2a2f0 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:10.783137 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 79/164] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:09:10 2022] GET /identity/v3/role_assignments?user.id=8de86eb101ea4d8ca7abd59c20dd7150&scope.project.id=a9d904b06eb24d5d8bce3f192f7927ca&role.id=314f0b44fb344a99bdda986e7b4ac3ab => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:11.647035 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce0e61-d3f5-46eb-8c5c-6190fc56ec4d None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:11.648041 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce0e61-d3f5-46eb-8c5c-6190fc56ec4d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:11.648570 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce0e61-d3f5-46eb-8c5c-6190fc56ec4d None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:11.650521 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 86/165] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:11.652433 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec17858-56a8-406c-98a8-5d49284fda9e None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:11.653221 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec17858-56a8-406c-98a8-5d49284fda9e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:11.653695 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec17858-56a8-406c-98a8-5d49284fda9e None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:11.655595 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b134e84-6c3d-4afc-b030-b9d6ca451f64 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:11.656104 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b134e84-6c3d-4afc-b030-b9d6ca451f64 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:11.656570 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b134e84-6c3d-4afc-b030-b9d6ca451f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:11.666471 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 80/166] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:11 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:11.667794 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144abe02-42cd-40b3-b474-a3d2adc61ed1 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:11.668072 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144abe02-42cd-40b3-b474-a3d2adc61ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:11.668351 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144abe02-42cd-40b3-b474-a3d2adc61ed1 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:11.669663 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 81/167] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:11.676793 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe809e14-91c2-4e89-abcc-5a4825f37a79 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:11.677071 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe809e14-91c2-4e89-abcc-5a4825f37a79 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:11.677609 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe809e14-91c2-4e89-abcc-5a4825f37a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:11.685849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-0b134e84-6c3d-4afc-b030-b9d6ca451f64 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:11.687099 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0b134e84-6c3d-4afc-b030-b9d6ca451f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:11.696079 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-fe809e14-91c2-4e89-abcc-5a4825f37a79 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:11.697271 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-fe809e14-91c2-4e89-abcc-5a4825f37a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:11.698893 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:11.700606 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:11.773916 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 82/168] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:11.775483 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ab761-c971-4f2d-bf5f-6105a68cd810 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:11.775913 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ab761-c971-4f2d-bf5f-6105a68cd810 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:11.776326 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ab761-c971-4f2d-bf5f-6105a68cd810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:11.792907 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-380ab761-c971-4f2d-bf5f-6105a68cd810 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:11.794347 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-380ab761-c971-4f2d-bf5f-6105a68cd810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:11.860298 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 87/169] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:11.861080 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b134e84-6c3d-4afc-b030-b9d6ca451f64 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:11.872623 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 83/170] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:11.890536 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ab761-c971-4f2d-bf5f-6105a68cd810 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:11.962218 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:11.998313 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ab761-c971-4f2d-bf5f-6105a68cd810 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:12.027678 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b134e84-6c3d-4afc-b030-b9d6ca451f64 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:12.035512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fa3f5-8546-48d4-92bd-da5933a1ebab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:12.036547 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fa3f5-8546-48d4-92bd-da5933a1ebab None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:12.037021 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fa3f5-8546-48d4-92bd-da5933a1ebab None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:12.037483 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fa3f5-8546-48d4-92bd-da5933a1ebab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:12.048502 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86fa3f5-8546-48d4-92bd-da5933a1ebab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:12.057896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-d86fa3f5-8546-48d4-92bd-da5933a1ebab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:09:12.057896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:12.057896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:12.057896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:12.057896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:12.057896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:12.057896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:12.057896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:12.057896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:12.057896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:12.057896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:12.057896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:12.057896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:12.057896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:12.057896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:12.057896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:12.058998 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:12.058998 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:12.058998 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:12.058998 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:12.058998 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:12.058998 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:12.058998 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:12.058998 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:12.058998 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:12.058998 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:12.058998 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:12.058998 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:12.058998 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:12.058998 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:12.058998 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:12.058998 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:12.059831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:12.059831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:12.059831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:12.059831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:12.059831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:12.059831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:12.059831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:12.059831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:12.059831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:12.059831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:12.059831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:09:12.059831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:12.060431 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 84/171] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:09:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:09:12.066532 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fa3f5-8546-48d4-92bd-da5933a1ebab None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:12.068426 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c438570-a760-4dcf-b040-96bccee99c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:12.069437 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c438570-a760-4dcf-b040-96bccee99c01 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:12.069911 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c438570-a760-4dcf-b040-96bccee99c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:12.070359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c438570-a760-4dcf-b040-96bccee99c01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:12.080956 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c438570-a760-4dcf-b040-96bccee99c01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:12.089362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-1c438570-a760-4dcf-b040-96bccee99c01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:09:12.089362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:12.089362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:12.089362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:12.089362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:12.089362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:12.089362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:12.089362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:12.089362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:12.089362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:12.089362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:12.089362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:12.089362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:12.089362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:12.089362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:12.089362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:12.090359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:12.090359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:12.090359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:12.090359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:12.090359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:12.090359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:12.090359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:12.090359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:12.090359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:12.090359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:12.090359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:12.090359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:12.090359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:12.090359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:12.090359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:12.090359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:12.091156 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:12.091156 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:12.091156 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:12.091156 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:12.091156 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:12.091156 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:12.091156 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:12.091156 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:12.091156 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:12.091156 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:12.091156 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:09:12.091156 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:12.093711 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 88/172] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:09:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:12.095132 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c81b79-d415-4cd1-9aa1-fa8ab7ad8e6e None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:12.095589 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c81b79-d415-4cd1-9aa1-fa8ab7ad8e6e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:12.096033 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c81b79-d415-4cd1-9aa1-fa8ab7ad8e6e None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:12.098116 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 89/173] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:12.098971 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c81b79-d415-4cd1-9aa1-fa8ab7ad8e6e None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:12.102162 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:12.170943 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fa3f5-8546-48d4-92bd-da5933a1ebab None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:12.202684 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:12.205670 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c81b79-d415-4cd1-9aa1-fa8ab7ad8e6e None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:12.212447 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5c150-0166-462a-a227-4b81f9225079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:12.213548 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5c150-0166-462a-a227-4b81f9225079 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:12.213654 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5c150-0166-462a-a227-4b81f9225079 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:12.213938 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5c150-0166-462a-a227-4b81f9225079 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:12.225121 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5c150-0166-462a-a227-4b81f9225079 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:12.233370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-c3f5c150-0166-462a-a227-4b81f9225079 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:09:12.233370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:12.233370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:12.233370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:12.233370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:12.233370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:12.233370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:12.233370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:12.233370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:12.233370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:12.233370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:12.233370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:12.233370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:12.233370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:12.233370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:12.233370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:12.234359 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:12.234359 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:12.234359 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:12.234359 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:12.234359 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:12.234359 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:12.234359 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:12.234359 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:12.234359 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:12.234359 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:12.234359 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:12.234359 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:12.234359 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:12.234359 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:12.234359 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:12.234359 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:12.235149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:12.235149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:12.235149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:12.235149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:12.235149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:12.235149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:12.235149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:12.235149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:12.235149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:12.235149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:12.235149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:09:12.235149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:12.235149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 85/174] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:12.236428 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05910b8-0bb0-4dc3-b469-459034838abd None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:12.236428 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05910b8-0bb0-4dc3-b469-459034838abd None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:12.236589 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05910b8-0bb0-4dc3-b469-459034838abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:12.246038 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82666be4-1c62-469c-90fb-9be38bd5269c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:12.246706 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82666be4-1c62-469c-90fb-9be38bd5269c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:12.246986 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82666be4-1c62-469c-90fb-9be38bd5269c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:12.247258 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82666be4-1c62-469c-90fb-9be38bd5269c None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:12.247997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82666be4-1c62-469c-90fb-9be38bd5269c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:12.248297 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82666be4-1c62-469c-90fb-9be38bd5269c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:12.249685 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82666be4-1c62-469c-90fb-9be38bd5269c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:12.254967 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f05910b8-0bb0-4dc3-b469-459034838abd None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:12.254967 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f05910b8-0bb0-4dc3-b469-459034838abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:12.260667 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 90/175] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:12.262829 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82666be4-1c62-469c-90fb-9be38bd5269c None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:12.326918 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:12.327815 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 86/176] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:12.329206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc154f-feb8-4ec5-880b-f613592a0e6e None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:12.329529 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc154f-feb8-4ec5-880b-f613592a0e6e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:12.329898 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc154f-feb8-4ec5-880b-f613592a0e6e None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:12.331786 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 87/177] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:12.332422 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc154f-feb8-4ec5-880b-f613592a0e6e None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:12.366149 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82666be4-1c62-469c-90fb-9be38bd5269c None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:12.400353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f59499-6099-4fde-8f5c-524a4080871f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:12.401013 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f59499-6099-4fde-8f5c-524a4080871f None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:12.401296 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f59499-6099-4fde-8f5c-524a4080871f None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:12.401569 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f59499-6099-4fde-8f5c-524a4080871f None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:12.402334 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f59499-6099-4fde-8f5c-524a4080871f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:12.402641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f59499-6099-4fde-8f5c-524a4080871f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:12.404019 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f59499-6099-4fde-8f5c-524a4080871f None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:12.411988 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 91/178] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:12.412738 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f59499-6099-4fde-8f5c-524a4080871f None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:12.435776 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc154f-feb8-4ec5-880b-f613592a0e6e None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:12.453061 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:12.470209 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8765e3-561c-4cbd-b0c3-8cdfb06d500b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:12.470875 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8765e3-561c-4cbd-b0c3-8cdfb06d500b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:12.471159 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8765e3-561c-4cbd-b0c3-8cdfb06d500b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:12.471439 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8765e3-561c-4cbd-b0c3-8cdfb06d500b None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:12.472207 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8765e3-561c-4cbd-b0c3-8cdfb06d500b None admin] RBAC: Adding query filter params (name=member) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:12.472516 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8765e3-561c-4cbd-b0c3-8cdfb06d500b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:12.473924 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8765e3-561c-4cbd-b0c3-8cdfb06d500b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:12.481714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 88/179] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jun 4 08:09:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:12.482941 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c987472-94fe-49f7-bdbf-067515f81109 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:12.483230 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c987472-94fe-49f7-bdbf-067515f81109 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:12.483506 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c987472-94fe-49f7-bdbf-067515f81109 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:12.484958 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 89/180] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:12.486945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df32fa-128a-41b1-ba7d-19efcf79ffbd None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:12.487231 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df32fa-128a-41b1-ba7d-19efcf79ffbd None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:12.488046 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df32fa-128a-41b1-ba7d-19efcf79ffbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:12.504278 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-90df32fa-128a-41b1-ba7d-19efcf79ffbd None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:12.505463 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-90df32fa-128a-41b1-ba7d-19efcf79ffbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:12.512417 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f59499-6099-4fde-8f5c-524a4080871f None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:12.538483 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:12.547477 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb112072-21c0-4c64-a920-f64e02676d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:12.548359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb112072-21c0-4c64-a920-f64e02676d23 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:12.548642 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb112072-21c0-4c64-a920-f64e02676d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:12.548921 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb112072-21c0-4c64-a920-f64e02676d23 None admin] PATH_INFO: `/v3/users/ea4962dcc8704bc2a27dbae552dc5732` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:12.564842 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb112072-21c0-4c64-a920-f64e02676d23 None admin] RBAC: Authorizing `identity:get_user(user_id=ea4962dcc8704bc2a27dbae552dc5732)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:12.566905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb112072-21c0-4c64-a920-f64e02676d23 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:12.568596 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 92/181] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:09:12 2022] GET /identity/v3/users/ea4962dcc8704bc2a27dbae552dc5732 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:12.569447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb112072-21c0-4c64-a920-f64e02676d23 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:12.574186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 90/182] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:12.575188 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df32fa-128a-41b1-ba7d-19efcf79ffbd None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:12.667054 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb112072-21c0-4c64-a920-f64e02676d23 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:12.672289 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df32fa-128a-41b1-ba7d-19efcf79ffbd None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:12.683740 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:12.702353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1f173-99b4-4f1e-9412-eb8a0b9cea27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:12.703184 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1f173-99b4-4f1e-9412-eb8a0b9cea27 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:12.703414 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1f173-99b4-4f1e-9412-eb8a0b9cea27 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:12.703691 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1f173-99b4-4f1e-9412-eb8a0b9cea27 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:12.704844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1f173-99b4-4f1e-9412-eb8a0b9cea27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:12.706358 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1f173-99b4-4f1e-9412-eb8a0b9cea27 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:12.707965 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 93/183] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:09:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:12.712315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda87e51-ee0a-4b85-98f3-802698fabb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:12.712442 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1f173-99b4-4f1e-9412-eb8a0b9cea27 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:12.712531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda87e51-ee0a-4b85-98f3-802698fabb0a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:12.712531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda87e51-ee0a-4b85-98f3-802698fabb0a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:12.712531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda87e51-ee0a-4b85-98f3-802698fabb0a None admin] PATH_INFO: `/v3/users/1757b5d7af48479b9e3aef95e06a280d` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:12.713516 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda87e51-ee0a-4b85-98f3-802698fabb0a None admin] RBAC: Authorizing `identity:get_user(user_id=1757b5d7af48479b9e3aef95e06a280d)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:12.715013 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda87e51-ee0a-4b85-98f3-802698fabb0a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:12.720762 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 91/184] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:09:12 2022] GET /identity/v3/users/1757b5d7af48479b9e3aef95e06a280d => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:12.720762 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2143cae-12c8-4857-bff3-7635a04163bf None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:12.720762 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2143cae-12c8-4857-bff3-7635a04163bf None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:12.720762 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2143cae-12c8-4857-bff3-7635a04163bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:12.733877 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-a2143cae-12c8-4857-bff3-7635a04163bf None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:12.735050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a2143cae-12c8-4857-bff3-7635a04163bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:12.764024 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:12.803496 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 92/185] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:12.804307 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2143cae-12c8-4857-bff3-7635a04163bf None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:12.820706 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1f173-99b4-4f1e-9412-eb8a0b9cea27 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:12.855575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462de35e-fba1-4575-966c-ad3608ce5d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:12.856437 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462de35e-fba1-4575-966c-ad3608ce5d3d None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:12.856711 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462de35e-fba1-4575-966c-ad3608ce5d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:12.856987 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462de35e-fba1-4575-966c-ad3608ce5d3d None admin] PATH_INFO: `/v3/users/8de86eb101ea4d8ca7abd59c20dd7150` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:12.858193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462de35e-fba1-4575-966c-ad3608ce5d3d None admin] RBAC: Authorizing `identity:get_user(user_id=8de86eb101ea4d8ca7abd59c20dd7150)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:12.859677 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462de35e-fba1-4575-966c-ad3608ce5d3d None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:12.861447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 94/186] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:09:12 2022] GET /identity/v3/users/8de86eb101ea4d8ca7abd59c20dd7150 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:12.862038 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462de35e-fba1-4575-966c-ad3608ce5d3d None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:12.902046 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2143cae-12c8-4857-bff3-7635a04163bf None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:12.912450 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:12.938966 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ede6dd-5c7d-4169-a443-05c583ab2ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:12.939614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ede6dd-5c7d-4169-a443-05c583ab2ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:12.939897 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ede6dd-5c7d-4169-a443-05c583ab2ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:12.940166 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ede6dd-5c7d-4169-a443-05c583ab2ec7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:12.964563 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462de35e-fba1-4575-966c-ad3608ce5d3d None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:12.983645 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:12.997353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20458f-3b58-4327-a4a5-bb2c49a3c1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:12.998180 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20458f-3b58-4327-a4a5-bb2c49a3c1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:12.998459 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20458f-3b58-4327-a4a5-bb2c49a3c1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:12.998732 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20458f-3b58-4327-a4a5-bb2c49a3c1c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:13.006533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ede6dd-5c7d-4169-a443-05c583ab2ec7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:13.008001 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ede6dd-5c7d-4169-a443-05c583ab2ec7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:13.009360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20458f-3b58-4327-a4a5-bb2c49a3c1c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:13.017650 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-ea20458f-3b58-4327-a4a5-bb2c49a3c1c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 08:09:13.017650 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:13.017650 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:13.017650 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:13.017650 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:13.017650 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:13.017650 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:13.017650 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:13.017650 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:13.017650 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:13.017650 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:13.017650 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:13.017650 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:13.017650 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:13.017650 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:13.017650 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:13.018658 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:13.018658 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:13.018658 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:13.018658 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:13.018658 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:13.018658 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:13.018658 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:13.018658 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:13.018658 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:13.018658 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:13.018658 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:13.018658 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:13.018658 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:13.018658 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:13.018658 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:13.018658 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:13.020010 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:13.020010 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:13.020010 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:13.020010 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:13.020010 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:13.020010 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:13.020010 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:13.020010 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:13.020010 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:13.020010 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:13.020010 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 08:09:13.020010 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:13.020010 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 95/187] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jun 4 08:09:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:13.020663 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20458f-3b58-4327-a4a5-bb2c49a3c1c7 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:13.107825 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 93/188] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:09:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 08:09:13.108655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ede6dd-5c7d-4169-a443-05c583ab2ec7 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:13.117938 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20458f-3b58-4327-a4a5-bb2c49a3c1c7 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:13.119759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:13.151369 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5a606-ba68-4000-8e0c-ceb12f5e614b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:13.152027 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5a606-ba68-4000-8e0c-ceb12f5e614b None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:13.152306 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5a606-ba68-4000-8e0c-ceb12f5e614b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:13.152576 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5a606-ba68-4000-8e0c-ceb12f5e614b None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:13.153272 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5a606-ba68-4000-8e0c-ceb12f5e614b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:13.154732 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5a606-ba68-4000-8e0c-ceb12f5e614b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:13.174812 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 96/189] 10.222.0.57 () {60 vars in 1132 bytes} [Sat Jun 4 08:09:13 2022] POST /identity/v3/users => generated 297 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:09:13.176152 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5a606-ba68-4000-8e0c-ceb12f5e614b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:13.213709 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ede6dd-5c7d-4169-a443-05c583ab2ec7 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:13.221390 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:13.254230 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1e3e3-2006-4b42-ac2d-90439c1e4f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:13.254893 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1e3e3-2006-4b42-ac2d-90439c1e4f6b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:13.255172 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1e3e3-2006-4b42-ac2d-90439c1e4f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:13.255450 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1e3e3-2006-4b42-ac2d-90439c1e4f6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:13.298499 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5a606-ba68-4000-8e0c-ceb12f5e614b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:13.331887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1e3e3-2006-4b42-ac2d-90439c1e4f6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:13.333700 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1e3e3-2006-4b42-ac2d-90439c1e4f6b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:13.335715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044ddd2-27ab-413a-a2ba-57e1fc5424f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:13.336528 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044ddd2-27ab-413a-a2ba-57e1fc5424f3 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:13.336812 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044ddd2-27ab-413a-a2ba-57e1fc5424f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:13.337090 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044ddd2-27ab-413a-a2ba-57e1fc5424f3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:13.344999 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:13.349453 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6044ddd2-27ab-413a-a2ba-57e1fc5424f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:13.357397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-6044ddd2-27ab-413a-a2ba-57e1fc5424f3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 08:09:13.357397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:13.357397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:13.357397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:13.357397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:13.357397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:13.357397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:13.357397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:13.357397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:13.357397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:13.357397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:13.357397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:13.357397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:13.357397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:13.357397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:13.357397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:13.358460 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:13.358460 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:13.358460 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:13.358460 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:13.358460 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:13.358460 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:13.358460 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:13.358460 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:13.358460 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:13.358460 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:13.358460 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:13.358460 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:13.358460 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:13.358460 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:13.358460 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:13.358460 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:13.359311 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:13.359311 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:13.359311 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:13.359311 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:13.359311 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:13.359311 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:13.359311 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:13.359311 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:13.359311 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:13.359311 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:13.359311 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 08:09:13.359311 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:13.359311 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 97/190] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:13.359955 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044ddd2-27ab-413a-a2ba-57e1fc5424f3 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:13.459640 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 94/191] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:09:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 08:09:13.465280 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1e3e3-2006-4b42-ac2d-90439c1e4f6b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:13.481102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:13.490191 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044ddd2-27ab-413a-a2ba-57e1fc5424f3 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:13.533958 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404df29-4518-4758-b3c1-8693fc684122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:13.535944 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404df29-4518-4758-b3c1-8693fc684122 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:13.535944 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404df29-4518-4758-b3c1-8693fc684122 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:13.535944 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404df29-4518-4758-b3c1-8693fc684122 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:13.593747 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1e3e3-2006-4b42-ac2d-90439c1e4f6b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:13.606410 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:13.620549 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404df29-4518-4758-b3c1-8693fc684122 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:13.622171 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404df29-4518-4758-b3c1-8693fc684122 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:13.639364 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d3623-b0f4-4b71-bc60-37a7b6a43d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:13.640047 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d3623-b0f4-4b71-bc60-37a7b6a43d8a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:13.640581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d3623-b0f4-4b71-bc60-37a7b6a43d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:13.640861 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d3623-b0f4-4b71-bc60-37a7b6a43d8a None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:13.642034 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d3623-b0f4-4b71-bc60-37a7b6a43d8a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:13.642346 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d3623-b0f4-4b71-bc60-37a7b6a43d8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:13.643781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d3623-b0f4-4b71-bc60-37a7b6a43d8a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:13.655896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 95/192] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:09:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:13.656740 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d3623-b0f4-4b71-bc60-37a7b6a43d8a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:13.733285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:13.741785 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 98/193] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:09:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 08:09:13.742737 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404df29-4518-4758-b3c1-8693fc684122 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:13.801948 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d3623-b0f4-4b71-bc60-37a7b6a43d8a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:13.843910 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd38422-2721-4413-b332-4f02a82762ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:13.844870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd38422-2721-4413-b332-4f02a82762ed None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:13.845158 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd38422-2721-4413-b332-4f02a82762ed None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:13.846096 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd38422-2721-4413-b332-4f02a82762ed None admin] PATH_INFO: `/v3/projects/626251d4d31a465b966323ca5f3905d9` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:13.849512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd38422-2721-4413-b332-4f02a82762ed None admin] RBAC: Authorizing `identity:get_project(project_id=626251d4d31a465b966323ca5f3905d9)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:13.852082 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd38422-2721-4413-b332-4f02a82762ed None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:13.854844 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 96/194] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:13 2022] GET /identity/v3/projects/626251d4d31a465b966323ca5f3905d9 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:13.855766 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd38422-2721-4413-b332-4f02a82762ed None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:13.874812 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404df29-4518-4758-b3c1-8693fc684122 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:13.910591 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:13.920182 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783a766-3587-4cae-a113-b8ac427efde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:13.921357 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783a766-3587-4cae-a113-b8ac427efde6 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:13.921851 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783a766-3587-4cae-a113-b8ac427efde6 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:13.922295 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783a766-3587-4cae-a113-b8ac427efde6 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:13.923191 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783a766-3587-4cae-a113-b8ac427efde6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:13.923650 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783a766-3587-4cae-a113-b8ac427efde6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:13.925811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783a766-3587-4cae-a113-b8ac427efde6 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:13.935312 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 99/195] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jun 4 08:09:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:13.936375 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783a766-3587-4cae-a113-b8ac427efde6 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:13.984327 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd38422-2721-4413-b332-4f02a82762ed None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:14.017724 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:14.026753 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e9fab-b5c4-420c-b8d3-23f060f07f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:14.027633 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e9fab-b5c4-420c-b8d3-23f060f07f8c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:14.027918 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e9fab-b5c4-420c-b8d3-23f060f07f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:14.028440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e9fab-b5c4-420c-b8d3-23f060f07f8c None admin] PATH_INFO: `/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:14.030249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e9fab-b5c4-420c-b8d3-23f060f07f8c None admin] RBAC: Authorizing `identity:get_project(project_id=a9d904b06eb24d5d8bce3f192f7927ca)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:14.032032 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e9fab-b5c4-420c-b8d3-23f060f07f8c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:14.035316 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 97/196] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:13 2022] GET /identity/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:14.035907 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e9fab-b5c4-420c-b8d3-23f060f07f8c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:14.069076 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783a766-3587-4cae-a113-b8ac427efde6 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:14.109600 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a1aa4-6132-4437-b2c0-d32556af8e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:14.110780 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a1aa4-6132-4437-b2c0-d32556af8e29 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:14.111070 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a1aa4-6132-4437-b2c0-d32556af8e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:14.111349 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a1aa4-6132-4437-b2c0-d32556af8e29 None admin] PATH_INFO: `/v3/users/ea4962dcc8704bc2a27dbae552dc5732` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:14.113372 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a1aa4-6132-4437-b2c0-d32556af8e29 None admin] RBAC: Authorizing `identity:get_user(user_id=ea4962dcc8704bc2a27dbae552dc5732)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:14.115567 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a1aa4-6132-4437-b2c0-d32556af8e29 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:14.118143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 100/197] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:09:13 2022] GET /identity/v3/users/ea4962dcc8704bc2a27dbae552dc5732 => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:14.118717 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a1aa4-6132-4437-b2c0-d32556af8e29 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:14.162700 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e9fab-b5c4-420c-b8d3-23f060f07f8c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:14.170814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:14.202838 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0994d-287d-4a45-afc7-a3b52498c3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:14.204111 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0994d-287d-4a45-afc7-a3b52498c3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:14.205147 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0994d-287d-4a45-afc7-a3b52498c3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:14.205651 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0994d-287d-4a45-afc7-a3b52498c3a1 None admin] PATH_INFO: `/v3/projects/8231e2301d734c70a522035e3a4bf17a` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:14.207395 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0994d-287d-4a45-afc7-a3b52498c3a1 None admin] RBAC: Authorizing `identity:get_project(project_id=8231e2301d734c70a522035e3a4bf17a)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:14.209085 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0994d-287d-4a45-afc7-a3b52498c3a1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:14.211190 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 98/198] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:14 2022] GET /identity/v3/projects/8231e2301d734c70a522035e3a4bf17a => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:14.212256 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0994d-287d-4a45-afc7-a3b52498c3a1 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:14.260355 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a1aa4-6132-4437-b2c0-d32556af8e29 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:14.290678 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:14.301707 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350a339-e464-4377-80c3-e6aa15a1584e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:14.302663 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350a339-e464-4377-80c3-e6aa15a1584e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:14.302953 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350a339-e464-4377-80c3-e6aa15a1584e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:14.303230 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350a339-e464-4377-80c3-e6aa15a1584e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:14.304194 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350a339-e464-4377-80c3-e6aa15a1584e None admin] RBAC: Adding query filter params (role.id=431cef539cfb476aad50d2470e763b5f, scope.project.id=626251d4d31a465b966323ca5f3905d9, user.id=ea4962dcc8704bc2a27dbae552dc5732) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:14.304503 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350a339-e464-4377-80c3-e6aa15a1584e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:14.306056 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350a339-e464-4377-80c3-e6aa15a1584e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:14.311728 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 101/199] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:09:14 2022] GET /identity/v3/role_assignments?user.id=ea4962dcc8704bc2a27dbae552dc5732&scope.project.id=626251d4d31a465b966323ca5f3905d9&role.id=431cef539cfb476aad50d2470e763b5f => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:14.312569 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350a339-e464-4377-80c3-e6aa15a1584e None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:14.332266 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0994d-287d-4a45-afc7-a3b52498c3a1 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:14.370445 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe36fbe-4829-4b83-bb8a-3580558d1148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:14.371778 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe36fbe-4829-4b83-bb8a-3580558d1148 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:14.372366 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe36fbe-4829-4b83-bb8a-3580558d1148 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:14.372920 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe36fbe-4829-4b83-bb8a-3580558d1148 None admin] PATH_INFO: `/v3/users/2e3cf5de75894c17b1cc9bf0c4855c82` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:14.374492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe36fbe-4829-4b83-bb8a-3580558d1148 None admin] RBAC: Authorizing `identity:get_user(user_id=2e3cf5de75894c17b1cc9bf0c4855c82)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:14.376290 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe36fbe-4829-4b83-bb8a-3580558d1148 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:14.378268 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 99/200] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:09:14 2022] GET /identity/v3/users/2e3cf5de75894c17b1cc9bf0c4855c82 => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:14.379278 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe36fbe-4829-4b83-bb8a-3580558d1148 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:14.423741 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350a339-e464-4377-80c3-e6aa15a1584e None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:14.428360 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:14.461137 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe2b9e-8746-4ba7-907e-bccc14604662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:14.461811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe2b9e-8746-4ba7-907e-bccc14604662 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:14.462118 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe2b9e-8746-4ba7-907e-bccc14604662 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:14.462394 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe2b9e-8746-4ba7-907e-bccc14604662 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:14.463235 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe2b9e-8746-4ba7-907e-bccc14604662 None admin] RBAC: Adding query filter params (role.id=431cef539cfb476aad50d2470e763b5f, scope.project.id=a9d904b06eb24d5d8bce3f192f7927ca, user.id=1757b5d7af48479b9e3aef95e06a280d) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:14.463547 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe2b9e-8746-4ba7-907e-bccc14604662 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:14.465064 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe2b9e-8746-4ba7-907e-bccc14604662 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:14.472490 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 102/201] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:09:14 2022] GET /identity/v3/role_assignments?user.id=1757b5d7af48479b9e3aef95e06a280d&scope.project.id=a9d904b06eb24d5d8bce3f192f7927ca&role.id=431cef539cfb476aad50d2470e763b5f => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:14.473210 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe2b9e-8746-4ba7-907e-bccc14604662 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:14.498322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe36fbe-4829-4b83-bb8a-3580558d1148 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:14.538151 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:14.546569 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68100d-ef3b-484a-830d-8b8572154734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:14.547671 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68100d-ef3b-484a-830d-8b8572154734 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:14.548158 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68100d-ef3b-484a-830d-8b8572154734 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:14.548667 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68100d-ef3b-484a-830d-8b8572154734 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:14.594761 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe2b9e-8746-4ba7-907e-bccc14604662 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:14.631922 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec68100d-ef3b-484a-830d-8b8572154734 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:14.633799 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf82d9-466b-482a-9de2-2ce9dcd0685f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:14.634123 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec68100d-ef3b-484a-830d-8b8572154734 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:14.634518 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf82d9-466b-482a-9de2-2ce9dcd0685f None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:14.634803 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf82d9-466b-482a-9de2-2ce9dcd0685f None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:14.635080 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf82d9-466b-482a-9de2-2ce9dcd0685f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:14.635947 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf82d9-466b-482a-9de2-2ce9dcd0685f None admin] RBAC: Adding query filter params (role.id=314f0b44fb344a99bdda986e7b4ac3ab, scope.project.id=8231e2301d734c70a522035e3a4bf17a, user.id=8de86eb101ea4d8ca7abd59c20dd7150) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:14.636270 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf82d9-466b-482a-9de2-2ce9dcd0685f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:14.637905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf82d9-466b-482a-9de2-2ce9dcd0685f None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:14.644764 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 103/202] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:09:14 2022] GET /identity/v3/role_assignments?user.id=8de86eb101ea4d8ca7abd59c20dd7150&scope.project.id=8231e2301d734c70a522035e3a4bf17a&role.id=314f0b44fb344a99bdda986e7b4ac3ab => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:14.645648 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf82d9-466b-482a-9de2-2ce9dcd0685f None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:14.688547 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:14.757881 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 100/203] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:09:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 08:09:14.764274 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68100d-ef3b-484a-830d-8b8572154734 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:14.776849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf82d9-466b-482a-9de2-2ce9dcd0685f None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:14.832100 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:14.887439 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512dd811-bca4-4737-8530-8e340d5d500b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:14.887884 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dd811-bca4-4737-8530-8e340d5d500b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:14.888164 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dd811-bca4-4737-8530-8e340d5d500b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:14.888442 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dd811-bca4-4737-8530-8e340d5d500b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:14.895708 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68100d-ef3b-484a-830d-8b8572154734 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:14.949267 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d66ee0-10a3-4569-b727-2a094a49181b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:14.950730 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d66ee0-10a3-4569-b727-2a094a49181b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:14.951251 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d66ee0-10a3-4569-b727-2a094a49181b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:14.951730 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d66ee0-10a3-4569-b727-2a094a49181b None admin] PATH_INFO: `/v3/projects/626251d4d31a465b966323ca5f3905d9` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:14.953433 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d66ee0-10a3-4569-b727-2a094a49181b None admin] RBAC: Authorizing `identity:get_project(project_id=626251d4d31a465b966323ca5f3905d9)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:14.955340 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d66ee0-10a3-4569-b727-2a094a49181b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:14.958698 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 101/204] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:14 2022] GET /identity/v3/projects/626251d4d31a465b966323ca5f3905d9 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:14.964393 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d66ee0-10a3-4569-b727-2a094a49181b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:14.986276 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:15.041236 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512dd811-bca4-4737-8530-8e340d5d500b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:15.042747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512dd811-bca4-4737-8530-8e340d5d500b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:15.080636 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d66ee0-10a3-4569-b727-2a094a49181b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:15.125911 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6c858-d2bf-4d0a-9e6a-cd41ef6119b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:15.126528 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6c858-d2bf-4d0a-9e6a-cd41ef6119b3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:15.126862 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6c858-d2bf-4d0a-9e6a-cd41ef6119b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:15.127148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6c858-d2bf-4d0a-9e6a-cd41ef6119b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:15.128641 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6c858-d2bf-4d0a-9e6a-cd41ef6119b3 None admin] RBAC: Adding query filter params (role.id=b6177706a26446d5b4c540a3e97dee2e, scope.project.id=626251d4d31a465b966323ca5f3905d9, user.id=ea4962dcc8704bc2a27dbae552dc5732) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:15.128955 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6c858-d2bf-4d0a-9e6a-cd41ef6119b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:15.130574 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6c858-d2bf-4d0a-9e6a-cd41ef6119b3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:15.137124 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 102/205] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:09:14 2022] GET /identity/v3/role_assignments?user.id=ea4962dcc8704bc2a27dbae552dc5732&scope.project.id=626251d4d31a465b966323ca5f3905d9&role.id=b6177706a26446d5b4c540a3e97dee2e => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:15.189285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 104/206] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:09:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 08:09:15.195874 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6c858-d2bf-4d0a-9e6a-cd41ef6119b3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:15.279941 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:15.320136 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6c858-d2bf-4d0a-9e6a-cd41ef6119b3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:15.363598 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b753e2-3811-419c-ba50-e4239bdaad15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:15.364837 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b753e2-3811-419c-ba50-e4239bdaad15 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:15.365315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b753e2-3811-419c-ba50-e4239bdaad15 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:15.365809 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b753e2-3811-419c-ba50-e4239bdaad15 None admin] PATH_INFO: `/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:15.370686 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b753e2-3811-419c-ba50-e4239bdaad15 None admin] RBAC: Authorizing `identity:get_project(project_id=a9d904b06eb24d5d8bce3f192f7927ca)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:15.372487 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b753e2-3811-419c-ba50-e4239bdaad15 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:15.374673 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 103/207] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:15 2022] GET /identity/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:15.381268 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512dd811-bca4-4737-8530-8e340d5d500b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:15.421533 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:15.519972 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512dd811-bca4-4737-8530-8e340d5d500b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:15.560357 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46bb60-34fc-4ba7-9141-de404b78d7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:15.561017 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46bb60-34fc-4ba7-9141-de404b78d7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:15.561296 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46bb60-34fc-4ba7-9141-de404b78d7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:15.561566 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46bb60-34fc-4ba7-9141-de404b78d7c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:15.562432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46bb60-34fc-4ba7-9141-de404b78d7c0 None admin] RBAC: Adding query filter params (role.id=c005105deb5849b9a6e5122b2efa9633, scope.project.id=a9d904b06eb24d5d8bce3f192f7927ca, user.id=2e3cf5de75894c17b1cc9bf0c4855c82) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:15.562744 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46bb60-34fc-4ba7-9141-de404b78d7c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:15.564183 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46bb60-34fc-4ba7-9141-de404b78d7c0 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:15.571443 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 105/208] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:09:15 2022] GET /identity/v3/role_assignments?user.id=2e3cf5de75894c17b1cc9bf0c4855c82&scope.project.id=a9d904b06eb24d5d8bce3f192f7927ca&role.id=c005105deb5849b9a6e5122b2efa9633 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:16.171328 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b75d8-1b27-4010-bdce-c9d156282cd4 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:16.172322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b75d8-1b27-4010-bdce-c9d156282cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:16.172811 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b75d8-1b27-4010-bdce-c9d156282cd4 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:16.174422 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 104/209] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:16.181571 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8206a8-1c2f-453f-b748-b7364b76a25c None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:16.182481 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8206a8-1c2f-453f-b748-b7364b76a25c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:16.182965 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8206a8-1c2f-453f-b748-b7364b76a25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:16.203753 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-0d8206a8-1c2f-453f-b748-b7364b76a25c None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:16.205395 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0d8206a8-1c2f-453f-b748-b7364b76a25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:16.220551 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9c63e-243b-4183-bbd5-facf75a0485a None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:16.220878 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9c63e-243b-4183-bbd5-facf75a0485a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:16.221121 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9c63e-243b-4183-bbd5-facf75a0485a None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:16.222790 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 105/210] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:16.228190 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef311f-c289-4e1a-8472-53e6b418f1a8 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:16.228531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef311f-c289-4e1a-8472-53e6b418f1a8 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:16.228815 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef311f-c289-4e1a-8472-53e6b418f1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:16.248868 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-57ef311f-c289-4e1a-8472-53e6b418f1a8 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:16.250092 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-57ef311f-c289-4e1a-8472-53e6b418f1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:16.305948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 106/211] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 08:09:16.330520 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8206a8-1c2f-453f-b748-b7364b76a25c None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:16.338147 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 106/212] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 08:09:16.347103 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:16.366860 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef311f-c289-4e1a-8472-53e6b418f1a8 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:16.444060 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8206a8-1c2f-453f-b748-b7364b76a25c None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:16.449661 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:16.478923 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c1aac-8689-483d-a670-41c89f07b2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:16.479713 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c1aac-8689-483d-a670-41c89f07b2e7 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:16.479992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c1aac-8689-483d-a670-41c89f07b2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:16.480258 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c1aac-8689-483d-a670-41c89f07b2e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:16.482502 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef311f-c289-4e1a-8472-53e6b418f1a8 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:16.491464 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c1aac-8689-483d-a670-41c89f07b2e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:16.499632 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-0b4c1aac-8689-483d-a670-41c89f07b2e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:09:16.499632 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:16.499632 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:16.499632 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:16.499632 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:16.499632 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:16.499632 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:16.499632 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:16.499632 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:16.499632 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:16.499632 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:16.499632 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:16.499632 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:16.499632 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:16.499632 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:16.499632 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:16.500502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:16.500502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:16.500502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:16.500502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:16.500502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:16.500502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:16.500502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:16.500502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:16.500502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:16.500502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:16.500502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:16.500502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:16.500502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:16.500502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:16.500502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:16.500502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:16.501310 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:16.501310 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:16.501310 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:16.501310 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:16.501310 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:16.501310 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:16.501310 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:16.501310 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:16.501310 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:16.501310 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:16.501310 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:09:16.501310 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:16.501310 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 107/213] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:09:16.506892 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c1aac-8689-483d-a670-41c89f07b2e7 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:16.519878 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fbc33-1839-4043-bedf-9f05264db8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:16.520836 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fbc33-1839-4043-bedf-9f05264db8bc None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:16.521160 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fbc33-1839-4043-bedf-9f05264db8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:16.521449 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fbc33-1839-4043-bedf-9f05264db8bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:16.522664 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fbc33-1839-4043-bedf-9f05264db8bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:16.524394 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fbc33-1839-4043-bedf-9f05264db8bc None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:16.526309 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 107/214] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:09:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:16.531736 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fbc33-1839-4043-bedf-9f05264db8bc None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:16.580623 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:16.613762 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c1aac-8689-483d-a670-41c89f07b2e7 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:16.647788 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fbc33-1839-4043-bedf-9f05264db8bc None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:16.651904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aacc96-8613-4eb7-972e-d2020a11485e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:16.652578 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aacc96-8613-4eb7-972e-d2020a11485e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:16.652856 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aacc96-8613-4eb7-972e-d2020a11485e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:16.653132 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aacc96-8613-4eb7-972e-d2020a11485e None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:16.653931 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aacc96-8613-4eb7-972e-d2020a11485e None admin] RBAC: Adding query filter params (name=member) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:16.654238 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aacc96-8613-4eb7-972e-d2020a11485e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:16.655728 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aacc96-8613-4eb7-972e-d2020a11485e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:16.664663 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 108/215] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jun 4 08:09:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:16.670175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aacc96-8613-4eb7-972e-d2020a11485e None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:16.685383 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e0b49-fd03-4479-9f6f-c77335013c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:16.686470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e0b49-fd03-4479-9f6f-c77335013c50 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:16.686765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e0b49-fd03-4479-9f6f-c77335013c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:16.687175 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e0b49-fd03-4479-9f6f-c77335013c50 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:16.688153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e0b49-fd03-4479-9f6f-c77335013c50 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:16.689908 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e0b49-fd03-4479-9f6f-c77335013c50 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:16.702047 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:16.716709 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 108/216] 10.222.0.57 () {60 vars in 1132 bytes} [Sat Jun 4 08:09:16 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:09:16.792809 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aacc96-8613-4eb7-972e-d2020a11485e None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:16.838013 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4915a6c-e163-4a33-bdb1-3a7c19b14390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:16.838918 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4915a6c-e163-4a33-bdb1-3a7c19b14390 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:16.839203 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4915a6c-e163-4a33-bdb1-3a7c19b14390 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:16.839480 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4915a6c-e163-4a33-bdb1-3a7c19b14390 None admin] PATH_INFO: `/v3/users/6d498faaeb4646aa8d25f960a3de284d` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:16.841834 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:16.856245 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4915a6c-e163-4a33-bdb1-3a7c19b14390 None admin] RBAC: Authorizing `identity:get_user(user_id=6d498faaeb4646aa8d25f960a3de284d)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:16.857921 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4915a6c-e163-4a33-bdb1-3a7c19b14390 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:16.860420 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 109/217] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:09:16 2022] GET /identity/v3/users/6d498faaeb4646aa8d25f960a3de284d => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:16.866601 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e0b49-fd03-4479-9f6f-c77335013c50 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:16.992331 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e0b49-fd03-4479-9f6f-c77335013c50 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:17.027856 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f8b0c-7187-4ae4-a4f8-6203e44e6d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:17.028522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f8b0c-7187-4ae4-a4f8-6203e44e6d46 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:17.028810 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f8b0c-7187-4ae4-a4f8-6203e44e6d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:17.029090 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f8b0c-7187-4ae4-a4f8-6203e44e6d46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:17.099731 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:17.106828 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f8b0c-7187-4ae4-a4f8-6203e44e6d46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:17.108311 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f8b0c-7187-4ae4-a4f8-6203e44e6d46 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:17.211787 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781da86-b7ae-4e24-84e7-fab5f9b18e37 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:17.212389 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781da86-b7ae-4e24-84e7-fab5f9b18e37 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:17.212696 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781da86-b7ae-4e24-84e7-fab5f9b18e37 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:17.215008 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 110/218] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:17.219764 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 109/219] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:09:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 08:09:17.220205 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa0224-dcd5-45c4-a39d-b6b7cddabeaf None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:17.220369 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa0224-dcd5-45c4-a39d-b6b7cddabeaf None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:17.220627 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa0224-dcd5-45c4-a39d-b6b7cddabeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:17.226565 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f8b0c-7187-4ae4-a4f8-6203e44e6d46 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:17.238580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-66fa0224-dcd5-45c4-a39d-b6b7cddabeaf None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:17.239882 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-66fa0224-dcd5-45c4-a39d-b6b7cddabeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:17.328544 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 111/220] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 08:09:17.354939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:17.356855 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa0224-dcd5-45c4-a39d-b6b7cddabeaf None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:17.363279 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f8b0c-7187-4ae4-a4f8-6203e44e6d46 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:17.428303 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06369d39-0664-4e2f-a94d-e613dd87a5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:17.429183 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06369d39-0664-4e2f-a94d-e613dd87a5aa None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:17.429465 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06369d39-0664-4e2f-a94d-e613dd87a5aa None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:17.429738 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06369d39-0664-4e2f-a94d-e613dd87a5aa None admin] PATH_INFO: `/v3/projects/626251d4d31a465b966323ca5f3905d9` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:17.431608 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06369d39-0664-4e2f-a94d-e613dd87a5aa None admin] RBAC: Authorizing `identity:get_project(project_id=626251d4d31a465b966323ca5f3905d9)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:17.433344 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06369d39-0664-4e2f-a94d-e613dd87a5aa None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:17.435094 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 110/221] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:17 2022] GET /identity/v3/projects/626251d4d31a465b966323ca5f3905d9 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:17.440852 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06369d39-0664-4e2f-a94d-e613dd87a5aa None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:17.560012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa0224-dcd5-45c4-a39d-b6b7cddabeaf None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:17.607333 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:17.618426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06369d39-0664-4e2f-a94d-e613dd87a5aa None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:17.634081 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b378d5c-5590-4592-970b-6386c3f8d007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:17.634885 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b378d5c-5590-4592-970b-6386c3f8d007 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:17.635166 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b378d5c-5590-4592-970b-6386c3f8d007 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:17.635439 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b378d5c-5590-4592-970b-6386c3f8d007 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:17.656231 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b378d5c-5590-4592-970b-6386c3f8d007 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:17.667862 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-9b378d5c-5590-4592-970b-6386c3f8d007 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:09:17.667862 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:17.667862 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:17.667862 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:17.667862 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:17.667862 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:17.667862 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:17.667862 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:17.667862 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:17.667862 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:17.667862 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:17.667862 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:17.667862 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:17.667862 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:17.667862 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:17.667862 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:17.668787 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:17.668787 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:17.668787 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:17.668787 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:17.668787 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:17.668787 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:17.668787 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:17.668787 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:17.668787 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:17.668787 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:17.668787 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:17.668787 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:17.668787 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:17.668787 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:17.668787 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:17.668787 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:17.669588 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:17.669588 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:17.669588 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:17.669588 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:17.669588 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:17.669588 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:17.669588 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:17.669588 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:17.669588 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:17.669588 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:17.669588 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:09:17.669588 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:17.673758 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 112/222] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:09:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:09:17.682024 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b378d5c-5590-4592-970b-6386c3f8d007 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:17.689923 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4507f6-edd5-4a54-8b57-04d15f184e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:17.691888 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4507f6-edd5-4a54-8b57-04d15f184e6b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:17.692175 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4507f6-edd5-4a54-8b57-04d15f184e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:17.692453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4507f6-edd5-4a54-8b57-04d15f184e6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:17.693303 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4507f6-edd5-4a54-8b57-04d15f184e6b None admin] RBAC: Adding query filter params (role.id=314f0b44fb344a99bdda986e7b4ac3ab, scope.project.id=626251d4d31a465b966323ca5f3905d9, user.id=6d498faaeb4646aa8d25f960a3de284d) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:17.693616 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4507f6-edd5-4a54-8b57-04d15f184e6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:17.695104 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4507f6-edd5-4a54-8b57-04d15f184e6b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:17.710231 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 111/223] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:09:17 2022] GET /identity/v3/role_assignments?user.id=6d498faaeb4646aa8d25f960a3de284d&scope.project.id=626251d4d31a465b966323ca5f3905d9&role.id=314f0b44fb344a99bdda986e7b4ac3ab => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:17.836952 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b378d5c-5590-4592-970b-6386c3f8d007 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:17.855924 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592c098-0ff9-4aa4-af32-0e726626819c None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:17.856227 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592c098-0ff9-4aa4-af32-0e726626819c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:17.856497 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592c098-0ff9-4aa4-af32-0e726626819c None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:17.861941 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 112/224] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:17.867155 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24a2a8-9b6e-4e2b-965d-2b8ed1eae0ff None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:17.867442 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24a2a8-9b6e-4e2b-965d-2b8ed1eae0ff None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:17.867724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24a2a8-9b6e-4e2b-965d-2b8ed1eae0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:17.880493 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad5aec-2496-4261-bda1-92852a0f6477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:17.881574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad5aec-2496-4261-bda1-92852a0f6477 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:17.881876 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad5aec-2496-4261-bda1-92852a0f6477 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:17.882159 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad5aec-2496-4261-bda1-92852a0f6477 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:17.882929 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad5aec-2496-4261-bda1-92852a0f6477 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:17.883240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad5aec-2496-4261-bda1-92852a0f6477 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:17.884694 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad5aec-2496-4261-bda1-92852a0f6477 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:17.895431 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 113/225] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:17.904444 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad5aec-2496-4261-bda1-92852a0f6477 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:17.917297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-9b24a2a8-9b6e-4e2b-965d-2b8ed1eae0ff None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:17.919108 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9b24a2a8-9b6e-4e2b-965d-2b8ed1eae0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:17.970723 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:18.005880 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:18.056113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 113/226] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 08:09:18.085038 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad5aec-2496-4261-bda1-92852a0f6477 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:18.087177 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24a2a8-9b6e-4e2b-965d-2b8ed1eae0ff None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:18.170612 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ee258-8eff-4566-a93c-9147e4901d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:18.171412 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ee258-8eff-4566-a93c-9147e4901d4e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:18.171688 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ee258-8eff-4566-a93c-9147e4901d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:18.171965 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ee258-8eff-4566-a93c-9147e4901d4e None admin] PATH_INFO: `/v3/users/ea4962dcc8704bc2a27dbae552dc5732` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:18.173199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ee258-8eff-4566-a93c-9147e4901d4e None admin] RBAC: Authorizing `identity:get_user(user_id=ea4962dcc8704bc2a27dbae552dc5732)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:18.174683 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ee258-8eff-4566-a93c-9147e4901d4e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:18.176380 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 114/227] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:09:17 2022] GET /identity/v3/users/ea4962dcc8704bc2a27dbae552dc5732 => generated 283 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:18.182600 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ee258-8eff-4566-a93c-9147e4901d4e None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:18.243872 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24a2a8-9b6e-4e2b-965d-2b8ed1eae0ff None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:18.286157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c35ade-0a84-49d6-bcc3-b7c99e93dfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:18.286976 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c35ade-0a84-49d6-bcc3-b7c99e93dfb9 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:18.287252 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c35ade-0a84-49d6-bcc3-b7c99e93dfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:18.287520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c35ade-0a84-49d6-bcc3-b7c99e93dfb9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:18.310934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c35ade-0a84-49d6-bcc3-b7c99e93dfb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:18.321206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-98c35ade-0a84-49d6-bcc3-b7c99e93dfb9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 08:09:18.321206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:18.321206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:18.321206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:18.321206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:18.321206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:18.321206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:18.321206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:18.321206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:18.321206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:18.321206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:18.321206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:18.321206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:18.321206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:18.321206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:18.321206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:18.322227 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:18.322227 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:18.322227 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:18.322227 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:18.322227 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:18.322227 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:18.322227 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:18.322227 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:18.322227 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:18.322227 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:18.322227 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:18.322227 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:18.322227 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:18.322227 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:18.322227 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:18.322227 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:18.323145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:18.323145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:18.323145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:18.323145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:18.323145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:18.323145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:18.323145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:18.323145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:18.323145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:18.323145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:18.323145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 08:09:18.323145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:18.324682 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 114/228] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jun 4 08:09:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:09:18.335214 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c35ade-0a84-49d6-bcc3-b7c99e93dfb9 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:18.356997 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:18.399104 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ee258-8eff-4566-a93c-9147e4901d4e None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:18.432360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:18.468109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c35ade-0a84-49d6-bcc3-b7c99e93dfb9 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:18.475941 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbb296-2b95-4e1d-984a-3dfbae21e2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:18.477008 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbb296-2b95-4e1d-984a-3dfbae21e2e0 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:18.477410 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbb296-2b95-4e1d-984a-3dfbae21e2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:18.477788 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbb296-2b95-4e1d-984a-3dfbae21e2e0 None admin] PATH_INFO: `/v3/projects/626251d4d31a465b966323ca5f3905d9` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:18.482565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbb296-2b95-4e1d-984a-3dfbae21e2e0 None admin] RBAC: Authorizing `identity:get_project(project_id=626251d4d31a465b966323ca5f3905d9)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:18.484424 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbb296-2b95-4e1d-984a-3dfbae21e2e0 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:18.486684 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 115/229] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:18 2022] GET /identity/v3/projects/626251d4d31a465b966323ca5f3905d9 => generated 302 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:18.492753 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbb296-2b95-4e1d-984a-3dfbae21e2e0 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:18.507041 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dd3cc-8923-4dea-b30c-9c6c13ebdb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:18.507984 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dd3cc-8923-4dea-b30c-9c6c13ebdb06 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:18.508434 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dd3cc-8923-4dea-b30c-9c6c13ebdb06 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:18.509495 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dd3cc-8923-4dea-b30c-9c6c13ebdb06 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:18.510443 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21dd3cc-8923-4dea-b30c-9c6c13ebdb06 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:18.510953 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21dd3cc-8923-4dea-b30c-9c6c13ebdb06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:18.512533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21dd3cc-8923-4dea-b30c-9c6c13ebdb06 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:18.528558 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 115/230] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:09:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:18.530158 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dd3cc-8923-4dea-b30c-9c6c13ebdb06 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:18.653500 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbb296-2b95-4e1d-984a-3dfbae21e2e0 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:18.690461 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3dbc7-8d22-42fa-bcd3-c6b20befe8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:18.691577 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3dbc7-8d22-42fa-bcd3-c6b20befe8c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:18.692023 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3dbc7-8d22-42fa-bcd3-c6b20befe8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:18.692445 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3dbc7-8d22-42fa-bcd3-c6b20befe8c7 None admin] PATH_INFO: `/v3/projects/626251d4d31a465b966323ca5f3905d9/users/ea4962dcc8704bc2a27dbae552dc5732/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:18.694682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3dbc7-8d22-42fa-bcd3-c6b20befe8c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=626251d4d31a465b966323ca5f3905d9, user_id=ea4962dcc8704bc2a27dbae552dc5732, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:18.696416 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3dbc7-8d22-42fa-bcd3-c6b20befe8c7 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:18.699490 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:18.715809 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 116/231] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jun 4 08:09:18 2022] PUT /identity/v3/projects/626251d4d31a465b966323ca5f3905d9/users/ea4962dcc8704bc2a27dbae552dc5732/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:09:18.730775 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dd3cc-8923-4dea-b30c-9c6c13ebdb06 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:18.773597 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bfed0-a231-4afa-b9df-1677d4164686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:18.774584 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bfed0-a231-4afa-b9df-1677d4164686 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:18.774868 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bfed0-a231-4afa-b9df-1677d4164686 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:18.775140 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bfed0-a231-4afa-b9df-1677d4164686 None admin] PATH_INFO: `/v3/users/ea4962dcc8704bc2a27dbae552dc5732` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:18.782818 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9bfed0-a231-4afa-b9df-1677d4164686 None admin] RBAC: Authorizing `identity:get_user(user_id=ea4962dcc8704bc2a27dbae552dc5732)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:18.784990 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9bfed0-a231-4afa-b9df-1677d4164686 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:18.787014 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 116/232] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:09:18 2022] GET /identity/v3/users/ea4962dcc8704bc2a27dbae552dc5732 => generated 283 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:18.793063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3dbc7-8d22-42fa-bcd3-c6b20befe8c7 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:18.870334 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:18.956098 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3dbc7-8d22-42fa-bcd3-c6b20befe8c7 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:18.999729 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb65571-6ef6-4b33-8a97-9c8a5f951271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:19.000637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb65571-6ef6-4b33-8a97-9c8a5f951271 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:19.000922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb65571-6ef6-4b33-8a97-9c8a5f951271 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:19.001203 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb65571-6ef6-4b33-8a97-9c8a5f951271 None admin] PATH_INFO: `/v3/projects/626251d4d31a465b966323ca5f3905d9` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:19.002478 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb65571-6ef6-4b33-8a97-9c8a5f951271 None admin] RBAC: Authorizing `identity:get_project(project_id=626251d4d31a465b966323ca5f3905d9)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:19.004523 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb65571-6ef6-4b33-8a97-9c8a5f951271 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:19.006392 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 117/233] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:18 2022] GET /identity/v3/projects/626251d4d31a465b966323ca5f3905d9 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:19.012527 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bfed0-a231-4afa-b9df-1677d4164686 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:19.130796 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bfed0-a231-4afa-b9df-1677d4164686 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:19.175857 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba9fec-e0b7-4ce9-9657-23d5c65533ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:19.176841 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba9fec-e0b7-4ce9-9657-23d5c65533ee None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:19.177128 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba9fec-e0b7-4ce9-9657-23d5c65533ee None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:19.177396 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba9fec-e0b7-4ce9-9657-23d5c65533ee None admin] PATH_INFO: `/v3/projects/626251d4d31a465b966323ca5f3905d9/users/ea4962dcc8704bc2a27dbae552dc5732/roles/b6177706a26446d5b4c540a3e97dee2e` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:19.180078 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba9fec-e0b7-4ce9-9657-23d5c65533ee None admin] RBAC: Authorizing `identity:create_grant(project_id=626251d4d31a465b966323ca5f3905d9, user_id=ea4962dcc8704bc2a27dbae552dc5732, role_id=b6177706a26446d5b4c540a3e97dee2e)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:19.181564 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba9fec-e0b7-4ce9-9657-23d5c65533ee None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:19.209088 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 117/234] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jun 4 08:09:19 2022] PUT /identity/v3/projects/626251d4d31a465b966323ca5f3905d9/users/ea4962dcc8704bc2a27dbae552dc5732/roles/b6177706a26446d5b4c540a3e97dee2e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:09:19.617480 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212a8ea-bbff-40e6-aa98-5fb5a109977e None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:19.618031 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212a8ea-bbff-40e6-aa98-5fb5a109977e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:19.618031 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212a8ea-bbff-40e6-aa98-5fb5a109977e None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:19.619686 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 118/235] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:19.625339 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd78443-dbcb-4b64-aa72-ced12b043e9a None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:19.626011 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd78443-dbcb-4b64-aa72-ced12b043e9a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:19.626011 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd78443-dbcb-4b64-aa72-ced12b043e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:19.646718 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-3cd78443-dbcb-4b64-aa72-ced12b043e9a None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:19.647883 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3cd78443-dbcb-4b64-aa72-ced12b043e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:19.649884 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:19.698867 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715571e-4e8e-421d-82af-c8d2117d0e2d None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:19.699262 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715571e-4e8e-421d-82af-c8d2117d0e2d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:19.699500 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715571e-4e8e-421d-82af-c8d2117d0e2d None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:19.701074 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 119/236] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 08:09:19.706891 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c1df4-4ddc-4f48-a6a1-1689d575f0d1 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:19.707181 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c1df4-4ddc-4f48-a6a1-1689d575f0d1 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:19.707461 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c1df4-4ddc-4f48-a6a1-1689d575f0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:19.724704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-737c1df4-4ddc-4f48-a6a1-1689d575f0d1 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:19.725937 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-737c1df4-4ddc-4f48-a6a1-1689d575f0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:19.733783 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 118/237] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:19.769385 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd78443-dbcb-4b64-aa72-ced12b043e9a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:19.798175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 120/238] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 08:09:19.829127 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c1df4-4ddc-4f48-a6a1-1689d575f0d1 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:19.886554 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:19.965733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd78443-dbcb-4b64-aa72-ced12b043e9a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:20.002771 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c1df4-4ddc-4f48-a6a1-1689d575f0d1 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:20.041811 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f4f58-6d39-4654-9459-5aac1f3020bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:20.043008 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f4f58-6d39-4654-9459-5aac1f3020bd None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:20.043492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f4f58-6d39-4654-9459-5aac1f3020bd None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:20.043964 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f4f58-6d39-4654-9459-5aac1f3020bd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:20.055876 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:20.062736 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f4f58-6d39-4654-9459-5aac1f3020bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:20.070781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-f16f4f58-6d39-4654-9459-5aac1f3020bd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 08:09:20.070781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:20.070781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:20.070781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:20.070781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:20.070781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:20.070781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:20.070781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:20.070781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:20.070781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:20.070781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:20.070781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:20.070781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:20.070781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:20.070781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:20.070781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:20.071671 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:20.071671 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:20.071671 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:20.071671 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:20.071671 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:20.071671 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:20.071671 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:20.071671 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:20.071671 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:20.071671 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:20.071671 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:20.071671 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:20.071671 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:20.071671 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:20.071671 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:20.071671 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:20.072462 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:20.072462 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:20.072462 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:20.072462 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:20.072462 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:20.072462 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:20.072462 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:20.072462 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:20.072462 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:20.072462 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:20.072462 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 08:09:20.072462 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:20.073114 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 119/239] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:09:20.077170 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a47fd-e8e6-48c5-b6e4-92fc81bf4124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:20.078181 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a47fd-e8e6-48c5-b6e4-92fc81bf4124 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:20.078610 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a47fd-e8e6-48c5-b6e4-92fc81bf4124 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:20.079029 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a47fd-e8e6-48c5-b6e4-92fc81bf4124 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:20.080365 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a47fd-e8e6-48c5-b6e4-92fc81bf4124 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:20.082565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a47fd-e8e6-48c5-b6e4-92fc81bf4124 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:20.085252 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f4f58-6d39-4654-9459-5aac1f3020bd None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:20.086021 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 121/240] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:09:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:20.091721 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a47fd-e8e6-48c5-b6e4-92fc81bf4124 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:20.249231 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f4f58-6d39-4654-9459-5aac1f3020bd None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:20.289798 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4134174-908a-4cc7-978d-6b04736d8924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:20.290524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4134174-908a-4cc7-978d-6b04736d8924 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:20.290808 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4134174-908a-4cc7-978d-6b04736d8924 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:20.291084 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4134174-908a-4cc7-978d-6b04736d8924 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:20.291853 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4134174-908a-4cc7-978d-6b04736d8924 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:20.292153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4134174-908a-4cc7-978d-6b04736d8924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:20.293619 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4134174-908a-4cc7-978d-6b04736d8924 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:20.311727 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 120/241] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jun 4 08:09:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:20.318426 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a47fd-e8e6-48c5-b6e4-92fc81bf4124 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:20.321136 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4134174-908a-4cc7-978d-6b04736d8924 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:20.330240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:20.395850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902be88a-a4dc-4433-a43c-e8ef83ee43c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:20.396528 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902be88a-a4dc-4433-a43c-e8ef83ee43c0 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:20.396804 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902be88a-a4dc-4433-a43c-e8ef83ee43c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:20.397073 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902be88a-a4dc-4433-a43c-e8ef83ee43c0 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:20.397789 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902be88a-a4dc-4433-a43c-e8ef83ee43c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:20.399259 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902be88a-a4dc-4433-a43c-e8ef83ee43c0 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:20.432512 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 122/242] 10.222.0.57 () {60 vars in 1132 bytes} [Sat Jun 4 08:09:20 2022] POST /identity/v3/users => generated 293 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:09:20.435410 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:20.494269 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4134174-908a-4cc7-978d-6b04736d8924 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:20.541595 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d917e54-3f9c-4519-babc-ff598df1148c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:20.542428 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d917e54-3f9c-4519-babc-ff598df1148c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:20.542714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d917e54-3f9c-4519-babc-ff598df1148c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:20.542989 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d917e54-3f9c-4519-babc-ff598df1148c None admin] PATH_INFO: `/v3/users/079fd518cd814e74be40405a251d2602` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:20.560559 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d917e54-3f9c-4519-babc-ff598df1148c None admin] RBAC: Authorizing `identity:get_user(user_id=079fd518cd814e74be40405a251d2602)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:20.562154 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d917e54-3f9c-4519-babc-ff598df1148c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:20.564043 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 121/243] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:09:20 2022] GET /identity/v3/users/079fd518cd814e74be40405a251d2602 => generated 297 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:20.570253 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902be88a-a4dc-4433-a43c-e8ef83ee43c0 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:20.703271 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56911c40-8549-4efd-ae0f-408eddeba068 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:20.703785 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56911c40-8549-4efd-ae0f-408eddeba068 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:20.703876 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56911c40-8549-4efd-ae0f-408eddeba068 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:20.705190 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 122/244] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:20.710874 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec880635-bba3-46f9-ac25-86ba62b7edd3 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:20.711165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec880635-bba3-46f9-ac25-86ba62b7edd3 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:20.711445 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec880635-bba3-46f9-ac25-86ba62b7edd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:20.715435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902be88a-a4dc-4433-a43c-e8ef83ee43c0 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:20.732441 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-ec880635-bba3-46f9-ac25-86ba62b7edd3 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:20.733651 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ec880635-bba3-46f9-ac25-86ba62b7edd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:20.755934 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3e376-8a60-4fcb-b5fe-ae6ecb8fa783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:20.756861 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3e376-8a60-4fcb-b5fe-ae6ecb8fa783 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:20.757427 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3e376-8a60-4fcb-b5fe-ae6ecb8fa783 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:20.757706 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3e376-8a60-4fcb-b5fe-ae6ecb8fa783 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:20.790248 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:20.811698 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 123/245] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 08:09:20.836197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3e376-8a60-4fcb-b5fe-ae6ecb8fa783 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:20.837496 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec880635-bba3-46f9-ac25-86ba62b7edd3 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:20.837701 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3e376-8a60-4fcb-b5fe-ae6ecb8fa783 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:20.893539 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:20.957932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec880635-bba3-46f9-ac25-86ba62b7edd3 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:20.963940 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 123/246] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:09:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 08:09:20.969544 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3e376-8a60-4fcb-b5fe-ae6ecb8fa783 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:21.009351 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e2117-78a4-47c2-98d1-e2761e308017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:21.010392 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e2117-78a4-47c2-98d1-e2761e308017 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:21.010772 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e2117-78a4-47c2-98d1-e2761e308017 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:21.011142 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e2117-78a4-47c2-98d1-e2761e308017 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:21.031529 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e2117-78a4-47c2-98d1-e2761e308017 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:21.039519 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-625e2117-78a4-47c2-98d1-e2761e308017 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:09:21.039519 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:21.039519 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:21.039519 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:21.039519 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:21.039519 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:21.039519 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:21.039519 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:21.039519 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:21.039519 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:21.039519 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:21.039519 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:21.039519 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:21.039519 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:21.039519 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:21.039519 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:21.040440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:21.040440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:21.040440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:21.040440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:21.040440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:21.040440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:21.040440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:21.040440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:21.040440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:21.040440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:21.040440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:21.040440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:21.040440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:21.040440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:21.040440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:21.040440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:21.041260 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:21.041260 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:21.041260 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:21.041260 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:21.041260 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:21.041260 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:21.041260 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:21.041260 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:21.041260 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:21.041260 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:21.041260 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:09:21.041260 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:21.041260 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 124/247] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:21.051192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e2117-78a4-47c2-98d1-e2761e308017 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:21.064636 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:21.116848 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3e376-8a60-4fcb-b5fe-ae6ecb8fa783 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:21.155371 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc253e-96b1-440a-ab9a-45cdd9d483fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:21.156237 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc253e-96b1-440a-ab9a-45cdd9d483fe None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:21.156518 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc253e-96b1-440a-ab9a-45cdd9d483fe None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:21.156794 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc253e-96b1-440a-ab9a-45cdd9d483fe None admin] PATH_INFO: `/v3/projects/626251d4d31a465b966323ca5f3905d9` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:21.158147 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc253e-96b1-440a-ab9a-45cdd9d483fe None admin] RBAC: Authorizing `identity:get_project(project_id=626251d4d31a465b966323ca5f3905d9)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:21.159785 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc253e-96b1-440a-ab9a-45cdd9d483fe None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:21.161841 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 124/248] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:20 2022] GET /identity/v3/projects/626251d4d31a465b966323ca5f3905d9 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:21.167427 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc253e-96b1-440a-ab9a-45cdd9d483fe None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:21.169571 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e2117-78a4-47c2-98d1-e2761e308017 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:21.179905 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:21.209134 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb541a-5eb9-4948-bacc-a2a165b94ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:21.211035 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb541a-5eb9-4948-bacc-a2a165b94ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:21.211527 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb541a-5eb9-4948-bacc-a2a165b94ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:21.212043 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb541a-5eb9-4948-bacc-a2a165b94ce1 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:21.213100 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb541a-5eb9-4948-bacc-a2a165b94ce1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:21.213634 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb541a-5eb9-4948-bacc-a2a165b94ce1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:21.215377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb541a-5eb9-4948-bacc-a2a165b94ce1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:21.225129 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 125/249] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jun 4 08:09:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:21.230990 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb541a-5eb9-4948-bacc-a2a165b94ce1 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:21.276241 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc253e-96b1-440a-ab9a-45cdd9d483fe None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:21.313078 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:21.319989 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf1c90-dbbc-45fa-9d2e-0c5acbc7935e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:21.320563 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf1c90-dbbc-45fa-9d2e-0c5acbc7935e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:21.320850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf1c90-dbbc-45fa-9d2e-0c5acbc7935e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:21.321130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf1c90-dbbc-45fa-9d2e-0c5acbc7935e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:21.322167 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf1c90-dbbc-45fa-9d2e-0c5acbc7935e None admin] RBAC: Adding query filter params (role.id=c005105deb5849b9a6e5122b2efa9633, scope.project.id=626251d4d31a465b966323ca5f3905d9, user.id=079fd518cd814e74be40405a251d2602) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:21.322490 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf1c90-dbbc-45fa-9d2e-0c5acbc7935e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:21.324062 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf1c90-dbbc-45fa-9d2e-0c5acbc7935e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:21.331620 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 125/250] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:09:21 2022] GET /identity/v3/role_assignments?user.id=079fd518cd814e74be40405a251d2602&scope.project.id=626251d4d31a465b966323ca5f3905d9&role.id=c005105deb5849b9a6e5122b2efa9633 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:21.386216 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb541a-5eb9-4948-bacc-a2a165b94ce1 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:21.425267 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd2b9b-0711-44d5-afe7-a0d30a5cfbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:21.426591 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd2b9b-0711-44d5-afe7-a0d30a5cfbce None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:21.427128 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd2b9b-0711-44d5-afe7-a0d30a5cfbce None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:21.427881 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd2b9b-0711-44d5-afe7-a0d30a5cfbce None admin] PATH_INFO: `/v3/users/6d498faaeb4646aa8d25f960a3de284d` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:21.429430 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd2b9b-0711-44d5-afe7-a0d30a5cfbce None admin] RBAC: Authorizing `identity:get_user(user_id=6d498faaeb4646aa8d25f960a3de284d)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:21.431189 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd2b9b-0711-44d5-afe7-a0d30a5cfbce None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:21.433155 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 126/251] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:09:21 2022] GET /identity/v3/users/6d498faaeb4646aa8d25f960a3de284d => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:21.438893 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf1c90-dbbc-45fa-9d2e-0c5acbc7935e None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:21.587178 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf1c90-dbbc-45fa-9d2e-0c5acbc7935e None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:21.624538 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636acfb-08f7-4609-8210-cda6e115d375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:21.625410 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636acfb-08f7-4609-8210-cda6e115d375 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:21.625697 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636acfb-08f7-4609-8210-cda6e115d375 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:21.626008 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636acfb-08f7-4609-8210-cda6e115d375 None admin] PATH_INFO: `/v3/projects/626251d4d31a465b966323ca5f3905d9` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:21.627214 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636acfb-08f7-4609-8210-cda6e115d375 None admin] RBAC: Authorizing `identity:get_project(project_id=626251d4d31a465b966323ca5f3905d9)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:21.629242 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636acfb-08f7-4609-8210-cda6e115d375 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:21.630996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 126/252] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:21 2022] GET /identity/v3/projects/626251d4d31a465b966323ca5f3905d9 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:21.636783 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd2b9b-0711-44d5-afe7-a0d30a5cfbce None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:21.687752 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:21.735156 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9d89b-2e98-4ebc-b647-f52e22b976fe None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:21.735664 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9d89b-2e98-4ebc-b647-f52e22b976fe None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:21.735739 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9d89b-2e98-4ebc-b647-f52e22b976fe None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:21.737283 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 127/253] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:21.745434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279b471-6c03-4355-92f9-0e10557914e6 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:21.745434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279b471-6c03-4355-92f9-0e10557914e6 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:21.745434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279b471-6c03-4355-92f9-0e10557914e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:21.771382 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-4279b471-6c03-4355-92f9-0e10557914e6 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:21.773443 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4279b471-6c03-4355-92f9-0e10557914e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:21.775413 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd2b9b-0711-44d5-afe7-a0d30a5cfbce None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:21.838333 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8222340-0604-4f33-92d0-b996c204e986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:21.839316 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8222340-0604-4f33-92d0-b996c204e986 None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:21.841855 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8222340-0604-4f33-92d0-b996c204e986 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:21.841855 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8222340-0604-4f33-92d0-b996c204e986 None admin] PATH_INFO: `/v3/projects/626251d4d31a465b966323ca5f3905d9/users/6d498faaeb4646aa8d25f960a3de284d/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:21.846439 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8222340-0604-4f33-92d0-b996c204e986 None admin] RBAC: Authorizing `identity:create_grant(project_id=626251d4d31a465b966323ca5f3905d9, user_id=6d498faaeb4646aa8d25f960a3de284d, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:21.849516 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8222340-0604-4f33-92d0-b996c204e986 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:21.877651 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 127/254] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jun 4 08:09:21 2022] PUT /identity/v3/projects/626251d4d31a465b966323ca5f3905d9/users/6d498faaeb4646aa8d25f960a3de284d/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:09:21.892587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:21.917180 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 128/255] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:21.958885 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8222340-0604-4f33-92d0-b996c204e986 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:22.080317 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8222340-0604-4f33-92d0-b996c204e986 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:22.088273 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:22.119368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a34c8-bc9c-4948-8ccc-4b4224e038e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:22.120097 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a34c8-bc9c-4948-8ccc-4b4224e038e7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:22.120438 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a34c8-bc9c-4948-8ccc-4b4224e038e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:22.120722 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a34c8-bc9c-4948-8ccc-4b4224e038e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:22.131629 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a34c8-bc9c-4948-8ccc-4b4224e038e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:22.139792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-055a34c8-bc9c-4948-8ccc-4b4224e038e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:09:22.139792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:22.139792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:22.139792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:22.139792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:22.139792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:22.139792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:22.139792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:22.139792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:22.139792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:22.139792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:22.139792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:22.139792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:22.139792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:22.139792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:22.139792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:22.140733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:22.140733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:22.140733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:22.140733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:22.140733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:22.140733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:22.140733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:22.140733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:22.140733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:22.140733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:22.140733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:22.140733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:22.140733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:22.140733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:22.140733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:22.140733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:22.141539 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:22.141539 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:22.141539 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:22.141539 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:22.141539 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:22.141539 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:22.141539 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:22.141539 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:22.141539 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:22.141539 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:22.141539 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:09:22.141539 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:22.141539 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 128/256] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:09:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:22.150985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279b471-6c03-4355-92f9-0e10557914e6 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:22.303354 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279b471-6c03-4355-92f9-0e10557914e6 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:22.355496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db082c87-f7e9-4eb2-be33-8882a9657e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:22.356190 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db082c87-f7e9-4eb2-be33-8882a9657e6c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:22.356473 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db082c87-f7e9-4eb2-be33-8882a9657e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:22.356751 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db082c87-f7e9-4eb2-be33-8882a9657e6c None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:22.357513 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db082c87-f7e9-4eb2-be33-8882a9657e6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:22.357862 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db082c87-f7e9-4eb2-be33-8882a9657e6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:22.359259 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db082c87-f7e9-4eb2-be33-8882a9657e6c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:22.374884 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 129/257] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:22.380767 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a34c8-bc9c-4948-8ccc-4b4224e038e7 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:22.513850 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a34c8-bc9c-4948-8ccc-4b4224e038e7 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:22.561408 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ac019-d9ad-4ae0-824b-fa8833765dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:22.562337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ac019-d9ad-4ae0-824b-fa8833765dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:22.562626 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ac019-d9ad-4ae0-824b-fa8833765dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:22.562907 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ac019-d9ad-4ae0-824b-fa8833765dc4 None admin] PATH_INFO: `/v3/users/ea4962dcc8704bc2a27dbae552dc5732` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:22.564129 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ac019-d9ad-4ae0-824b-fa8833765dc4 None admin] RBAC: Authorizing `identity:get_user(user_id=ea4962dcc8704bc2a27dbae552dc5732)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:22.565627 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ac019-d9ad-4ae0-824b-fa8833765dc4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:22.567321 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 129/258] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:09:22 2022] GET /identity/v3/users/ea4962dcc8704bc2a27dbae552dc5732 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:22.572850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db082c87-f7e9-4eb2-be33-8882a9657e6c None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:22.622501 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146ee67-4dc3-4723-85ec-5d150126c456 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:22.623048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146ee67-4dc3-4723-85ec-5d150126c456 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:22.623500 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146ee67-4dc3-4723-85ec-5d150126c456 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:22.625065 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 130/259] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:22.631129 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5524f6-8960-48b6-bbab-86f5ea80068f None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:22.631577 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5524f6-8960-48b6-bbab-86f5ea80068f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:22.632002 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5524f6-8960-48b6-bbab-86f5ea80068f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:22.650247 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6c5524f6-8960-48b6-bbab-86f5ea80068f None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:22.654834 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6c5524f6-8960-48b6-bbab-86f5ea80068f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:22.656535 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:22.687406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:22.742384 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 131/260] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 08:09:22.763932 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db082c87-f7e9-4eb2-be33-8882a9657e6c None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:22.777610 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5524f6-8960-48b6-bbab-86f5ea80068f None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:22.831658 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0d4a3-06b6-4e12-8c6f-709cba710417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:22.832320 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0d4a3-06b6-4e12-8c6f-709cba710417 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:22.832605 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0d4a3-06b6-4e12-8c6f-709cba710417 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:22.832869 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0d4a3-06b6-4e12-8c6f-709cba710417 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:22.980746 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5524f6-8960-48b6-bbab-86f5ea80068f None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:22.986504 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0d4a3-06b6-4e12-8c6f-709cba710417 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:22.989601 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0d4a3-06b6-4e12-8c6f-709cba710417 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:23.086746 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de097e2c-ffe6-40af-8b80-e4a2295f535f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:23.087570 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de097e2c-ffe6-40af-8b80-e4a2295f535f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:23.087857 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de097e2c-ffe6-40af-8b80-e4a2295f535f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:23.088136 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de097e2c-ffe6-40af-8b80-e4a2295f535f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:23.116907 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:23.117434 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de097e2c-ffe6-40af-8b80-e4a2295f535f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:23.125655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-de097e2c-ffe6-40af-8b80-e4a2295f535f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 08:09:23.125655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:23.125655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:23.125655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:23.125655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:23.125655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:23.125655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:23.125655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:23.125655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:23.125655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:23.125655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:23.125655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:23.125655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:23.125655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:23.125655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:23.125655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:23.126614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:23.126614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:23.126614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:23.126614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:23.126614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:23.126614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:23.126614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:23.126614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:23.126614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:23.126614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:23.126614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:23.126614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:23.126614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:23.126614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:23.126614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:23.126614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:23.127493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:23.127493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:23.127493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:23.127493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:23.127493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:23.127493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:23.127493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:23.127493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:23.127493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:23.127493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:23.127493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 08:09:23.127493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:23.131782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 132/261] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jun 4 08:09:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:09:23.137618 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de097e2c-ffe6-40af-8b80-e4a2295f535f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:23.167034 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:23.233754 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 130/262] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:09:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 08:09:23.241364 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0d4a3-06b6-4e12-8c6f-709cba710417 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:23.295344 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de097e2c-ffe6-40af-8b80-e4a2295f535f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:23.370543 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077eaa0c-8600-4c52-8f9b-9ecee8bd172e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:23.371652 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077eaa0c-8600-4c52-8f9b-9ecee8bd172e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:23.371942 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077eaa0c-8600-4c52-8f9b-9ecee8bd172e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:23.372222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077eaa0c-8600-4c52-8f9b-9ecee8bd172e None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:23.372986 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077eaa0c-8600-4c52-8f9b-9ecee8bd172e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:23.373298 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077eaa0c-8600-4c52-8f9b-9ecee8bd172e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:23.374741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077eaa0c-8600-4c52-8f9b-9ecee8bd172e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:23.390819 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 133/263] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:09:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:23.397171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077eaa0c-8600-4c52-8f9b-9ecee8bd172e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:23.480265 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:23.483230 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0d4a3-06b6-4e12-8c6f-709cba710417 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:23.501307 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077eaa0c-8600-4c52-8f9b-9ecee8bd172e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:23.535547 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda56e7-c9a6-4e9b-97f2-9f3d32831509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:23.540999 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e0a43-775c-4daf-aa05-0bdb34a8f9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:23.541874 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e0a43-775c-4daf-aa05-0bdb34a8f9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:23.542157 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e0a43-775c-4daf-aa05-0bdb34a8f9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:23.542429 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e0a43-775c-4daf-aa05-0bdb34a8f9c0 None admin] PATH_INFO: `/v3/projects/626251d4d31a465b966323ca5f3905d9` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:23.543616 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e0a43-775c-4daf-aa05-0bdb34a8f9c0 None admin] RBAC: Authorizing `identity:get_project(project_id=626251d4d31a465b966323ca5f3905d9)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:23.545135 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e0a43-775c-4daf-aa05-0bdb34a8f9c0 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:23.546920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 131/264] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:23 2022] GET /identity/v3/projects/626251d4d31a465b966323ca5f3905d9 => generated 302 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:23.547205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda56e7-c9a6-4e9b-97f2-9f3d32831509 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:23.547538 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda56e7-c9a6-4e9b-97f2-9f3d32831509 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:23.547825 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda56e7-c9a6-4e9b-97f2-9f3d32831509 None admin] PATH_INFO: `/v3/users/ea4962dcc8704bc2a27dbae552dc5732` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:23.553412 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e0a43-775c-4daf-aa05-0bdb34a8f9c0 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:23.554550 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda56e7-c9a6-4e9b-97f2-9f3d32831509 None admin] RBAC: Authorizing `identity:get_user(user_id=ea4962dcc8704bc2a27dbae552dc5732)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:23.556016 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda56e7-c9a6-4e9b-97f2-9f3d32831509 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:23.557800 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 134/265] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:09:23 2022] GET /identity/v3/users/ea4962dcc8704bc2a27dbae552dc5732 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:23.567870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda56e7-c9a6-4e9b-97f2-9f3d32831509 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:23.596339 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:23.716918 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda56e7-c9a6-4e9b-97f2-9f3d32831509 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:23.755827 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e0a43-775c-4daf-aa05-0bdb34a8f9c0 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:23.781859 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddee3d-9743-4fba-9ca5-e9a8870dbd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:23.782527 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddee3d-9743-4fba-9ca5-e9a8870dbd0b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:23.782803 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddee3d-9743-4fba-9ca5-e9a8870dbd0b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:23.783077 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddee3d-9743-4fba-9ca5-e9a8870dbd0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:23.811016 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:23.811365 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fc98c-543a-4ef2-8d86-b8ab6446454c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:23.812040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fc98c-543a-4ef2-8d86-b8ab6446454c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:23.812319 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fc98c-543a-4ef2-8d86-b8ab6446454c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:23.812970 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fc98c-543a-4ef2-8d86-b8ab6446454c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:23.813977 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54fc98c-543a-4ef2-8d86-b8ab6446454c None admin] RBAC: Adding query filter params (role.id=431cef539cfb476aad50d2470e763b5f, scope.project.id=626251d4d31a465b966323ca5f3905d9, user.id=ea4962dcc8704bc2a27dbae552dc5732) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:23.814304 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54fc98c-543a-4ef2-8d86-b8ab6446454c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:23.816731 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54fc98c-543a-4ef2-8d86-b8ab6446454c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:23.824561 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 132/266] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:09:23 2022] GET /identity/v3/role_assignments?user.id=ea4962dcc8704bc2a27dbae552dc5732&scope.project.id=626251d4d31a465b966323ca5f3905d9&role.id=431cef539cfb476aad50d2470e763b5f => generated 608 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:23.913940 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ddee3d-9743-4fba-9ca5-e9a8870dbd0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:23.915791 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ddee3d-9743-4fba-9ca5-e9a8870dbd0b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:24.054066 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 135/267] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:09:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 08:09:24.059664 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fc98c-543a-4ef2-8d86-b8ab6446454c None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:24.167045 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:24.182973 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc5cf4-8673-4989-9ff1-576e7e89d745 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:24.183291 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc5cf4-8673-4989-9ff1-576e7e89d745 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:24.183522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc5cf4-8673-4989-9ff1-576e7e89d745 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:24.185365 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 136/268] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:24.186805 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fc98c-543a-4ef2-8d86-b8ab6446454c None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:24.199058 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cee859-1fa0-4a4a-aab8-5e210b92771e None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:24.199682 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cee859-1fa0-4a4a-aab8-5e210b92771e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:24.200154 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cee859-1fa0-4a4a-aab8-5e210b92771e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:24.222403 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-16cee859-1fa0-4a4a-aab8-5e210b92771e None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:24.223918 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-16cee859-1fa0-4a4a-aab8-5e210b92771e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:24.248919 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c719c0-950c-42d7-8dad-0dde04ed4b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:24.249796 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c719c0-950c-42d7-8dad-0dde04ed4b80 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:24.250272 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c719c0-950c-42d7-8dad-0dde04ed4b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:24.250557 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c719c0-950c-42d7-8dad-0dde04ed4b80 None admin] PATH_INFO: `/v3/projects/626251d4d31a465b966323ca5f3905d9` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:24.254614 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c719c0-950c-42d7-8dad-0dde04ed4b80 None admin] RBAC: Authorizing `identity:get_project(project_id=626251d4d31a465b966323ca5f3905d9)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:24.256098 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c719c0-950c-42d7-8dad-0dde04ed4b80 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:24.257870 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 133/269] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:24 2022] GET /identity/v3/projects/626251d4d31a465b966323ca5f3905d9 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:24.266856 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c719c0-950c-42d7-8dad-0dde04ed4b80 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:24.302214 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:24.305144 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 137/270] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:24.353704 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cee859-1fa0-4a4a-aab8-5e210b92771e None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:24.441462 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c719c0-950c-42d7-8dad-0dde04ed4b80 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:24.475643 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cee859-1fa0-4a4a-aab8-5e210b92771e None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:24.493508 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd968fca-bc87-426a-835e-b595c3b55c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:24.494456 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd968fca-bc87-426a-835e-b595c3b55c05 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:24.494953 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd968fca-bc87-426a-835e-b595c3b55c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:24.495409 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd968fca-bc87-426a-835e-b595c3b55c05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:24.496543 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd968fca-bc87-426a-835e-b595c3b55c05 None admin] RBAC: Adding query filter params (role.id=b6177706a26446d5b4c540a3e97dee2e, scope.project.id=626251d4d31a465b966323ca5f3905d9, user.id=ea4962dcc8704bc2a27dbae552dc5732) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:24.497075 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd968fca-bc87-426a-835e-b595c3b55c05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:24.498752 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd968fca-bc87-426a-835e-b595c3b55c05 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:24.505410 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 134/271] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:09:24 2022] GET /identity/v3/role_assignments?user.id=ea4962dcc8704bc2a27dbae552dc5732&scope.project.id=626251d4d31a465b966323ca5f3905d9&role.id=b6177706a26446d5b4c540a3e97dee2e => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:24.506969 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145ff2f-88dd-4612-9d8a-2a5952b369e6 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:24.507459 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145ff2f-88dd-4612-9d8a-2a5952b369e6 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:24.507931 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145ff2f-88dd-4612-9d8a-2a5952b369e6 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:24.509384 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 135/272] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:24.516352 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd2956-ecab-4c6d-8562-e46348c7619b None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:24.516935 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd2956-ecab-4c6d-8562-e46348c7619b None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:24.517411 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd2956-ecab-4c6d-8562-e46348c7619b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:24.535567 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6b095-d398-42e7-ad91-d9ae85d7b433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:24.536408 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6b095-d398-42e7-ad91-d9ae85d7b433 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:24.536874 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6b095-d398-42e7-ad91-d9ae85d7b433 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:24.537288 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6b095-d398-42e7-ad91-d9ae85d7b433 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:24.537662 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-7dcd2956-ecab-4c6d-8562-e46348c7619b None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:24.539256 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-7dcd2956-ecab-4c6d-8562-e46348c7619b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:24.541417 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6b095-d398-42e7-ad91-d9ae85d7b433 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:24.543205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6b095-d398-42e7-ad91-d9ae85d7b433 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:24.544963 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 138/273] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:09:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:24.550928 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6b095-d398-42e7-ad91-d9ae85d7b433 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:24.560881 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:24.648794 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:24.684646 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 136/274] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:24.711236 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd2956-ecab-4c6d-8562-e46348c7619b None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:24.741737 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6b095-d398-42e7-ad91-d9ae85d7b433 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:24.782574 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6d88e-b174-4f70-9eba-89d274db69bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:24.783923 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6d88e-b174-4f70-9eba-89d274db69bf None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:24.784766 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6d88e-b174-4f70-9eba-89d274db69bf None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:24.785044 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6d88e-b174-4f70-9eba-89d274db69bf None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:24.785768 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6d88e-b174-4f70-9eba-89d274db69bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:24.787248 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6d88e-b174-4f70-9eba-89d274db69bf None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:24.815081 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 139/275] 10.222.0.57 () {60 vars in 1132 bytes} [Sat Jun 4 08:09:24 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:09:24.875882 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd2956-ecab-4c6d-8562-e46348c7619b None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:24.918280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c6ca5-782a-478d-9562-e008d4602e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:24.919682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c6ca5-782a-478d-9562-e008d4602e07 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:24.919682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c6ca5-782a-478d-9562-e008d4602e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:24.925879 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c6ca5-782a-478d-9562-e008d4602e07 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:24.933732 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c6ca5-782a-478d-9562-e008d4602e07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:24.942110 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-760c6ca5-782a-478d-9562-e008d4602e07 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:09:24.942110 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:24.942110 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:24.942110 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:24.942110 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:24.942110 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:24.942110 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:24.942110 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:24.942110 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:24.942110 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:24.942110 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:24.942110 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:24.942110 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:24.942110 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:24.942110 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:24.942110 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:24.943051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:24.943051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:24.943051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:24.943051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:24.943051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:24.943051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:24.943051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:24.943051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:24.943051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:24.943051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:24.943051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:24.943051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:24.943051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:24.943051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:24.943051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:24.943051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:24.943848 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:24.943848 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:24.943848 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:24.943848 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:24.943848 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:24.943848 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:24.943848 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:24.943848 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:24.943848 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:24.943848 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:24.943848 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:09:24.943848 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:24.943848 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 137/276] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:24.950998 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6d88e-b174-4f70-9eba-89d274db69bf None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:24.959469 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861eac37-6be2-46ab-b4f4-c73b62d4bdef None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:24.959790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861eac37-6be2-46ab-b4f4-c73b62d4bdef None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:24.960023 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861eac37-6be2-46ab-b4f4-c73b62d4bdef None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:24.961790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 138/277] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:24.967593 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2b30b-35ac-44cc-ae2e-759518effc1d None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:24.967874 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2b30b-35ac-44cc-ae2e-759518effc1d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:24.968151 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2b30b-35ac-44cc-ae2e-759518effc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:24.987990 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-a8c2b30b-35ac-44cc-ae2e-759518effc1d None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:24.989217 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a8c2b30b-35ac-44cc-ae2e-759518effc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:24.991674 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:25.070903 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 139/278] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 08:09:25.088538 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:25.094033 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2b30b-35ac-44cc-ae2e-759518effc1d None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:25.094911 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6d88e-b174-4f70-9eba-89d274db69bf None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:25.143593 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e195a4-54ce-4eed-91b5-a09f3ce0c1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:25.146390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e195a4-54ce-4eed-91b5-a09f3ce0c1e3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:25.146390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e195a4-54ce-4eed-91b5-a09f3ce0c1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:25.146390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e195a4-54ce-4eed-91b5-a09f3ce0c1e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:25.146390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e195a4-54ce-4eed-91b5-a09f3ce0c1e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:25.146390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e195a4-54ce-4eed-91b5-a09f3ce0c1e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:25.148445 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e195a4-54ce-4eed-91b5-a09f3ce0c1e3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:25.164472 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 140/279] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jun 4 08:09:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:25.166182 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e195a4-54ce-4eed-91b5-a09f3ce0c1e3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:25.219287 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2b30b-35ac-44cc-ae2e-759518effc1d None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:25.263755 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c99f62-c60a-43e7-8d19-4a666fcbfb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:25.264551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c99f62-c60a-43e7-8d19-4a666fcbfb7d None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:25.264830 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c99f62-c60a-43e7-8d19-4a666fcbfb7d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:25.265102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c99f62-c60a-43e7-8d19-4a666fcbfb7d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:25.275022 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:25.281217 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c99f62-c60a-43e7-8d19-4a666fcbfb7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:25.286822 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e195a4-54ce-4eed-91b5-a09f3ce0c1e3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:25.290465 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-41c99f62-c60a-43e7-8d19-4a666fcbfb7d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 08:09:25.290465 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:25.290465 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:25.290465 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:25.290465 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:25.290465 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:25.290465 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:25.290465 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:25.290465 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:25.290465 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:25.290465 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:25.290465 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:25.290465 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:25.290465 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:25.290465 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:25.290465 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:25.291358 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:25.291358 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:25.291358 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:25.291358 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:25.291358 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:25.291358 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:25.291358 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:25.291358 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:25.291358 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:25.291358 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:25.291358 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:25.291358 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:25.291358 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:25.291358 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:25.291358 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:25.291358 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:25.292193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:25.292193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:25.292193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:25.292193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:25.292193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:25.292193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:25.292193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:25.292193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:25.292193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:25.292193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:25.292193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 08:09:25.292193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:25.294960 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 140/280] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:25.300574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c99f62-c60a-43e7-8d19-4a666fcbfb7d None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:25.326116 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9531807-9f23-4750-a584-a7ba0e8ef3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:25.326935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9531807-9f23-4750-a584-a7ba0e8ef3d6 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:25.327218 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9531807-9f23-4750-a584-a7ba0e8ef3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:25.327492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9531807-9f23-4750-a584-a7ba0e8ef3d6 None admin] PATH_INFO: `/v3/users/0c912684b9054bc78e4eb47e6b527186` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:25.343498 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9531807-9f23-4750-a584-a7ba0e8ef3d6 None admin] RBAC: Authorizing `identity:get_user(user_id=0c912684b9054bc78e4eb47e6b527186)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:25.345685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9531807-9f23-4750-a584-a7ba0e8ef3d6 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:25.347569 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 141/281] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:09:25 2022] GET /identity/v3/users/0c912684b9054bc78e4eb47e6b527186 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:25.353895 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9531807-9f23-4750-a584-a7ba0e8ef3d6 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:25.381894 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:25.424636 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c99f62-c60a-43e7-8d19-4a666fcbfb7d None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:25.463874 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b03b79-6307-4ed4-86e7-884acefae245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:25.465579 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b03b79-6307-4ed4-86e7-884acefae245 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:25.466126 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b03b79-6307-4ed4-86e7-884acefae245 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:25.466851 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b03b79-6307-4ed4-86e7-884acefae245 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:25.468450 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b03b79-6307-4ed4-86e7-884acefae245 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:25.468968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b03b79-6307-4ed4-86e7-884acefae245 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:25.470225 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9531807-9f23-4750-a584-a7ba0e8ef3d6 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:25.470740 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b03b79-6307-4ed4-86e7-884acefae245 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:25.482159 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 141/282] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jun 4 08:09:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:25.484301 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ca44f-4c50-47aa-9424-26668aeb4e6c None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:25.484796 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ca44f-4c50-47aa-9424-26668aeb4e6c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:25.485270 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ca44f-4c50-47aa-9424-26668aeb4e6c None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:25.486804 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 142/283] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:25.488612 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ca44f-4c50-47aa-9424-26668aeb4e6c None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:25.512534 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ba2fb-393f-4e42-b9a8-4fd9168afd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:25.513637 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ba2fb-393f-4e42-b9a8-4fd9168afd97 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:25.514134 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ba2fb-393f-4e42-b9a8-4fd9168afd97 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:25.514620 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ba2fb-393f-4e42-b9a8-4fd9168afd97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:25.515654 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ba2fb-393f-4e42-b9a8-4fd9168afd97 None admin] RBAC: Adding query filter params (role.id=314f0b44fb344a99bdda986e7b4ac3ab, user.id=0c912684b9054bc78e4eb47e6b527186, scope.system=all) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:25.516286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ba2fb-393f-4e42-b9a8-4fd9168afd97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:25.518049 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ba2fb-393f-4e42-b9a8-4fd9168afd97 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:25.530045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 142/284] 10.222.0.57 () {56 vars in 1308 bytes} [Sat Jun 4 08:09:25 2022] GET /identity/v3/role_assignments?user.id=0c912684b9054bc78e4eb47e6b527186&scope.system=all&role.id=314f0b44fb344a99bdda986e7b4ac3ab => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:25.531939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac445880-6c20-458c-ab71-75285c9e677c None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:25.532446 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac445880-6c20-458c-ab71-75285c9e677c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:25.532913 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac445880-6c20-458c-ab71-75285c9e677c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:25.562735 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:25.564142 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-ac445880-6c20-458c-ab71-75285c9e677c None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:25.565801 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ac445880-6c20-458c-ab71-75285c9e677c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:25.608952 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ca44f-4c50-47aa-9424-26668aeb4e6c None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:25.646281 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35e04c-425b-4d9e-a295-0a0bde180569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:25.647168 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35e04c-425b-4d9e-a295-0a0bde180569 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:25.647497 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35e04c-425b-4d9e-a295-0a0bde180569 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:25.647828 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35e04c-425b-4d9e-a295-0a0bde180569 None admin] PATH_INFO: `/v3/users/079fd518cd814e74be40405a251d2602` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:25.649087 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35e04c-425b-4d9e-a295-0a0bde180569 None admin] RBAC: Authorizing `identity:get_user(user_id=079fd518cd814e74be40405a251d2602)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:25.650637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35e04c-425b-4d9e-a295-0a0bde180569 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:25.652765 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 143/285] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:09:25 2022] GET /identity/v3/users/079fd518cd814e74be40405a251d2602 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:25.660027 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35e04c-425b-4d9e-a295-0a0bde180569 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:25.713605 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 143/286] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:25.748886 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac445880-6c20-458c-ab71-75285c9e677c None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:25.790506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35e04c-425b-4d9e-a295-0a0bde180569 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:25.791600 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:25.830388 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:25.834565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d57dc8-6601-442a-9cf0-7cae51402e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:25.836104 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d57dc8-6601-442a-9cf0-7cae51402e5f None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:25.836395 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d57dc8-6601-442a-9cf0-7cae51402e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:25.836748 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d57dc8-6601-442a-9cf0-7cae51402e5f None admin] PATH_INFO: `/v3/projects/626251d4d31a465b966323ca5f3905d9` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:25.838217 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d57dc8-6601-442a-9cf0-7cae51402e5f None admin] RBAC: Authorizing `identity:get_project(project_id=626251d4d31a465b966323ca5f3905d9)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:25.839746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d57dc8-6601-442a-9cf0-7cae51402e5f None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:25.841781 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 144/287] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:25 2022] GET /identity/v3/projects/626251d4d31a465b966323ca5f3905d9 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:25.849732 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d57dc8-6601-442a-9cf0-7cae51402e5f None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:26.000061 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac445880-6c20-458c-ab71-75285c9e677c None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:26.014102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d57dc8-6601-442a-9cf0-7cae51402e5f None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:26.078456 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db598e-0093-4a0e-9ef5-f2d95b49dc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:26.079552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db598e-0093-4a0e-9ef5-f2d95b49dc96 None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:26.079837 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db598e-0093-4a0e-9ef5-f2d95b49dc96 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:26.080112 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db598e-0093-4a0e-9ef5-f2d95b49dc96 None admin] PATH_INFO: `/v3/projects/626251d4d31a465b966323ca5f3905d9/users/079fd518cd814e74be40405a251d2602/roles/c005105deb5849b9a6e5122b2efa9633` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:26.083239 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db598e-0093-4a0e-9ef5-f2d95b49dc96 None admin] RBAC: Authorizing `identity:create_grant(project_id=626251d4d31a465b966323ca5f3905d9, user_id=079fd518cd814e74be40405a251d2602, role_id=c005105deb5849b9a6e5122b2efa9633)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:26.084874 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db598e-0093-4a0e-9ef5-f2d95b49dc96 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:26.099472 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d11221-d0ba-436e-aead-4e5d9477fb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:26.100281 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d11221-d0ba-436e-aead-4e5d9477fb54 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:26.100563 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d11221-d0ba-436e-aead-4e5d9477fb54 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:26.100837 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d11221-d0ba-436e-aead-4e5d9477fb54 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:26.101613 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 145/288] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jun 4 08:09:25 2022] PUT /identity/v3/projects/626251d4d31a465b966323ca5f3905d9/users/079fd518cd814e74be40405a251d2602/roles/c005105deb5849b9a6e5122b2efa9633 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:09:26.134946 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d11221-d0ba-436e-aead-4e5d9477fb54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:26.142942 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-f1d11221-d0ba-436e-aead-4e5d9477fb54 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:09:26.142942 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:26.142942 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:26.142942 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:26.142942 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:26.142942 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:26.142942 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:26.142942 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:26.142942 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:26.142942 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:26.142942 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:26.142942 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:26.142942 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:26.142942 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:26.142942 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:26.142942 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:26.143963 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:26.143963 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:26.143963 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:26.143963 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:26.143963 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:26.143963 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:26.143963 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:26.143963 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:26.143963 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:26.143963 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:26.143963 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:26.143963 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:26.143963 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:26.143963 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:26.143963 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:26.143963 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:26.144774 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:26.144774 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:26.144774 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:26.144774 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:26.144774 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:26.144774 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:26.144774 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:26.144774 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:26.144774 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:26.144774 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:26.144774 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:09:26.144774 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:26.144774 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 144/289] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:26.151509 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db598e-0093-4a0e-9ef5-f2d95b49dc96 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:26.240270 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:26.303346 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db598e-0093-4a0e-9ef5-f2d95b49dc96 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:26.360596 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d0a05-7dbf-4e47-b9be-3d8a55f3a761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:26.361277 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d0a05-7dbf-4e47-b9be-3d8a55f3a761 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:26.361558 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d0a05-7dbf-4e47-b9be-3d8a55f3a761 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:26.361852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d0a05-7dbf-4e47-b9be-3d8a55f3a761 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:26.363166 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d0a05-7dbf-4e47-b9be-3d8a55f3a761 None admin] RBAC: Adding query filter params (name=member) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:26.363471 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d0a05-7dbf-4e47-b9be-3d8a55f3a761 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:26.364848 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d0a05-7dbf-4e47-b9be-3d8a55f3a761 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:26.375180 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 146/290] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jun 4 08:09:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:26.380998 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d11221-d0ba-436e-aead-4e5d9477fb54 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:26.500244 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:26.544562 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d11221-d0ba-436e-aead-4e5d9477fb54 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:26.594615 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fddf2d-c4cc-4049-bcf6-df145d87931a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:26.595503 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fddf2d-c4cc-4049-bcf6-df145d87931a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:26.595784 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fddf2d-c4cc-4049-bcf6-df145d87931a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:26.596054 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fddf2d-c4cc-4049-bcf6-df145d87931a None admin] PATH_INFO: `/v3/users/6d498faaeb4646aa8d25f960a3de284d` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:26.597302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fddf2d-c4cc-4049-bcf6-df145d87931a None admin] RBAC: Authorizing `identity:get_user(user_id=6d498faaeb4646aa8d25f960a3de284d)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:26.598795 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fddf2d-c4cc-4049-bcf6-df145d87931a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:26.600728 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 145/291] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:09:26 2022] GET /identity/v3/users/6d498faaeb4646aa8d25f960a3de284d => generated 297 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:26.606117 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d0a05-7dbf-4e47-b9be-3d8a55f3a761 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:26.784146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d0a05-7dbf-4e47-b9be-3d8a55f3a761 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:26.812667 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:26.831587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf13b72-1bcb-4782-8823-5f0efcf3908c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:26.832241 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf13b72-1bcb-4782-8823-5f0efcf3908c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:26.832527 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf13b72-1bcb-4782-8823-5f0efcf3908c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:26.832809 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf13b72-1bcb-4782-8823-5f0efcf3908c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:26.937359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf13b72-1bcb-4782-8823-5f0efcf3908c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:26.938872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf13b72-1bcb-4782-8823-5f0efcf3908c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:27.068945 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 147/292] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:09:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 08:09:27.074917 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fddf2d-c4cc-4049-bcf6-df145d87931a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:27.229534 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fddf2d-c4cc-4049-bcf6-df145d87931a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:27.281373 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166ff47-b452-4503-bb46-97c35347defa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:27.282641 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166ff47-b452-4503-bb46-97c35347defa None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:27.283155 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166ff47-b452-4503-bb46-97c35347defa None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:27.283626 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166ff47-b452-4503-bb46-97c35347defa None admin] PATH_INFO: `/v3/projects/626251d4d31a465b966323ca5f3905d9` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:27.285061 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166ff47-b452-4503-bb46-97c35347defa None admin] RBAC: Authorizing `identity:get_project(project_id=626251d4d31a465b966323ca5f3905d9)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:27.286730 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166ff47-b452-4503-bb46-97c35347defa None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:27.288667 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 146/293] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:27 2022] GET /identity/v3/projects/626251d4d31a465b966323ca5f3905d9 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:27.294978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf13b72-1bcb-4782-8823-5f0efcf3908c None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:27.327215 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:27.439194 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf13b72-1bcb-4782-8823-5f0efcf3908c None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:27.485357 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c6dba-15df-47bf-84ca-9214a9359fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:27.486320 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c6dba-15df-47bf-84ca-9214a9359fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:27.486606 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c6dba-15df-47bf-84ca-9214a9359fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:27.487055 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c6dba-15df-47bf-84ca-9214a9359fc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:27.488444 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c6dba-15df-47bf-84ca-9214a9359fc3 None admin] RBAC: Adding query filter params (role.id=314f0b44fb344a99bdda986e7b4ac3ab, scope.project.id=626251d4d31a465b966323ca5f3905d9, user.id=6d498faaeb4646aa8d25f960a3de284d) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:27.488752 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c6dba-15df-47bf-84ca-9214a9359fc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:27.490224 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c6dba-15df-47bf-84ca-9214a9359fc3 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:27.496708 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 148/294] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:09:27 2022] GET /identity/v3/role_assignments?user.id=6d498faaeb4646aa8d25f960a3de284d&scope.project.id=626251d4d31a465b966323ca5f3905d9&role.id=314f0b44fb344a99bdda986e7b4ac3ab => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:27.784125 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd4f2f-efc1-4f06-8294-12b5ee06882d None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:27.785304 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd4f2f-efc1-4f06-8294-12b5ee06882d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:27.785787 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd4f2f-efc1-4f06-8294-12b5ee06882d None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:27.787610 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 147/295] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:27.793217 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a235c-c743-42bf-a9f6-92c96a2f67fe None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:27.793765 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a235c-c743-42bf-a9f6-92c96a2f67fe None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:27.794273 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a235c-c743-42bf-a9f6-92c96a2f67fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:27.811827 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-a43a235c-c743-42bf-a9f6-92c96a2f67fe None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:27.813320 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a43a235c-c743-42bf-a9f6-92c96a2f67fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:27.886055 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 149/296] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:27.911251 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd4f2f-efc1-4f06-8294-12b5ee06882d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:27.925709 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:27.944490 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bbd84-b200-47df-8fab-0469bb39998b None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:27.945097 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bbd84-b200-47df-8fab-0469bb39998b None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:27.945715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bbd84-b200-47df-8fab-0469bb39998b None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:27.947877 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 150/297] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:27.954854 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69a6ba-8723-40f4-a67d-6131c4dab420 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:27.955503 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69a6ba-8723-40f4-a67d-6131c4dab420 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:27.956615 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69a6ba-8723-40f4-a67d-6131c4dab420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:27.979305 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-ee69a6ba-8723-40f4-a67d-6131c4dab420 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:27.980461 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ee69a6ba-8723-40f4-a67d-6131c4dab420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:27.989621 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:28.054065 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd4f2f-efc1-4f06-8294-12b5ee06882d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:28.087766 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 151/298] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 08:09:28.105952 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6a386-bcd1-4b9a-9ad9-58e314238f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:28.106810 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6a386-bcd1-4b9a-9ad9-58e314238f0c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:28.107144 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6a386-bcd1-4b9a-9ad9-58e314238f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:28.107420 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6a386-bcd1-4b9a-9ad9-58e314238f0c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:28.111372 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69a6ba-8723-40f4-a67d-6131c4dab420 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:28.121788 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6a386-bcd1-4b9a-9ad9-58e314238f0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:28.131045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-fcb6a386-bcd1-4b9a-9ad9-58e314238f0c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 08:09:28.131045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:28.131045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:28.131045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:28.131045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:28.131045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:28.131045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:28.131045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:28.131045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:28.131045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:28.131045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:28.131045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:28.131045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:28.131045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:28.131045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:28.131045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:28.131944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:28.131944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:28.131944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:28.131944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:28.131944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:28.131944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:28.131944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:28.131944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:28.131944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:28.131944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:28.131944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:28.131944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:28.131944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:28.131944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:28.131944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:28.131944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:28.132759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:28.132759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:28.132759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:28.132759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:28.132759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:28.132759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:28.132759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:28.132759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:28.132759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:28.132759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:28.132759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 08:09:28.132759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:28.132759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 148/299] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:28.138203 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6a386-bcd1-4b9a-9ad9-58e314238f0c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:28.216254 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:28.232126 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69a6ba-8723-40f4-a67d-6131c4dab420 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:28.252519 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6a386-bcd1-4b9a-9ad9-58e314238f0c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:28.282873 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6757a-7b2a-4944-858e-4f67abe91cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:28.283672 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6757a-7b2a-4944-858e-4f67abe91cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:28.284251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6757a-7b2a-4944-858e-4f67abe91cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:28.284675 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6757a-7b2a-4944-858e-4f67abe91cd3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:28.286133 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf6757a-7b2a-4944-858e-4f67abe91cd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:28.287837 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf6757a-7b2a-4944-858e-4f67abe91cd3 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:28.290047 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 152/300] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:09:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:28.295376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6757a-7b2a-4944-858e-4f67abe91cd3 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:28.297503 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c2237-63d3-430e-948b-affb9335f9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:28.298225 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c2237-63d3-430e-948b-affb9335f9cd None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:28.298517 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c2237-63d3-430e-948b-affb9335f9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:28.298796 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c2237-63d3-430e-948b-affb9335f9cd None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:28.300595 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c2237-63d3-430e-948b-affb9335f9cd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:28.300949 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c2237-63d3-430e-948b-affb9335f9cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:28.303486 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c2237-63d3-430e-948b-affb9335f9cd None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:28.311034 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:28.313691 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 149/301] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jun 4 08:09:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:28.319583 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c2237-63d3-430e-948b-affb9335f9cd None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:28.411196 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6757a-7b2a-4944-858e-4f67abe91cd3 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:28.423125 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c2237-63d3-430e-948b-affb9335f9cd None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:28.453505 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d98a2-d8aa-42b5-97de-0cfa5406ca6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:28.454239 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d98a2-d8aa-42b5-97de-0cfa5406ca6d None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:28.454510 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d98a2-d8aa-42b5-97de-0cfa5406ca6d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:28.454777 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d98a2-d8aa-42b5-97de-0cfa5406ca6d None admin] PATH_INFO: `/v3/groups` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:28.455485 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d98a2-d8aa-42b5-97de-0cfa5406ca6d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:28.457131 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d98a2-d8aa-42b5-97de-0cfa5406ca6d None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:28.460592 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:28.467767 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d225339-7513-4ee4-80d7-2fb8b5272fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:28.468720 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d225339-7513-4ee4-80d7-2fb8b5272fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:28.468994 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d225339-7513-4ee4-80d7-2fb8b5272fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:28.469279 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d225339-7513-4ee4-80d7-2fb8b5272fa7 None admin] PATH_INFO: `/v3/users/7e23f96e15894835bddc89d580413135` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:28.473683 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 153/302] 10.222.0.57 () {60 vars in 1134 bytes} [Sat Jun 4 08:09:28 2022] POST /identity/v3/groups => generated 229 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:09:28.475176 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99224a1-eda1-4089-8814-a6efdf9a5890 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:28.475622 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99224a1-eda1-4089-8814-a6efdf9a5890 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:28.476343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99224a1-eda1-4089-8814-a6efdf9a5890 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:28.482115 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 154/303] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:28.483824 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d2891-e950-4211-a361-a1d0c5e122c6 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:28.484280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d2891-e950-4211-a361-a1d0c5e122c6 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:28.484725 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d2891-e950-4211-a361-a1d0c5e122c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:28.492657 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d225339-7513-4ee4-80d7-2fb8b5272fa7 None admin] RBAC: Authorizing `identity:get_user(user_id=7e23f96e15894835bddc89d580413135)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:28.494707 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d225339-7513-4ee4-80d7-2fb8b5272fa7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:28.498045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 150/304] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:09:28 2022] GET /identity/v3/users/7e23f96e15894835bddc89d580413135 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:28.504488 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d225339-7513-4ee4-80d7-2fb8b5272fa7 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:28.515836 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-1d5d2891-e950-4211-a361-a1d0c5e122c6 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:28.517444 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1d5d2891-e950-4211-a361-a1d0c5e122c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:28.622265 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:28.624046 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d225339-7513-4ee4-80d7-2fb8b5272fa7 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:28.634239 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 155/305] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:28.659682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d2891-e950-4211-a361-a1d0c5e122c6 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:28.668988 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fad21-dfee-4dc5-a368-36c5df6e4670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:28.669977 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fad21-dfee-4dc5-a368-36c5df6e4670 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:28.670405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fad21-dfee-4dc5-a368-36c5df6e4670 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:28.670823 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fad21-dfee-4dc5-a368-36c5df6e4670 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:28.672008 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4fad21-dfee-4dc5-a368-36c5df6e4670 None admin] RBAC: Adding query filter params (role.id=c005105deb5849b9a6e5122b2efa9633, user.id=7e23f96e15894835bddc89d580413135, scope.system=all) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:28.672324 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4fad21-dfee-4dc5-a368-36c5df6e4670 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:28.673890 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4fad21-dfee-4dc5-a368-36c5df6e4670 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:28.681874 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 151/306] 10.222.0.57 () {56 vars in 1308 bytes} [Sat Jun 4 08:09:28 2022] GET /identity/v3/role_assignments?user.id=7e23f96e15894835bddc89d580413135&scope.system=all&role.id=c005105deb5849b9a6e5122b2efa9633 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:28.786214 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c608c-bb25-4f53-ae6a-008e7be7fca8 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:28.786547 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c608c-bb25-4f53-ae6a-008e7be7fca8 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:28.786781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c608c-bb25-4f53-ae6a-008e7be7fca8 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:28.788188 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 152/307] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 08:09:28.790831 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d2891-e950-4211-a361-a1d0c5e122c6 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:28.794675 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121930c9-f9eb-4b58-8759-403a31cff31c None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:28.794970 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121930c9-f9eb-4b58-8759-403a31cff31c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:28.795236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121930c9-f9eb-4b58-8759-403a31cff31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:28.816628 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-121930c9-f9eb-4b58-8759-403a31cff31c None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:28.818254 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-121930c9-f9eb-4b58-8759-403a31cff31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:28.834465 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203f40e-5b6e-4097-8bed-9ecab640f5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:28.835288 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203f40e-5b6e-4097-8bed-9ecab640f5bb None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:28.835574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203f40e-5b6e-4097-8bed-9ecab640f5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:28.835909 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203f40e-5b6e-4097-8bed-9ecab640f5bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:28.852032 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203f40e-5b6e-4097-8bed-9ecab640f5bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:28.860534 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-d203f40e-5b6e-4097-8bed-9ecab640f5bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:09:28.860534 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:28.860534 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:28.860534 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:28.860534 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:28.860534 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:28.860534 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:28.860534 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:28.860534 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:28.860534 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:28.860534 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:28.860534 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:28.860534 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:28.860534 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:28.860534 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:28.860534 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:28.861610 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:28.861610 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:28.861610 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:28.861610 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:28.861610 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:28.861610 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:28.861610 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:28.861610 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:28.861610 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:28.861610 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:28.861610 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:28.861610 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:28.861610 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:28.861610 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:28.861610 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:28.861610 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:28.863640 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:28.863640 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:28.863640 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:28.863640 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:28.863640 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:28.863640 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:28.863640 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:28.863640 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:28.863640 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:28.863640 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:28.863640 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:09:28.863640 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:28.863640 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 156/308] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:09:28.868205 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203f40e-5b6e-4097-8bed-9ecab640f5bb None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:28.880095 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:28.906356 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 153/309] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 08:09:28.936337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121930c9-f9eb-4b58-8759-403a31cff31c None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:28.945202 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:28.998196 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203f40e-5b6e-4097-8bed-9ecab640f5bb None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:29.040558 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ff555-6659-4869-a436-a9e3fab8a13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:29.041568 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ff555-6659-4869-a436-a9e3fab8a13a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:29.042088 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ff555-6659-4869-a436-a9e3fab8a13a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:29.042556 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ff555-6659-4869-a436-a9e3fab8a13a None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:29.043503 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ff555-6659-4869-a436-a9e3fab8a13a None admin] RBAC: Adding query filter params (name=member) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:29.044003 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ff555-6659-4869-a436-a9e3fab8a13a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:29.045572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ff555-6659-4869-a436-a9e3fab8a13a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:29.054917 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 157/310] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jun 4 08:09:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:29.061955 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121930c9-f9eb-4b58-8759-403a31cff31c None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:29.062115 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ff555-6659-4869-a436-a9e3fab8a13a None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:29.097212 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bdbb1-1110-4e56-b1b6-826526f6aad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:29.098081 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bdbb1-1110-4e56-b1b6-826526f6aad1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:29.098478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bdbb1-1110-4e56-b1b6-826526f6aad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:29.098763 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bdbb1-1110-4e56-b1b6-826526f6aad1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:29.111698 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57bdbb1-1110-4e56-b1b6-826526f6aad1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:29.121387 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-a57bdbb1-1110-4e56-b1b6-826526f6aad1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 08:09:29.121387 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:29.121387 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:29.121387 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:29.121387 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:29.121387 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:29.121387 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:29.121387 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:29.121387 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:29.121387 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:29.121387 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:29.121387 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:29.121387 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:29.121387 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:29.121387 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:29.121387 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:29.122593 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:29.122593 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:29.122593 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:29.122593 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:29.122593 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:29.122593 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:29.122593 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:29.122593 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:29.122593 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:29.122593 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:29.122593 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:29.122593 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:29.122593 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:29.122593 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:29.122593 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:29.122593 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:29.123456 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:29.123456 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:29.123456 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:29.123456 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:29.123456 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:29.123456 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:29.123456 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:29.123456 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:29.123456 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:29.123456 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:29.123456 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 08:09:29.123456 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:29.123456 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 154/311] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:29.128558 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bdbb1-1110-4e56-b1b6-826526f6aad1 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:29.174750 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ff555-6659-4869-a436-a9e3fab8a13a None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:29.190933 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:29.200599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:29.215365 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e947fb2-f478-43b2-9398-6510dde81003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:29.216646 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e947fb2-f478-43b2-9398-6510dde81003 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:29.217138 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e947fb2-f478-43b2-9398-6510dde81003 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:29.217679 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e947fb2-f478-43b2-9398-6510dde81003 None admin] PATH_INFO: `/v3/users/0c912684b9054bc78e4eb47e6b527186` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:29.219164 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e947fb2-f478-43b2-9398-6510dde81003 None admin] RBAC: Authorizing `identity:get_user(user_id=0c912684b9054bc78e4eb47e6b527186)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:29.220824 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e947fb2-f478-43b2-9398-6510dde81003 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:29.228421 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 158/312] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:09:29 2022] GET /identity/v3/users/0c912684b9054bc78e4eb47e6b527186 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:29.229486 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e947fb2-f478-43b2-9398-6510dde81003 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:29.265414 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bdbb1-1110-4e56-b1b6-826526f6aad1 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:29.311800 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6b728-9527-4034-858d-6d5613280908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:29.312478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6b728-9527-4034-858d-6d5613280908 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:29.312762 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6b728-9527-4034-858d-6d5613280908 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:29.313140 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6b728-9527-4034-858d-6d5613280908 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:29.314049 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6b728-9527-4034-858d-6d5613280908 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:29.314361 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6b728-9527-4034-858d-6d5613280908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:29.316440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6b728-9527-4034-858d-6d5613280908 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:29.325849 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 155/313] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jun 4 08:09:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:29.331334 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6b728-9527-4034-858d-6d5613280908 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:29.351808 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e947fb2-f478-43b2-9398-6510dde81003 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:29.387874 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4f7e4-9dd0-4d59-90a5-ba3c0e61c8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:29.388606 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4f7e4-9dd0-4d59-90a5-ba3c0e61c8a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:29.388893 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4f7e4-9dd0-4d59-90a5-ba3c0e61c8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:29.389172 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4f7e4-9dd0-4d59-90a5-ba3c0e61c8a5 None admin] PATH_INFO: `/v3/system/users/0c912684b9054bc78e4eb47e6b527186/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:29.390765 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4f7e4-9dd0-4d59-90a5-ba3c0e61c8a5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0c912684b9054bc78e4eb47e6b527186, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:29.392617 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4f7e4-9dd0-4d59-90a5-ba3c0e61c8a5 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:29.406545 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 159/314] 10.222.0.57 () {58 vars in 1334 bytes} [Sat Jun 4 08:09:29 2022] PUT /identity/v3/system/users/0c912684b9054bc78e4eb47e6b527186/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:09:29.463844 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6b728-9527-4034-858d-6d5613280908 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:29.472858 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:29.504706 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d446be-c779-4be0-a189-4fc27cd067d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:29.505874 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d446be-c779-4be0-a189-4fc27cd067d0 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:29.506320 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d446be-c779-4be0-a189-4fc27cd067d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:29.506734 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d446be-c779-4be0-a189-4fc27cd067d0 None admin] PATH_INFO: `/v3/users/079fd518cd814e74be40405a251d2602` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:29.508167 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d446be-c779-4be0-a189-4fc27cd067d0 None admin] RBAC: Authorizing `identity:get_user(user_id=079fd518cd814e74be40405a251d2602)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:29.509801 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d446be-c779-4be0-a189-4fc27cd067d0 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:29.511666 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 156/315] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:09:29 2022] GET /identity/v3/users/079fd518cd814e74be40405a251d2602 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:29.520218 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4f7e4-9dd0-4d59-90a5-ba3c0e61c8a5 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:29.585975 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:29.637246 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4f7e4-9dd0-4d59-90a5-ba3c0e61c8a5 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:29.672824 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a412d-d401-4be3-bb5d-38d6e42e30b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:29.673481 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a412d-d401-4be3-bb5d-38d6e42e30b5 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:29.673766 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a412d-d401-4be3-bb5d-38d6e42e30b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:29.674086 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a412d-d401-4be3-bb5d-38d6e42e30b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:29.748693 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a412d-d401-4be3-bb5d-38d6e42e30b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:29.750216 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a412d-d401-4be3-bb5d-38d6e42e30b5 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:29.811360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:29.859854 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 160/316] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:09:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 08:09:29.865401 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d446be-c779-4be0-a189-4fc27cd067d0 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:29.980888 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d446be-c779-4be0-a189-4fc27cd067d0 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:30.017302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a17642-8ffe-4ebb-bab0-8f8946371c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:30.019048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a17642-8ffe-4ebb-bab0-8f8946371c34 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:30.019554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a17642-8ffe-4ebb-bab0-8f8946371c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:30.020029 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a17642-8ffe-4ebb-bab0-8f8946371c34 None admin] PATH_INFO: `/v3/projects/626251d4d31a465b966323ca5f3905d9` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:30.021448 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a17642-8ffe-4ebb-bab0-8f8946371c34 None admin] RBAC: Authorizing `identity:get_project(project_id=626251d4d31a465b966323ca5f3905d9)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:30.023265 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a17642-8ffe-4ebb-bab0-8f8946371c34 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:30.025458 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 157/317] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:29 2022] GET /identity/v3/projects/626251d4d31a465b966323ca5f3905d9 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:30.031359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a412d-d401-4be3-bb5d-38d6e42e30b5 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:30.138867 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a412d-d401-4be3-bb5d-38d6e42e30b5 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:30.174580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc19dd0-eb2a-47a8-a02a-bf7853491f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:30.175622 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc19dd0-eb2a-47a8-a02a-bf7853491f3d None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:30.176541 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc19dd0-eb2a-47a8-a02a-bf7853491f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:30.177035 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc19dd0-eb2a-47a8-a02a-bf7853491f3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:30.178358 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc19dd0-eb2a-47a8-a02a-bf7853491f3d None admin] RBAC: Adding query filter params (role.id=c005105deb5849b9a6e5122b2efa9633, scope.project.id=626251d4d31a465b966323ca5f3905d9, user.id=079fd518cd814e74be40405a251d2602) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:30.178878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc19dd0-eb2a-47a8-a02a-bf7853491f3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:30.180530 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc19dd0-eb2a-47a8-a02a-bf7853491f3d None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:30.186927 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 161/318] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:09:30 2022] GET /identity/v3/role_assignments?user.id=079fd518cd814e74be40405a251d2602&scope.project.id=626251d4d31a465b966323ca5f3905d9&role.id=c005105deb5849b9a6e5122b2efa9633 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:30.877397 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d52777-b683-47bf-be1e-f7226e7bab8e None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:30.877936 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d52777-b683-47bf-be1e-f7226e7bab8e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:30.878013 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d52777-b683-47bf-be1e-f7226e7bab8e None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:30.879523 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 158/319] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:30.884479 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14cc27-2587-4bf2-b107-e242fdfedb97 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:30.884770 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14cc27-2587-4bf2-b107-e242fdfedb97 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:30.885052 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14cc27-2587-4bf2-b107-e242fdfedb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:30.901703 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-2b14cc27-2587-4bf2-b107-e242fdfedb97 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:30.902913 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2b14cc27-2587-4bf2-b107-e242fdfedb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:30.922059 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:30.977904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 162/320] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:31.000533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d52777-b683-47bf-be1e-f7226e7bab8e None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:31.046631 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:31.051685 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ec8d0-33b6-472f-9d59-3e3f63e0be9e None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:31.051971 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ec8d0-33b6-472f-9d59-3e3f63e0be9e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:31.052254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ec8d0-33b6-472f-9d59-3e3f63e0be9e None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:31.054047 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 163/321] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:31.058848 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1399af1-bfd4-425f-93d8-8ca08587ed6e None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:31.059134 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1399af1-bfd4-425f-93d8-8ca08587ed6e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:31.059413 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1399af1-bfd4-425f-93d8-8ca08587ed6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:31.075853 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-d1399af1-bfd4-425f-93d8-8ca08587ed6e None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:31.077314 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d1399af1-bfd4-425f-93d8-8ca08587ed6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:31.114027 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d52777-b683-47bf-be1e-f7226e7bab8e None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:31.147272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8bd28-bfbb-45cd-b042-0e8902f421e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:31.147996 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8bd28-bfbb-45cd-b042-0e8902f421e4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:31.148280 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8bd28-bfbb-45cd-b042-0e8902f421e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:31.148554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8bd28-bfbb-45cd-b042-0e8902f421e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:31.149758 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8bd28-bfbb-45cd-b042-0e8902f421e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:31.157021 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 164/322] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 08:09:31.157168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8bd28-bfbb-45cd-b042-0e8902f421e4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:31.157168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 159/323] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:09:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:31.158219 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1399af1-bfd4-425f-93d8-8ca08587ed6e None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:31.177656 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8bd28-bfbb-45cd-b042-0e8902f421e4 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:31.251359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:31.275172 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1399af1-bfd4-425f-93d8-8ca08587ed6e None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:31.283858 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8bd28-bfbb-45cd-b042-0e8902f421e4 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:31.295667 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:31.313539 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b105b-92d4-4a57-8073-5c98a0b82b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:31.314359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b105b-92d4-4a57-8073-5c98a0b82b0d None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:31.314696 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b105b-92d4-4a57-8073-5c98a0b82b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:31.314977 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b105b-92d4-4a57-8073-5c98a0b82b0d None admin] PATH_INFO: `/v3/groups` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:31.315705 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b105b-92d4-4a57-8073-5c98a0b82b0d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:31.317151 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b105b-92d4-4a57-8073-5c98a0b82b0d None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:31.320666 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d5ea2-7c45-49af-b75c-4c7658f59767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:31.321485 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d5ea2-7c45-49af-b75c-4c7658f59767 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:31.321937 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d5ea2-7c45-49af-b75c-4c7658f59767 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:31.322425 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d5ea2-7c45-49af-b75c-4c7658f59767 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:31.333227 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 165/324] 10.222.0.57 () {60 vars in 1134 bytes} [Sat Jun 4 08:09:31 2022] POST /identity/v3/groups => generated 226 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:09:31.334859 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d5ea2-7c45-49af-b75c-4c7658f59767 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:31.343038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-028d5ea2-7c45-49af-b75c-4c7658f59767 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 08:09:31.343038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:31.343038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:31.343038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:31.343038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:31.343038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:31.343038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:31.343038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:31.343038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:31.343038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:31.343038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:31.343038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:31.343038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:31.343038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:31.343038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:31.343038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:31.344145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:31.344145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:31.344145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:31.344145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:31.344145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:31.344145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:31.344145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:31.344145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:31.344145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:31.344145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:31.344145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:31.344145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:31.344145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:31.344145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:31.344145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:31.344145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:31.345108 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:31.345108 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:31.345108 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:31.345108 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:31.345108 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:31.345108 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:31.345108 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:31.345108 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:31.345108 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:31.345108 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:31.345108 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 08:09:31.345108 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:31.348066 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 160/325] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:31.354410 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b105b-92d4-4a57-8073-5c98a0b82b0d None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:31.477233 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b105b-92d4-4a57-8073-5c98a0b82b0d None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:31.513788 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3706574-3f55-462c-aec4-5e64251f6f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:31.514804 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3706574-3f55-462c-aec4-5e64251f6f64 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:31.515224 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3706574-3f55-462c-aec4-5e64251f6f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:31.515634 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3706574-3f55-462c-aec4-5e64251f6f64 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:31.516528 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3706574-3f55-462c-aec4-5e64251f6f64 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:31.516990 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3706574-3f55-462c-aec4-5e64251f6f64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:31.519243 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3706574-3f55-462c-aec4-5e64251f6f64 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:31.525238 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:31.535176 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 166/326] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jun 4 08:09:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:31.536767 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d5ea2-7c45-49af-b75c-4c7658f59767 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:31.646121 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d5ea2-7c45-49af-b75c-4c7658f59767 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:31.681555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3584b-6fd8-4b47-8cb7-1593b645e4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:31.682933 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3584b-6fd8-4b47-8cb7-1593b645e4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:31.683418 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3584b-6fd8-4b47-8cb7-1593b645e4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:31.683888 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3584b-6fd8-4b47-8cb7-1593b645e4e2 None admin] PATH_INFO: `/v3/users/7e23f96e15894835bddc89d580413135` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:31.685371 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3584b-6fd8-4b47-8cb7-1593b645e4e2 None admin] RBAC: Authorizing `identity:get_user(user_id=7e23f96e15894835bddc89d580413135)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:31.687194 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3584b-6fd8-4b47-8cb7-1593b645e4e2 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:31.689384 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 161/327] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:09:31 2022] GET /identity/v3/users/7e23f96e15894835bddc89d580413135 => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:31.695841 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3706574-3f55-462c-aec4-5e64251f6f64 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:31.763880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bef686-9349-4250-8ae4-05ae7704ac33 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:31.764162 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bef686-9349-4250-8ae4-05ae7704ac33 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:31.764447 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bef686-9349-4250-8ae4-05ae7704ac33 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:31.766127 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 162/328] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:31.771990 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3793ee7-3f83-4550-84a8-55b990a5c8e4 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:31.772339 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3793ee7-3f83-4550-84a8-55b990a5c8e4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:31.772599 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3793ee7-3f83-4550-84a8-55b990a5c8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:31.790944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f3793ee7-3f83-4550-84a8-55b990a5c8e4 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:31.792451 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f3793ee7-3f83-4550-84a8-55b990a5c8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:31.827679 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3706574-3f55-462c-aec4-5e64251f6f64 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:31.833435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:31.873281 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ed9ff-b81e-4237-ad82-8f057a2e6cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:31.874176 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ed9ff-b81e-4237-ad82-8f057a2e6cd4 None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:31.874456 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ed9ff-b81e-4237-ad82-8f057a2e6cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:31.874892 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ed9ff-b81e-4237-ad82-8f057a2e6cd4 None admin] PATH_INFO: `/v3/system/users/7e23f96e15894835bddc89d580413135/roles/c005105deb5849b9a6e5122b2efa9633` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:31.876998 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ed9ff-b81e-4237-ad82-8f057a2e6cd4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7e23f96e15894835bddc89d580413135, role_id=c005105deb5849b9a6e5122b2efa9633)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:31.878936 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ed9ff-b81e-4237-ad82-8f057a2e6cd4 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:31.880536 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 163/329] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 08:09:31.895042 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 167/330] 10.222.0.57 () {58 vars in 1334 bytes} [Sat Jun 4 08:09:31 2022] PUT /identity/v3/system/users/7e23f96e15894835bddc89d580413135/roles/c005105deb5849b9a6e5122b2efa9633 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:09:31.908736 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3793ee7-3f83-4550-84a8-55b990a5c8e4 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:32.030926 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3793ee7-3f83-4550-84a8-55b990a5c8e4 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:32.072189 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc2302-0381-4e17-9096-0d8883843aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:32.073416 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc2302-0381-4e17-9096-0d8883843aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:32.073937 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc2302-0381-4e17-9096-0d8883843aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:32.074445 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc2302-0381-4e17-9096-0d8883843aa7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:32.087588 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc2302-0381-4e17-9096-0d8883843aa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:32.096004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-70dc2302-0381-4e17-9096-0d8883843aa7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:09:32.096004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:32.096004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:32.096004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:32.096004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:32.096004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:32.096004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:32.096004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:32.096004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:32.096004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:32.096004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:32.096004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:32.096004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:32.096004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:32.096004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:32.096004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:32.096980 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:32.096980 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:32.096980 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:32.096980 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:32.096980 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:32.096980 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:32.096980 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:32.096980 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:32.096980 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:32.096980 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:32.096980 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:32.096980 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:32.096980 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:32.096980 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:32.096980 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:32.096980 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:32.097811 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:32.097811 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:32.097811 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:32.097811 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:32.097811 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:32.097811 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:32.097811 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:32.097811 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:32.097811 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:32.097811 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:32.097811 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:09:32.097811 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:32.100350 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 164/331] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:32.106315 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ed9ff-b81e-4237-ad82-8f057a2e6cd4 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:32.186953 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:32.234790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ed9ff-b81e-4237-ad82-8f057a2e6cd4 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:32.275988 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe13a72-cb73-46a5-9775-4ac6c73774dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:32.276727 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe13a72-cb73-46a5-9775-4ac6c73774dc None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:32.276942 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe13a72-cb73-46a5-9775-4ac6c73774dc None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:32.277224 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe13a72-cb73-46a5-9775-4ac6c73774dc None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:32.278013 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe13a72-cb73-46a5-9775-4ac6c73774dc None admin] RBAC: Adding query filter params (name=member) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:32.278325 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe13a72-cb73-46a5-9775-4ac6c73774dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:32.279717 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe13a72-cb73-46a5-9775-4ac6c73774dc None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:32.292207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 168/332] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jun 4 08:09:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:32.297676 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc2302-0381-4e17-9096-0d8883843aa7 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:32.331118 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:32.432456 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc2302-0381-4e17-9096-0d8883843aa7 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:32.479720 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5d844-29b9-4d07-8fb0-1ae866470b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:32.480595 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5d844-29b9-4d07-8fb0-1ae866470b91 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:32.480880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5d844-29b9-4d07-8fb0-1ae866470b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:32.481153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5d844-29b9-4d07-8fb0-1ae866470b91 None admin] PATH_INFO: `/v3/users/0c912684b9054bc78e4eb47e6b527186` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:32.482424 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b5d844-29b9-4d07-8fb0-1ae866470b91 None admin] RBAC: Authorizing `identity:get_user(user_id=0c912684b9054bc78e4eb47e6b527186)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:32.483896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b5d844-29b9-4d07-8fb0-1ae866470b91 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:32.485839 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 165/333] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:09:32 2022] GET /identity/v3/users/0c912684b9054bc78e4eb47e6b527186 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:32.492086 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe13a72-cb73-46a5-9775-4ac6c73774dc None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:32.610860 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe13a72-cb73-46a5-9775-4ac6c73774dc None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:32.649577 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:32.664349 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e253e-7337-44dc-a918-c95c6487dce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:32.665330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e253e-7337-44dc-a918-c95c6487dce2 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:32.665812 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e253e-7337-44dc-a918-c95c6487dce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:32.666309 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e253e-7337-44dc-a918-c95c6487dce2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:32.667358 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e253e-7337-44dc-a918-c95c6487dce2 None admin] RBAC: Adding query filter params (role.id=314f0b44fb344a99bdda986e7b4ac3ab, user.id=0c912684b9054bc78e4eb47e6b527186, scope.system=all) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:32.667868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e253e-7337-44dc-a918-c95c6487dce2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:32.669514 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e253e-7337-44dc-a918-c95c6487dce2 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:32.690009 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 169/334] 10.222.0.57 () {56 vars in 1308 bytes} [Sat Jun 4 08:09:32 2022] GET /identity/v3/role_assignments?user.id=0c912684b9054bc78e4eb47e6b527186&scope.system=all&role.id=314f0b44fb344a99bdda986e7b4ac3ab => generated 510 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:33.928519 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d198201-4d18-46ff-8268-e508ab37b89e None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:33.929019 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d198201-4d18-46ff-8268-e508ab37b89e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:33.929117 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d198201-4d18-46ff-8268-e508ab37b89e None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:33.930754 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 166/335] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:33.936275 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de70a7-03e5-4ba5-8eac-7e2fa20d1c83 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:33.937164 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de70a7-03e5-4ba5-8eac-7e2fa20d1c83 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:33.937636 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de70a7-03e5-4ba5-8eac-7e2fa20d1c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:33.956891 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-75de70a7-03e5-4ba5-8eac-7e2fa20d1c83 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:33.958479 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-75de70a7-03e5-4ba5-8eac-7e2fa20d1c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:34.029936 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 170/336] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:34.054198 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d198201-4d18-46ff-8268-e508ab37b89e None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:34.157484 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:34.170611 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d198201-4d18-46ff-8268-e508ab37b89e None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:34.215386 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a09f7-83b8-4538-b493-53971b847113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:34.216208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a09f7-83b8-4538-b493-53971b847113 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:34.216487 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a09f7-83b8-4538-b493-53971b847113 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:34.216847 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a09f7-83b8-4538-b493-53971b847113 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:34.232772 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a09f7-83b8-4538-b493-53971b847113 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:34.241173 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-036a09f7-83b8-4538-b493-53971b847113 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:09:34.241173 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:34.241173 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:34.241173 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:34.241173 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:34.241173 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:34.241173 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:34.241173 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:34.241173 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:34.241173 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:34.241173 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:34.241173 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:34.241173 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:34.241173 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:34.241173 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:34.241173 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:34.242136 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:34.242136 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:34.242136 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:34.242136 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:34.242136 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:34.242136 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:34.242136 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:34.242136 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:34.242136 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:34.242136 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:34.242136 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:34.242136 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:34.242136 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:34.242136 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:34.242136 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:34.242136 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:34.242936 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:34.242936 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:34.242936 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:34.242936 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:34.242936 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:34.242936 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:34.242936 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:34.242936 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:34.242936 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:34.242936 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:34.242936 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:09:34.242936 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:34.242936 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 167/337] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:34.248262 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de70a7-03e5-4ba5-8eac-7e2fa20d1c83 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:34.382083 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de70a7-03e5-4ba5-8eac-7e2fa20d1c83 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:34.398407 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:34.422315 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1933bb0-7358-4209-bb19-0050dab0db12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:34.422899 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1933bb0-7358-4209-bb19-0050dab0db12 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:34.423179 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1933bb0-7358-4209-bb19-0050dab0db12 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:34.423453 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1933bb0-7358-4209-bb19-0050dab0db12 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:34.424199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1933bb0-7358-4209-bb19-0050dab0db12 None admin] RBAC: Adding query filter params (name=member) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:34.424504 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1933bb0-7358-4209-bb19-0050dab0db12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:34.425946 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1933bb0-7358-4209-bb19-0050dab0db12 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:34.439492 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 171/338] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jun 4 08:09:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:34.441084 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a09f7-83b8-4538-b493-53971b847113 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:34.567969 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a09f7-83b8-4538-b493-53971b847113 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:34.607110 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b015e7-409b-4c07-8c3e-41d4a78879dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:34.608098 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b015e7-409b-4c07-8c3e-41d4a78879dd None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:34.608535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b015e7-409b-4c07-8c3e-41d4a78879dd None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:34.608957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b015e7-409b-4c07-8c3e-41d4a78879dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:34.637876 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:34.692683 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b015e7-409b-4c07-8c3e-41d4a78879dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:34.694190 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b015e7-409b-4c07-8c3e-41d4a78879dd None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:34.812443 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 168/339] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:09:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 08:09:34.818343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1933bb0-7358-4209-bb19-0050dab0db12 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:34.965623 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1933bb0-7358-4209-bb19-0050dab0db12 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:35.005332 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d45a5-14e4-466b-9e51-2e783cfd6bb4 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:35.006283 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d45a5-14e4-466b-9e51-2e783cfd6bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:35.006767 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d45a5-14e4-466b-9e51-2e783cfd6bb4 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:35.008347 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 169/340] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 08:09:35.014980 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602463e-ef72-4abc-994d-02f35b4f413b None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:35.015525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602463e-ef72-4abc-994d-02f35b4f413b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:35.015987 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602463e-ef72-4abc-994d-02f35b4f413b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:35.040253 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-8602463e-ef72-4abc-994d-02f35b4f413b None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:35.041167 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19e98b-f3c8-468d-be41-a98d3a419841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:35.042286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19e98b-f3c8-468d-be41-a98d3a419841 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:35.042763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19e98b-f3c8-468d-be41-a98d3a419841 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:35.043222 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19e98b-f3c8-468d-be41-a98d3a419841 None admin] PATH_INFO: `/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:35.045160 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8602463e-ef72-4abc-994d-02f35b4f413b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:35.046089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19e98b-f3c8-468d-be41-a98d3a419841 None admin] RBAC: Authorizing `identity:get_project(project_id=a9d904b06eb24d5d8bce3f192f7927ca)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:35.047801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19e98b-f3c8-468d-be41-a98d3a419841 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:35.052483 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 172/341] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:34 2022] GET /identity/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:35.060120 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19e98b-f3c8-468d-be41-a98d3a419841 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:35.142175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:35.183263 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:35.228053 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19e98b-f3c8-468d-be41-a98d3a419841 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:35.247547 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 170/342] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:35.248929 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fed907-f62d-408c-8913-327bde26fbff None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:35.249219 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fed907-f62d-408c-8913-327bde26fbff None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:35.249495 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fed907-f62d-408c-8913-327bde26fbff None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:35.250815 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 171/343] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:35.256715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a7673-4719-40b2-b426-54eaf6f5949f None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:35.257008 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a7673-4719-40b2-b426-54eaf6f5949f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:35.257283 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a7673-4719-40b2-b426-54eaf6f5949f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:35.273000 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45009613-ed4b-442d-a1ab-cb88ab975e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:35.274271 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45009613-ed4b-442d-a1ab-cb88ab975e97 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:35.274746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45009613-ed4b-442d-a1ab-cb88ab975e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:35.275239 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45009613-ed4b-442d-a1ab-cb88ab975e97 None admin] PATH_INFO: `/v3/groups/b8d888b135744995a345120b82c58779` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:35.282955 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45009613-ed4b-442d-a1ab-cb88ab975e97 None admin] RBAC: Authorizing `identity:get_group(group_id=b8d888b135744995a345120b82c58779)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:35.284789 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45009613-ed4b-442d-a1ab-cb88ab975e97 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:35.287664 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 173/344] 10.222.0.57 () {56 vars in 1180 bytes} [Sat Jun 4 08:09:35 2022] GET /identity/v3/groups/b8d888b135744995a345120b82c58779 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:35.293557 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45009613-ed4b-442d-a1ab-cb88ab975e97 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:35.298814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-4b1a7673-4719-40b2-b426-54eaf6f5949f None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:35.300751 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4b1a7673-4719-40b2-b426-54eaf6f5949f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:35.418892 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45009613-ed4b-442d-a1ab-cb88ab975e97 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:35.435974 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:35.457195 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 172/345] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:35.458425 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a7673-4719-40b2-b426-54eaf6f5949f None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:35.510576 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58572792-e330-479c-bd30-a2466b6012a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:35.511258 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58572792-e330-479c-bd30-a2466b6012a1 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:35.511834 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58572792-e330-479c-bd30-a2466b6012a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:35.511834 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58572792-e330-479c-bd30-a2466b6012a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:35.512640 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58572792-e330-479c-bd30-a2466b6012a1 None admin] RBAC: Adding query filter params (group.id=b8d888b135744995a345120b82c58779, role.id=314f0b44fb344a99bdda986e7b4ac3ab, scope.project.id=a9d904b06eb24d5d8bce3f192f7927ca) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:35.512955 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58572792-e330-479c-bd30-a2466b6012a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:35.514437 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58572792-e330-479c-bd30-a2466b6012a1 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:35.528670 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 174/346] 10.222.0.57 () {56 vars in 1376 bytes} [Sat Jun 4 08:09:35 2022] GET /identity/v3/role_assignments?group.id=b8d888b135744995a345120b82c58779&scope.project.id=a9d904b06eb24d5d8bce3f192f7927ca&role.id=314f0b44fb344a99bdda986e7b4ac3ab => generated 260 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:35.529507 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58572792-e330-479c-bd30-a2466b6012a1 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:35.585973 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a7673-4719-40b2-b426-54eaf6f5949f None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:35.606348 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:35.628344 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c909ab-41c8-497a-bcd0-8c80c68d4c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:35.629443 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c909ab-41c8-497a-bcd0-8c80c68d4c78 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:35.629997 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c909ab-41c8-497a-bcd0-8c80c68d4c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:35.630429 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c909ab-41c8-497a-bcd0-8c80c68d4c78 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:35.642735 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c909ab-41c8-497a-bcd0-8c80c68d4c78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:35.651222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-95c909ab-41c8-497a-bcd0-8c80c68d4c78 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 08:09:35.651222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:35.651222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:35.651222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:35.651222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:35.651222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:35.651222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:35.651222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:35.651222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:35.651222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:35.651222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:35.651222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:35.651222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:35.651222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:35.651222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:35.651222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:35.652426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:35.652426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:35.652426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:35.652426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:35.652426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:35.652426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:35.652426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:35.652426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:35.652426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:35.652426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:35.652426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:35.652426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:35.652426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:35.652426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:35.652426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:35.652426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:35.653453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:35.653453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:35.653453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:35.653453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:35.653453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:35.653453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:35.653453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:35.653453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:35.653453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:35.653453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:35.653453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 08:09:35.653453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:35.655897 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 173/347] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:35.663454 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c909ab-41c8-497a-bcd0-8c80c68d4c78 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:35.785112 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c909ab-41c8-497a-bcd0-8c80c68d4c78 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:35.818877 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58572792-e330-479c-bd30-a2466b6012a1 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:35.822138 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750abbd-56a5-41ae-adb7-827187222cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:35.823048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750abbd-56a5-41ae-adb7-827187222cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:35.823491 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750abbd-56a5-41ae-adb7-827187222cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:35.823927 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750abbd-56a5-41ae-adb7-827187222cf1 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:35.824856 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1750abbd-56a5-41ae-adb7-827187222cf1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:35.825318 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1750abbd-56a5-41ae-adb7-827187222cf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:35.826934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1750abbd-56a5-41ae-adb7-827187222cf1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:35.837514 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 174/348] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jun 4 08:09:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:35.839267 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1eb093-0f1f-49e5-8b1c-d84f7409f39c None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:35.839717 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1eb093-0f1f-49e5-8b1c-d84f7409f39c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:35.840161 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1eb093-0f1f-49e5-8b1c-d84f7409f39c None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:35.841587 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 175/349] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:35.848219 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d50848-385a-4983-91dc-6bff6b7162d0 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:35.848751 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d50848-385a-4983-91dc-6bff6b7162d0 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:35.849175 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d50848-385a-4983-91dc-6bff6b7162d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:35.871502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bd9fc-be96-49d6-9eec-7113a1b98864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:35.872227 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-41d50848-385a-4983-91dc-6bff6b7162d0 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:35.872408 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bd9fc-be96-49d6-9eec-7113a1b98864 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:35.872600 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bd9fc-be96-49d6-9eec-7113a1b98864 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:35.872878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bd9fc-be96-49d6-9eec-7113a1b98864 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:35.874297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-41d50848-385a-4983-91dc-6bff6b7162d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:35.893074 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1bd9fc-be96-49d6-9eec-7113a1b98864 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:35.909046 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:35.927746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-4d1bd9fc-be96-49d6-9eec-7113a1b98864 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 08:09:35.927746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:35.927746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:35.927746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:35.927746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:35.927746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:35.927746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:35.927746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:35.927746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:35.927746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:35.927746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:35.927746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:35.927746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:35.927746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:35.927746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:35.927746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:35.929193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:35.929193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:35.929193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:35.929193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:35.929193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:35.929193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:35.929193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:35.929193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:35.929193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:35.929193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:35.929193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:35.929193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:35.929193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:35.929193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:35.929193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:35.929193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:35.930228 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:35.930228 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:35.930228 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:35.930228 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:35.930228 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:35.930228 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:35.930228 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:35.930228 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:35.930228 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:35.930228 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:35.930228 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 08:09:35.930228 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:35.930228 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 175/350] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jun 4 08:09:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:35.930228 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bd9fc-be96-49d6-9eec-7113a1b98864 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:35.957635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 176/351] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 08:09:35.959043 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d50848-385a-4983-91dc-6bff6b7162d0 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:35.993506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:36.093327 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bd9fc-be96-49d6-9eec-7113a1b98864 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:36.130091 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d50848-385a-4983-91dc-6bff6b7162d0 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:36.130719 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867e510-68eb-4de3-9e4e-433349fe6e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:36.131792 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867e510-68eb-4de3-9e4e-433349fe6e08 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:36.132230 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867e510-68eb-4de3-9e4e-433349fe6e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:36.132656 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867e510-68eb-4de3-9e4e-433349fe6e08 None admin] PATH_INFO: `/v3/users/7e23f96e15894835bddc89d580413135` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:36.134061 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867e510-68eb-4de3-9e4e-433349fe6e08 None admin] RBAC: Authorizing `identity:get_user(user_id=7e23f96e15894835bddc89d580413135)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:36.135675 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867e510-68eb-4de3-9e4e-433349fe6e08 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:36.137491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 176/352] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:09:35 2022] GET /identity/v3/users/7e23f96e15894835bddc89d580413135 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:36.140549 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867e510-68eb-4de3-9e4e-433349fe6e08 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:36.174146 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c65ae-7f79-4b7b-9c67-da279a844247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:36.175003 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c65ae-7f79-4b7b-9c67-da279a844247 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:36.175288 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c65ae-7f79-4b7b-9c67-da279a844247 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:36.175614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c65ae-7f79-4b7b-9c67-da279a844247 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:36.176358 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c65ae-7f79-4b7b-9c67-da279a844247 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:36.176663 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c65ae-7f79-4b7b-9c67-da279a844247 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:36.178365 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c65ae-7f79-4b7b-9c67-da279a844247 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:36.189848 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 177/353] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:09:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:36.191332 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c65ae-7f79-4b7b-9c67-da279a844247 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:36.250288 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:36.266119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:36.274021 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867e510-68eb-4de3-9e4e-433349fe6e08 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:36.310355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c65ae-7f79-4b7b-9c67-da279a844247 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:36.311528 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6e267-30fb-489a-af8c-ffe6b32d1e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:36.312519 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6e267-30fb-489a-af8c-ffe6b32d1e7e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:36.312949 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6e267-30fb-489a-af8c-ffe6b32d1e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:36.313360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6e267-30fb-489a-af8c-ffe6b32d1e7e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:36.325799 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6e267-30fb-489a-af8c-ffe6b32d1e7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:36.334552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-d6d6e267-30fb-489a-af8c-ffe6b32d1e7e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:09:36.334552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:36.334552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:36.334552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:36.334552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:36.334552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:36.334552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:36.334552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:36.334552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:36.334552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:36.334552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:36.334552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:36.334552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:36.334552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:36.334552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:36.334552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:36.335551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:36.335551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:36.335551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:36.335551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:36.335551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:36.335551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:36.335551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:36.335551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:36.335551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:36.335551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:36.335551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:36.335551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:36.335551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:36.335551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:36.335551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:36.335551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:36.336365 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:36.336365 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:36.336365 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:36.336365 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:36.336365 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:36.336365 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:36.336365 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:36.336365 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:36.336365 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:36.336365 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:36.336365 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:09:36.336365 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:36.338721 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 177/354] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:36.339679 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6e267-30fb-489a-af8c-ffe6b32d1e7e None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:36.350535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda122a-af31-4eea-a9a6-59877afaa40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:36.351374 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda122a-af31-4eea-a9a6-59877afaa40d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:36.351661 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda122a-af31-4eea-a9a6-59877afaa40d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:36.352004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda122a-af31-4eea-a9a6-59877afaa40d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:36.352901 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda122a-af31-4eea-a9a6-59877afaa40d None admin] RBAC: Adding query filter params (role.id=c005105deb5849b9a6e5122b2efa9633, user.id=7e23f96e15894835bddc89d580413135, scope.system=all) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:36.353283 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda122a-af31-4eea-a9a6-59877afaa40d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:36.355001 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda122a-af31-4eea-a9a6-59877afaa40d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:36.368195 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 178/355] 10.222.0.57 () {56 vars in 1308 bytes} [Sat Jun 4 08:09:36 2022] GET /identity/v3/role_assignments?user.id=7e23f96e15894835bddc89d580413135&scope.system=all&role.id=c005105deb5849b9a6e5122b2efa9633 => generated 510 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:36.375829 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faeac11-0e9a-422c-9c3b-8fb4c2fdb053 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:36.376092 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faeac11-0e9a-422c-9c3b-8fb4c2fdb053 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:36.376446 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faeac11-0e9a-422c-9c3b-8fb4c2fdb053 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:36.378542 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 179/356] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:36.383731 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faeac11-0e9a-422c-9c3b-8fb4c2fdb053 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:36.456485 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6e267-30fb-489a-af8c-ffe6b32d1e7e None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:36.497243 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71ec9a-f32e-423a-b731-e59bb250f7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:36.498277 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71ec9a-f32e-423a-b731-e59bb250f7cb None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:36.498796 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71ec9a-f32e-423a-b731-e59bb250f7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:36.499416 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71ec9a-f32e-423a-b731-e59bb250f7cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:36.522308 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:36.537551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:36.543318 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faeac11-0e9a-422c-9c3b-8fb4c2fdb053 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:36.586910 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71ec9a-f32e-423a-b731-e59bb250f7cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:36.588810 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71ec9a-f32e-423a-b731-e59bb250f7cb None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:36.620828 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074d12c-47d4-4185-a4d8-2c03d5cba8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:36.621399 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074d12c-47d4-4185-a4d8-2c03d5cba8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:36.621682 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074d12c-47d4-4185-a4d8-2c03d5cba8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:36.622058 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074d12c-47d4-4185-a4d8-2c03d5cba8d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:36.622810 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074d12c-47d4-4185-a4d8-2c03d5cba8d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:36.623115 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074d12c-47d4-4185-a4d8-2c03d5cba8d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:36.624507 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074d12c-47d4-4185-a4d8-2c03d5cba8d1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:36.648086 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 180/357] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jun 4 08:09:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:36.649553 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5eb059-6d3e-4680-b507-f5cf519f42b4 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:36.649864 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5eb059-6d3e-4680-b507-f5cf519f42b4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:36.650131 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5eb059-6d3e-4680-b507-f5cf519f42b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:36.679254 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-0b5eb059-6d3e-4680-b507-f5cf519f42b4 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:36.680452 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0b5eb059-6d3e-4680-b507-f5cf519f42b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:36.713274 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 178/358] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:09:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 08:09:36.714653 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71ec9a-f32e-423a-b731-e59bb250f7cb None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:36.784322 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:36.795282 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 181/359] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:36.796240 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5eb059-6d3e-4680-b507-f5cf519f42b4 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:36.833601 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71ec9a-f32e-423a-b731-e59bb250f7cb None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:36.872376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895381d-d36f-4bf5-bcc2-c3d1ed8add58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:36.873432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895381d-d36f-4bf5-bcc2-c3d1ed8add58 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:36.873972 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895381d-d36f-4bf5-bcc2-c3d1ed8add58 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:36.874452 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895381d-d36f-4bf5-bcc2-c3d1ed8add58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:36.946258 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:36.953058 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895381d-d36f-4bf5-bcc2-c3d1ed8add58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:36.954144 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5eb059-6d3e-4680-b507-f5cf519f42b4 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:36.955098 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895381d-d36f-4bf5-bcc2-c3d1ed8add58 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:37.008185 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0c19f-c5fd-4db9-ab18-2a289e06412c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:37.009052 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0c19f-c5fd-4db9-ab18-2a289e06412c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:37.009322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0c19f-c5fd-4db9-ab18-2a289e06412c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:37.009591 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0c19f-c5fd-4db9-ab18-2a289e06412c None admin] PATH_INFO: `/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:37.015622 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb0c19f-c5fd-4db9-ab18-2a289e06412c None admin] RBAC: Authorizing `identity:get_project(project_id=a9d904b06eb24d5d8bce3f192f7927ca)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:37.017079 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb0c19f-c5fd-4db9-ab18-2a289e06412c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:37.018953 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 182/360] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:36 2022] GET /identity/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:37.021334 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0c19f-c5fd-4db9-ab18-2a289e06412c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:37.029942 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:37.078398 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 179/361] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:09:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 08:09:37.079594 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895381d-d36f-4bf5-bcc2-c3d1ed8add58 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:37.130812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0c19f-c5fd-4db9-ab18-2a289e06412c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:37.173292 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348b45e-ca34-470d-9126-2431f817e362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:37.174097 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348b45e-ca34-470d-9126-2431f817e362 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:37.174377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348b45e-ca34-470d-9126-2431f817e362 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:37.175204 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348b45e-ca34-470d-9126-2431f817e362 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:37.191044 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348b45e-ca34-470d-9126-2431f817e362 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:37.196301 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895381d-d36f-4bf5-bcc2-c3d1ed8add58 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:37.200749 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-6348b45e-ca34-470d-9126-2431f817e362 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 08:09:37.200749 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:37.200749 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:37.200749 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:37.200749 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:37.200749 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:37.200749 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:37.200749 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:37.200749 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:37.200749 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:37.200749 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:37.200749 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:37.200749 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:37.200749 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:37.200749 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:37.200749 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:37.201863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:37.201863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:37.201863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:37.201863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:37.201863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:37.201863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:37.201863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:37.201863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:37.201863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:37.201863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:37.201863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:37.201863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:37.201863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:37.201863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:37.201863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:37.201863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:37.202880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:37.202880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:37.202880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:37.202880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:37.202880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:37.202880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:37.202880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:37.202880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:37.202880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:37.202880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:37.202880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 08:09:37.202880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:37.202880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 183/362] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jun 4 08:09:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:37.202880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348b45e-ca34-470d-9126-2431f817e362 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:37.230229 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:37.239276 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e431c-1eb7-483a-b6d3-61ce55464dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:37.241092 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e431c-1eb7-483a-b6d3-61ce55464dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:37.241372 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e431c-1eb7-483a-b6d3-61ce55464dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:37.241649 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e431c-1eb7-483a-b6d3-61ce55464dd7 None admin] PATH_INFO: `/v3/groups/b8d888b135744995a345120b82c58779` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:37.243662 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e431c-1eb7-483a-b6d3-61ce55464dd7 None admin] RBAC: Authorizing `identity:get_group(group_id=b8d888b135744995a345120b82c58779)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:37.245364 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e431c-1eb7-483a-b6d3-61ce55464dd7 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:37.247264 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 180/363] 10.222.0.57 () {56 vars in 1180 bytes} [Sat Jun 4 08:09:37 2022] GET /identity/v3/groups/b8d888b135744995a345120b82c58779 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:37.248319 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049664ed-f193-47c9-bc3e-b9754fc9bea3 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:37.248601 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049664ed-f193-47c9-bc3e-b9754fc9bea3 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:37.248876 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049664ed-f193-47c9-bc3e-b9754fc9bea3 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:37.250143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 181/364] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:37.250841 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049664ed-f193-47c9-bc3e-b9754fc9bea3 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:37.293697 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:37.334293 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348b45e-ca34-470d-9126-2431f817e362 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:37.371016 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bf415-dc12-4c90-b823-4de0ddd502b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:37.371886 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bf415-dc12-4c90-b823-4de0ddd502b6 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:37.372168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bf415-dc12-4c90-b823-4de0ddd502b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:37.372440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bf415-dc12-4c90-b823-4de0ddd502b6 None admin] PATH_INFO: `/v3/projects/626251d4d31a465b966323ca5f3905d9` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:37.373641 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bf415-dc12-4c90-b823-4de0ddd502b6 None admin] RBAC: Authorizing `identity:get_project(project_id=626251d4d31a465b966323ca5f3905d9)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:37.375176 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bf415-dc12-4c90-b823-4de0ddd502b6 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:37.376855 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 184/365] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:37 2022] GET /identity/v3/projects/626251d4d31a465b966323ca5f3905d9 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:37.378080 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbab40-97c8-4fb0-92b9-b512a5c65f4a None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:37.378371 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbab40-97c8-4fb0-92b9-b512a5c65f4a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:37.378650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbab40-97c8-4fb0-92b9-b512a5c65f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:37.396278 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f4dbab40-97c8-4fb0-92b9-b512a5c65f4a None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:37.397395 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f4dbab40-97c8-4fb0-92b9-b512a5c65f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:37.400402 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049664ed-f193-47c9-bc3e-b9754fc9bea3 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:37.439650 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1c72c-8edf-46e4-98d1-762f6101eca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:37.440355 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1c72c-8edf-46e4-98d1-762f6101eca0 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:37.440639 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1c72c-8edf-46e4-98d1-762f6101eca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:37.440915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1c72c-8edf-46e4-98d1-762f6101eca0 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:37.441669 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1c72c-8edf-46e4-98d1-762f6101eca0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:37.442009 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1c72c-8edf-46e4-98d1-762f6101eca0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:37.443396 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1c72c-8edf-46e4-98d1-762f6101eca0 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:37.452486 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 182/366] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:09:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:37.453355 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1c72c-8edf-46e4-98d1-762f6101eca0 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:37.482685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 185/367] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:37.484318 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbab40-97c8-4fb0-92b9-b512a5c65f4a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:37.492627 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:37.575486 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:37.592873 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1c72c-8edf-46e4-98d1-762f6101eca0 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:37.609665 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbab40-97c8-4fb0-92b9-b512a5c65f4a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:37.633671 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059aeb37-1b76-44a0-9904-78d1e2369caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:37.634365 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059aeb37-1b76-44a0-9904-78d1e2369caa None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:37.634647 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059aeb37-1b76-44a0-9904-78d1e2369caa None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:37.634932 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059aeb37-1b76-44a0-9904-78d1e2369caa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:37.635771 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059aeb37-1b76-44a0-9904-78d1e2369caa None admin] RBAC: Adding query filter params (group.id=b8d888b135744995a345120b82c58779, role.id=b6177706a26446d5b4c540a3e97dee2e, scope.project.id=a9d904b06eb24d5d8bce3f192f7927ca) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:37.636086 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059aeb37-1b76-44a0-9904-78d1e2369caa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:37.637533 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059aeb37-1b76-44a0-9904-78d1e2369caa None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:37.646187 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 183/368] 10.222.0.57 () {56 vars in 1376 bytes} [Sat Jun 4 08:09:37 2022] GET /identity/v3/role_assignments?group.id=b8d888b135744995a345120b82c58779&scope.project.id=a9d904b06eb24d5d8bce3f192f7927ca&role.id=b6177706a26446d5b4c540a3e97dee2e => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:37.646830 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059aeb37-1b76-44a0-9904-78d1e2369caa None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:37.659895 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23a390-754f-4dfa-b142-88e913379f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:37.661632 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23a390-754f-4dfa-b142-88e913379f20 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:37.662132 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23a390-754f-4dfa-b142-88e913379f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:37.662592 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23a390-754f-4dfa-b142-88e913379f20 None admin] PATH_INFO: `/v3/groups/b8d888b135744995a345120b82c58779` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:37.664491 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23a390-754f-4dfa-b142-88e913379f20 None admin] RBAC: Authorizing `identity:get_group(group_id=b8d888b135744995a345120b82c58779)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:37.666681 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23a390-754f-4dfa-b142-88e913379f20 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:37.669993 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 186/369] 10.222.0.57 () {56 vars in 1180 bytes} [Sat Jun 4 08:09:37 2022] GET /identity/v3/groups/b8d888b135744995a345120b82c58779 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:37.671374 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23a390-754f-4dfa-b142-88e913379f20 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:37.776368 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059aeb37-1b76-44a0-9904-78d1e2369caa None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:37.787348 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:37.820468 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0577b25-5fe7-44af-8534-0f7f387a2ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:37.821516 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0577b25-5fe7-44af-8534-0f7f387a2ecb None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:37.822092 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0577b25-5fe7-44af-8534-0f7f387a2ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:37.823112 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23a390-754f-4dfa-b142-88e913379f20 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:37.823502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0577b25-5fe7-44af-8534-0f7f387a2ecb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:37.864218 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:37.878164 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d159c2-b607-4301-a5d4-f4e1b66ff1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:37.878982 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d159c2-b607-4301-a5d4-f4e1b66ff1b4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:37.879254 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d159c2-b607-4301-a5d4-f4e1b66ff1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:37.879696 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d159c2-b607-4301-a5d4-f4e1b66ff1b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:37.893619 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d159c2-b607-4301-a5d4-f4e1b66ff1b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:37.903390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-11d159c2-b607-4301-a5d4-f4e1b66ff1b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:09:37.903390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:37.903390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:37.903390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:37.903390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:37.903390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:37.903390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:37.903390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:37.903390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:37.903390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:37.903390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:37.903390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:37.903390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:37.903390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:37.903390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:37.903390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:37.904298 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:37.904298 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:37.904298 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:37.904298 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:37.904298 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:37.904298 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:37.904298 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:37.904298 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:37.904298 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:37.904298 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:37.904298 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:37.904298 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:37.904298 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:37.904298 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:37.904298 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:37.904298 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:37.905101 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:37.905101 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:37.905101 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:37.905101 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:37.905101 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:37.905101 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:37.905101 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:37.905101 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:37.905101 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:37.905101 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:37.905101 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:09:37.905101 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:37.905721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 187/370] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:09:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:37.906178 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d159c2-b607-4301-a5d4-f4e1b66ff1b4 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:37.925565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0577b25-5fe7-44af-8534-0f7f387a2ecb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:37.927191 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0577b25-5fe7-44af-8534-0f7f387a2ecb None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:38.045347 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d159c2-b607-4301-a5d4-f4e1b66ff1b4 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:38.062624 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 184/371] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:09:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 08:09:38.063557 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0577b25-5fe7-44af-8534-0f7f387a2ecb None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:38.092526 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc9d87-b8cd-4d21-828a-94f068d389ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:38.093670 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc9d87-b8cd-4d21-828a-94f068d389ff None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:38.094115 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc9d87-b8cd-4d21-828a-94f068d389ff None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:38.094401 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc9d87-b8cd-4d21-828a-94f068d389ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:38.095252 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc9d87-b8cd-4d21-828a-94f068d389ff None admin] RBAC: Adding query filter params (group.id=b8d888b135744995a345120b82c58779, role.id=314f0b44fb344a99bdda986e7b4ac3ab, scope.project.id=626251d4d31a465b966323ca5f3905d9) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:38.095574 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc9d87-b8cd-4d21-828a-94f068d389ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:38.097618 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc9d87-b8cd-4d21-828a-94f068d389ff None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:38.100406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:38.105242 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 188/372] 10.222.0.57 () {56 vars in 1376 bytes} [Sat Jun 4 08:09:37 2022] GET /identity/v3/role_assignments?group.id=b8d888b135744995a345120b82c58779&scope.project.id=626251d4d31a465b966323ca5f3905d9&role.id=314f0b44fb344a99bdda986e7b4ac3ab => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:38.106351 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc9d87-b8cd-4d21-828a-94f068d389ff None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:38.158340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:38.205488 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0577b25-5fe7-44af-8534-0f7f387a2ecb None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:38.246161 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc9d87-b8cd-4d21-828a-94f068d389ff None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:38.255677 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e319e-e4e5-4360-b75b-acc0924968fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:38.256371 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e319e-e4e5-4360-b75b-acc0924968fe None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:38.256661 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e319e-e4e5-4360-b75b-acc0924968fe None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:38.256936 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e319e-e4e5-4360-b75b-acc0924968fe None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:38.257995 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e319e-e4e5-4360-b75b-acc0924968fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:38.258351 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e319e-e4e5-4360-b75b-acc0924968fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:38.259821 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e319e-e4e5-4360-b75b-acc0924968fe None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:38.272520 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 185/373] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:38.277968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e319e-e4e5-4360-b75b-acc0924968fe None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:38.301032 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365630b-dac8-42bc-aab2-548cfd04b78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:38.302055 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365630b-dac8-42bc-aab2-548cfd04b78e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:38.303596 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365630b-dac8-42bc-aab2-548cfd04b78e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:38.305611 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365630b-dac8-42bc-aab2-548cfd04b78e None admin] PATH_INFO: `/v3/projects/626251d4d31a465b966323ca5f3905d9` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:38.307831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365630b-dac8-42bc-aab2-548cfd04b78e None admin] RBAC: Authorizing `identity:get_project(project_id=626251d4d31a465b966323ca5f3905d9)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:38.313694 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365630b-dac8-42bc-aab2-548cfd04b78e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:38.315916 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 189/374] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:38 2022] GET /identity/v3/projects/626251d4d31a465b966323ca5f3905d9 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:38.322881 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365630b-dac8-42bc-aab2-548cfd04b78e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:38.452817 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:38.469349 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e319e-e4e5-4360-b75b-acc0924968fe None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:38.501031 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:38.517608 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365630b-dac8-42bc-aab2-548cfd04b78e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:38.531975 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86ce9f-ae46-45c2-8cc0-a968ed29f0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:38.532696 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86ce9f-ae46-45c2-8cc0-a968ed29f0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:38.532980 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86ce9f-ae46-45c2-8cc0-a968ed29f0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:38.533256 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86ce9f-ae46-45c2-8cc0-a968ed29f0b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:38.588117 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb0eb1-2193-485f-acde-a1ee179b6789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:38.589005 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb0eb1-2193-485f-acde-a1ee179b6789 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:38.589286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb0eb1-2193-485f-acde-a1ee179b6789 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:38.590277 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb0eb1-2193-485f-acde-a1ee179b6789 None admin] PATH_INFO: `/v3/groups/b8d888b135744995a345120b82c58779` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:38.591666 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb0eb1-2193-485f-acde-a1ee179b6789 None admin] RBAC: Authorizing `identity:get_group(group_id=b8d888b135744995a345120b82c58779)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:38.594337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb0eb1-2193-485f-acde-a1ee179b6789 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:38.598020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 190/375] 10.222.0.57 () {56 vars in 1180 bytes} [Sat Jun 4 08:09:38 2022] GET /identity/v3/groups/b8d888b135744995a345120b82c58779 => generated 226 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:38.606184 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb0eb1-2193-485f-acde-a1ee179b6789 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:38.658417 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86ce9f-ae46-45c2-8cc0-a968ed29f0b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:38.659991 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86ce9f-ae46-45c2-8cc0-a968ed29f0b5 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:38.724764 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb0eb1-2193-485f-acde-a1ee179b6789 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:38.760460 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef87381-3d8e-4a59-9cc9-fe75bfee58d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:38.761124 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef87381-3d8e-4a59-9cc9-fe75bfee58d7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:38.761409 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef87381-3d8e-4a59-9cc9-fe75bfee58d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:38.761682 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef87381-3d8e-4a59-9cc9-fe75bfee58d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:38.762553 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef87381-3d8e-4a59-9cc9-fe75bfee58d7 None admin] RBAC: Adding query filter params (group.id=b8d888b135744995a345120b82c58779, role.id=b6177706a26446d5b4c540a3e97dee2e, scope.project.id=626251d4d31a465b966323ca5f3905d9) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:38.762865 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef87381-3d8e-4a59-9cc9-fe75bfee58d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:38.764305 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef87381-3d8e-4a59-9cc9-fe75bfee58d7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:38.770262 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 191/376] 10.222.0.57 () {56 vars in 1376 bytes} [Sat Jun 4 08:09:38 2022] GET /identity/v3/role_assignments?group.id=b8d888b135744995a345120b82c58779&scope.project.id=626251d4d31a465b966323ca5f3905d9&role.id=b6177706a26446d5b4c540a3e97dee2e => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:38.771531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c010ed6-c9ef-4e4d-9b7c-5ac59b8e59b8 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:38.771822 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c010ed6-c9ef-4e4d-9b7c-5ac59b8e59b8 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:38.772097 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c010ed6-c9ef-4e4d-9b7c-5ac59b8e59b8 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:38.777166 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 186/377] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:09:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 08:09:38.782393 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:38.783593 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86ce9f-ae46-45c2-8cc0-a968ed29f0b5 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:38.784862 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 192/378] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:38 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:38.790667 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0de27-91be-45e1-83d3-6a6ca046070f None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:38.791943 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0de27-91be-45e1-83d3-6a6ca046070f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:38.792319 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0de27-91be-45e1-83d3-6a6ca046070f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:38.822198 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:38.832715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-fda0de27-91be-45e1-83d3-6a6ca046070f None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:38.834032 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-fda0de27-91be-45e1-83d3-6a6ca046070f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:38.956433 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 193/379] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 08:09:38.980006 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0de27-91be-45e1-83d3-6a6ca046070f None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:39.021917 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86ce9f-ae46-45c2-8cc0-a968ed29f0b5 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:39.088433 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c365abf-7163-48c1-9369-19484862fe64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:39.089223 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c365abf-7163-48c1-9369-19484862fe64 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:39.089508 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c365abf-7163-48c1-9369-19484862fe64 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:39.089784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c365abf-7163-48c1-9369-19484862fe64 None admin] PATH_INFO: `/v3/projects/51efa731295b432199d02f2f22ada384` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:39.094622 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c365abf-7163-48c1-9369-19484862fe64 None admin] RBAC: Authorizing `identity:get_project(project_id=51efa731295b432199d02f2f22ada384)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:39.096104 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c365abf-7163-48c1-9369-19484862fe64 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:39.098845 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 187/380] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:38 2022] GET /identity/v3/projects/51efa731295b432199d02f2f22ada384 => generated 344 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:39.104319 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c365abf-7163-48c1-9369-19484862fe64 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:39.160823 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0de27-91be-45e1-83d3-6a6ca046070f None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:39.207099 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:39.214933 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:39.225806 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c365abf-7163-48c1-9369-19484862fe64 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:39.228617 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28252b32-7ae8-4863-bcd0-3e0d07c733bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:39.229995 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28252b32-7ae8-4863-bcd0-3e0d07c733bb None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:39.230528 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28252b32-7ae8-4863-bcd0-3e0d07c733bb None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:39.231008 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28252b32-7ae8-4863-bcd0-3e0d07c733bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:39.245114 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28252b32-7ae8-4863-bcd0-3e0d07c733bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:39.254272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-28252b32-7ae8-4863-bcd0-3e0d07c733bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:09:39.254272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:39.254272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:39.254272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:39.254272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:39.254272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:39.254272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:39.254272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:39.254272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:39.254272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:39.254272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:39.254272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:39.254272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:39.254272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:39.254272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:39.254272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:39.255699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:39.255699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:39.255699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:39.255699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:39.255699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:39.255699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:39.255699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:39.255699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:39.255699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:39.255699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:39.255699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:39.255699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:39.255699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:39.255699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:39.255699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:39.255699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:39.256502 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:39.256502 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:39.256502 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:39.256502 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:39.256502 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:39.256502 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:39.256502 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:39.256502 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:39.256502 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:39.256502 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:39.256502 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:09:39.256502 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:39.259019 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 194/381] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:09:39.265627 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28252b32-7ae8-4863-bcd0-3e0d07c733bb None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:39.287100 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbead0ff-27cc-4bda-937c-eb86f3635f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:39.287967 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbead0ff-27cc-4bda-937c-eb86f3635f76 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:39.288251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbead0ff-27cc-4bda-937c-eb86f3635f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:39.288533 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbead0ff-27cc-4bda-937c-eb86f3635f76 None admin] PATH_INFO: `/v3/groups/c966bde2cb6049db9bd93a7dade9b237` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:39.302714 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbead0ff-27cc-4bda-937c-eb86f3635f76 None admin] RBAC: Authorizing `identity:get_group(group_id=c966bde2cb6049db9bd93a7dade9b237)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:39.304251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbead0ff-27cc-4bda-937c-eb86f3635f76 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:39.309867 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 188/382] 10.222.0.57 () {56 vars in 1180 bytes} [Sat Jun 4 08:09:39 2022] GET /identity/v3/groups/c966bde2cb6049db9bd93a7dade9b237 => generated 229 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:39.312003 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbead0ff-27cc-4bda-937c-eb86f3635f76 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:39.418921 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28252b32-7ae8-4863-bcd0-3e0d07c733bb None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:39.425705 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbead0ff-27cc-4bda-937c-eb86f3635f76 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:39.462346 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e64918-eb15-4218-8aba-e05a9ff7b334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:39.463011 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e64918-eb15-4218-8aba-e05a9ff7b334 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:39.463303 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e64918-eb15-4218-8aba-e05a9ff7b334 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:39.463578 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e64918-eb15-4218-8aba-e05a9ff7b334 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:39.464414 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e64918-eb15-4218-8aba-e05a9ff7b334 None admin] RBAC: Adding query filter params (group.id=c966bde2cb6049db9bd93a7dade9b237, role.id=431cef539cfb476aad50d2470e763b5f, scope.project.id=51efa731295b432199d02f2f22ada384) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:39.467431 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e64918-eb15-4218-8aba-e05a9ff7b334 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:39.467431 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e64918-eb15-4218-8aba-e05a9ff7b334 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:39.477984 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 189/383] 10.222.0.57 () {56 vars in 1376 bytes} [Sat Jun 4 08:09:39 2022] GET /identity/v3/role_assignments?group.id=c966bde2cb6049db9bd93a7dade9b237&scope.project.id=51efa731295b432199d02f2f22ada384&role.id=431cef539cfb476aad50d2470e763b5f => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:39.482751 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa35b62-8b05-496c-b19e-7a8fec8297e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:39.483773 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa35b62-8b05-496c-b19e-7a8fec8297e4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:39.484259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa35b62-8b05-496c-b19e-7a8fec8297e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:39.484733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa35b62-8b05-496c-b19e-7a8fec8297e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:39.485800 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa35b62-8b05-496c-b19e-7a8fec8297e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:39.486497 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa35b62-8b05-496c-b19e-7a8fec8297e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:39.493853 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa35b62-8b05-496c-b19e-7a8fec8297e4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:39.512688 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 195/384] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jun 4 08:09:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:39.518729 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e64918-eb15-4218-8aba-e05a9ff7b334 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:39.556822 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:39.668173 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e64918-eb15-4218-8aba-e05a9ff7b334 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:39.721656 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4481c-7ccd-4088-834d-b9f377d2dbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:39.722616 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4481c-7ccd-4088-834d-b9f377d2dbe4 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:39.722902 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4481c-7ccd-4088-834d-b9f377d2dbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:39.723173 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4481c-7ccd-4088-834d-b9f377d2dbe4 None admin] PATH_INFO: `/v3/groups/b8d888b135744995a345120b82c58779` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:39.730809 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4481c-7ccd-4088-834d-b9f377d2dbe4 None admin] RBAC: Authorizing `identity:get_group(group_id=b8d888b135744995a345120b82c58779)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:39.732317 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4481c-7ccd-4088-834d-b9f377d2dbe4 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:39.734157 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 190/385] 10.222.0.57 () {56 vars in 1180 bytes} [Sat Jun 4 08:09:39 2022] GET /identity/v3/groups/b8d888b135744995a345120b82c58779 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:39.742980 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa35b62-8b05-496c-b19e-7a8fec8297e4 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:39.849188 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:39.908749 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa35b62-8b05-496c-b19e-7a8fec8297e4 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:39.950016 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf127c2-97fb-4202-8731-561fe44cab89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:39.950885 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf127c2-97fb-4202-8731-561fe44cab89 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:39.951168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf127c2-97fb-4202-8731-561fe44cab89 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:39.951441 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf127c2-97fb-4202-8731-561fe44cab89 None admin] PATH_INFO: `/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:39.952636 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf127c2-97fb-4202-8731-561fe44cab89 None admin] RBAC: Authorizing `identity:get_project(project_id=a9d904b06eb24d5d8bce3f192f7927ca)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:39.954154 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf127c2-97fb-4202-8731-561fe44cab89 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:39.956048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 196/386] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:39 2022] GET /identity/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:39.961513 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4481c-7ccd-4088-834d-b9f377d2dbe4 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:40.079536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:40.101033 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4481c-7ccd-4088-834d-b9f377d2dbe4 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:40.136155 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b685b-469d-4a15-93a6-33d49eb015ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:40.137040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b685b-469d-4a15-93a6-33d49eb015ba None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:40.137322 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b685b-469d-4a15-93a6-33d49eb015ba None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:40.137598 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b685b-469d-4a15-93a6-33d49eb015ba None admin] PATH_INFO: `/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca/groups/b8d888b135744995a345120b82c58779/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:40.139609 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b685b-469d-4a15-93a6-33d49eb015ba None admin] RBAC: Authorizing `identity:create_grant(project_id=a9d904b06eb24d5d8bce3f192f7927ca, group_id=b8d888b135744995a345120b82c58779, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:40.141070 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b685b-469d-4a15-93a6-33d49eb015ba None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:40.167791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 191/387] 10.222.0.57 () {58 vars in 1442 bytes} [Sat Jun 4 08:09:39 2022] PUT /identity/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca/groups/b8d888b135744995a345120b82c58779/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:09:40.320294 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e69b38-4c87-4afa-891d-719f87ae46c7 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:40.321279 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e69b38-4c87-4afa-891d-719f87ae46c7 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:40.321789 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e69b38-4c87-4afa-891d-719f87ae46c7 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:40.323396 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 197/388] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:40.329067 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fb3be-9813-457b-b462-36ecf9f9764d None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:40.329703 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fb3be-9813-457b-b462-36ecf9f9764d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:40.330216 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fb3be-9813-457b-b462-36ecf9f9764d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:40.352087 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-030fb3be-9813-457b-b462-36ecf9f9764d None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:40.353614 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-030fb3be-9813-457b-b462-36ecf9f9764d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:40.450694 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 192/389] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:40.482510 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e69b38-4c87-4afa-891d-719f87ae46c7 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:40.618128 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e69b38-4c87-4afa-891d-719f87ae46c7 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:40.640583 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:40.663211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda7083-b235-4f41-876a-e75cbe1170c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:40.664289 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda7083-b235-4f41-876a-e75cbe1170c8 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:40.664717 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda7083-b235-4f41-876a-e75cbe1170c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:40.665149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda7083-b235-4f41-876a-e75cbe1170c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:40.679168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda7083-b235-4f41-876a-e75cbe1170c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:40.687740 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-0dda7083-b235-4f41-876a-e75cbe1170c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 08:09:40.687740 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:40.687740 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:40.687740 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:40.687740 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:40.687740 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:40.687740 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:40.687740 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:40.687740 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:40.687740 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:40.687740 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:40.687740 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:40.687740 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:40.687740 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:40.687740 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:40.687740 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:40.688833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:40.688833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:40.688833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:40.688833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:40.688833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:40.688833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:40.688833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:40.688833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:40.688833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:40.688833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:40.688833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:40.688833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:40.688833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:40.688833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:40.688833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:40.688833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:40.689870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:40.689870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:40.689870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:40.689870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:40.689870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:40.689870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:40.689870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:40.689870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:40.689870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:40.689870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:40.689870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 08:09:40.689870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:40.692769 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 198/390] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jun 4 08:09:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:40.698623 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fb3be-9813-457b-b462-36ecf9f9764d None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:40.776848 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:40.814197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fb3be-9813-457b-b462-36ecf9f9764d None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:40.860063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3cd767-22d3-4c86-b43a-fc79df1ab96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:40.860981 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cd767-22d3-4c86-b43a-fc79df1ab96c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:40.861405 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cd767-22d3-4c86-b43a-fc79df1ab96c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:40.861835 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cd767-22d3-4c86-b43a-fc79df1ab96c None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:40.862773 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3cd767-22d3-4c86-b43a-fc79df1ab96c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:40.863257 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3cd767-22d3-4c86-b43a-fc79df1ab96c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:40.864828 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3cd767-22d3-4c86-b43a-fc79df1ab96c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:40.877184 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 193/391] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:09:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:40.883470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda7083-b235-4f41-876a-e75cbe1170c8 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:40.975826 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217c495-56c4-487e-bd94-388c5611a0c9 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:40.976161 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217c495-56c4-487e-bd94-388c5611a0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:40.976385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217c495-56c4-487e-bd94-388c5611a0c9 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:40.977956 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 194/392] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:40.983217 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549ce3a-72cd-4503-b0ec-56dd9eef0e92 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:40.983766 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549ce3a-72cd-4503-b0ec-56dd9eef0e92 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:40.984242 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549ce3a-72cd-4503-b0ec-56dd9eef0e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:41.010819 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-2549ce3a-72cd-4503-b0ec-56dd9eef0e92 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:41.011431 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda7083-b235-4f41-876a-e75cbe1170c8 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:41.012003 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2549ce3a-72cd-4503-b0ec-56dd9eef0e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:41.048015 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafd4cf-35de-44bc-942e-ca7c1520e9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:41.048877 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafd4cf-35de-44bc-942e-ca7c1520e9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:41.049155 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafd4cf-35de-44bc-942e-ca7c1520e9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:41.049432 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafd4cf-35de-44bc-942e-ca7c1520e9f4 None admin] PATH_INFO: `/v3/groups/b8d888b135744995a345120b82c58779` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:41.051192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafd4cf-35de-44bc-942e-ca7c1520e9f4 None admin] RBAC: Authorizing `identity:get_group(group_id=b8d888b135744995a345120b82c58779)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:41.052645 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafd4cf-35de-44bc-942e-ca7c1520e9f4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:41.054972 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 199/393] 10.222.0.57 () {56 vars in 1180 bytes} [Sat Jun 4 08:09:40 2022] GET /identity/v3/groups/b8d888b135744995a345120b82c58779 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:41.059932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafd4cf-35de-44bc-942e-ca7c1520e9f4 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:41.115711 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:41.124731 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 195/394] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 08:09:41.156452 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549ce3a-72cd-4503-b0ec-56dd9eef0e92 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:41.184704 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafd4cf-35de-44bc-942e-ca7c1520e9f4 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:41.249529 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d0a44-3f07-4a83-90e4-252bf795871a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:41.250416 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d0a44-3f07-4a83-90e4-252bf795871a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:41.250699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d0a44-3f07-4a83-90e4-252bf795871a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:41.250973 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d0a44-3f07-4a83-90e4-252bf795871a None admin] PATH_INFO: `/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:41.252191 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d0a44-3f07-4a83-90e4-252bf795871a None admin] RBAC: Authorizing `identity:get_project(project_id=a9d904b06eb24d5d8bce3f192f7927ca)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:41.259186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d0a44-3f07-4a83-90e4-252bf795871a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:41.262030 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 200/395] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:41 2022] GET /identity/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:41.269131 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d0a44-3f07-4a83-90e4-252bf795871a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:41.274191 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:41.339226 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549ce3a-72cd-4503-b0ec-56dd9eef0e92 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:41.404890 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9791555-8a4f-4792-9b80-4d999dc0a689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:41.405743 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9791555-8a4f-4792-9b80-4d999dc0a689 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:41.406050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9791555-8a4f-4792-9b80-4d999dc0a689 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:41.406323 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9791555-8a4f-4792-9b80-4d999dc0a689 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:41.426960 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9791555-8a4f-4792-9b80-4d999dc0a689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:41.439897 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-d9791555-8a4f-4792-9b80-4d999dc0a689 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:09:41.439897 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:41.439897 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:41.439897 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:41.439897 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:41.439897 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:41.439897 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:41.439897 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:41.439897 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:41.439897 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:41.439897 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:41.439897 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:41.439897 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:41.439897 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:41.439897 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:41.439897 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:41.443536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:41.443536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:41.443536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:41.443536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:41.443536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:41.443536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:41.443536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:41.443536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:41.443536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:41.443536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:41.443536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:41.443536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:41.443536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:41.443536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:41.443536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:41.443536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:41.445565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:41.445565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:41.445565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:41.445565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:41.445565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:41.445565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:41.445565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:41.445565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:41.445565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:41.445565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:41.445565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:09:41.445565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:41.445565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 196/396] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:09:41.452088 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9791555-8a4f-4792-9b80-4d999dc0a689 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:41.458425 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d0a44-3f07-4a83-90e4-252bf795871a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:41.482823 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:41.515890 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a124b-a1a5-4753-accd-c3db0a7739c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:41.516969 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a124b-a1a5-4753-accd-c3db0a7739c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:41.517862 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a124b-a1a5-4753-accd-c3db0a7739c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:41.517862 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a124b-a1a5-4753-accd-c3db0a7739c0 None admin] PATH_INFO: `/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca/groups/b8d888b135744995a345120b82c58779/roles/b6177706a26446d5b4c540a3e97dee2e` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:41.521183 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a124b-a1a5-4753-accd-c3db0a7739c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=a9d904b06eb24d5d8bce3f192f7927ca, group_id=b8d888b135744995a345120b82c58779, role_id=b6177706a26446d5b4c540a3e97dee2e)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:41.522848 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a124b-a1a5-4753-accd-c3db0a7739c0 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:41.551776 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 201/397] 10.222.0.57 () {58 vars in 1442 bytes} [Sat Jun 4 08:09:41 2022] PUT /identity/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca/groups/b8d888b135744995a345120b82c58779/roles/b6177706a26446d5b4c540a3e97dee2e => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:09:41.613434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9791555-8a4f-4792-9b80-4d999dc0a689 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:41.639431 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:41.652285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc8769-53a8-42d0-aa14-92c56d56dbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:41.653119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc8769-53a8-42d0-aa14-92c56d56dbef None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:41.653503 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc8769-53a8-42d0-aa14-92c56d56dbef None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:41.653915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc8769-53a8-42d0-aa14-92c56d56dbef None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:41.654799 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc8769-53a8-42d0-aa14-92c56d56dbef None admin] RBAC: Adding query filter params (name=member) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:41.655204 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc8769-53a8-42d0-aa14-92c56d56dbef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:41.656761 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc8769-53a8-42d0-aa14-92c56d56dbef None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:41.667711 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 197/398] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jun 4 08:09:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:41.673925 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a124b-a1a5-4753-accd-c3db0a7739c0 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:41.805367 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a124b-a1a5-4753-accd-c3db0a7739c0 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:41.844165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c16ec-39b0-4d84-b4f4-9aa0d0fbe8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:41.845034 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c16ec-39b0-4d84-b4f4-9aa0d0fbe8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:41.845318 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c16ec-39b0-4d84-b4f4-9aa0d0fbe8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:41.845593 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c16ec-39b0-4d84-b4f4-9aa0d0fbe8d8 None admin] PATH_INFO: `/v3/groups/b8d888b135744995a345120b82c58779` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:41.847400 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c16ec-39b0-4d84-b4f4-9aa0d0fbe8d8 None admin] RBAC: Authorizing `identity:get_group(group_id=b8d888b135744995a345120b82c58779)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:41.848868 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c16ec-39b0-4d84-b4f4-9aa0d0fbe8d8 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:41.850887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 202/399] 10.222.0.57 () {56 vars in 1180 bytes} [Sat Jun 4 08:09:41 2022] GET /identity/v3/groups/b8d888b135744995a345120b82c58779 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:41.858966 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc8769-53a8-42d0-aa14-92c56d56dbef None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:42.011312 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc8769-53a8-42d0-aa14-92c56d56dbef None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:42.054685 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d15ef-a4ad-4f1f-acd5-6effda57081b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:42.055616 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d15ef-a4ad-4f1f-acd5-6effda57081b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:42.055843 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d15ef-a4ad-4f1f-acd5-6effda57081b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:42.056119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d15ef-a4ad-4f1f-acd5-6effda57081b None admin] PATH_INFO: `/v3/projects/626251d4d31a465b966323ca5f3905d9` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:42.057339 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d15ef-a4ad-4f1f-acd5-6effda57081b None admin] RBAC: Authorizing `identity:get_project(project_id=626251d4d31a465b966323ca5f3905d9)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:42.058884 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d15ef-a4ad-4f1f-acd5-6effda57081b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:42.060599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 198/400] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:41 2022] GET /identity/v3/projects/626251d4d31a465b966323ca5f3905d9 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:42.066505 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c16ec-39b0-4d84-b4f4-9aa0d0fbe8d8 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:42.118186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:42.189266 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c16ec-39b0-4d84-b4f4-9aa0d0fbe8d8 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:42.227293 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d627be-a11c-4d39-82c0-a888757523e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:42.228176 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d627be-a11c-4d39-82c0-a888757523e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:42.228457 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d627be-a11c-4d39-82c0-a888757523e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:42.228734 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d627be-a11c-4d39-82c0-a888757523e3 None admin] PATH_INFO: `/v3/projects/626251d4d31a465b966323ca5f3905d9/groups/b8d888b135744995a345120b82c58779/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:42.230741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d627be-a11c-4d39-82c0-a888757523e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=626251d4d31a465b966323ca5f3905d9, group_id=b8d888b135744995a345120b82c58779, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:42.232248 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d627be-a11c-4d39-82c0-a888757523e3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:42.256970 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 203/401] 10.222.0.57 () {58 vars in 1442 bytes} [Sat Jun 4 08:09:42 2022] PUT /identity/v3/projects/626251d4d31a465b966323ca5f3905d9/groups/b8d888b135744995a345120b82c58779/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:09:42.454530 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f7684-c25d-4036-af40-161dd4c4cb03 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:42.455031 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f7684-c25d-4036-af40-161dd4c4cb03 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:42.455031 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f7684-c25d-4036-af40-161dd4c4cb03 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:42.456948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 199/402] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:42.462578 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507777ea-e0a9-4edf-aab9-0cfa3c40eba8 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:42.463073 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507777ea-e0a9-4edf-aab9-0cfa3c40eba8 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:42.463147 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507777ea-e0a9-4edf-aab9-0cfa3c40eba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:42.487495 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-507777ea-e0a9-4edf-aab9-0cfa3c40eba8 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:42.488748 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-507777ea-e0a9-4edf-aab9-0cfa3c40eba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:42.498264 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bd253-3980-40c4-a616-fa356ec1319d None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:42.498605 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bd253-3980-40c4-a616-fa356ec1319d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:42.498948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bd253-3980-40c4-a616-fa356ec1319d None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:42.500538 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 200/403] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:42.515790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff672d82-64cb-4626-a56c-a0417e63d083 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:42.516098 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff672d82-64cb-4626-a56c-a0417e63d083 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:42.516354 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff672d82-64cb-4626-a56c-a0417e63d083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:42.540936 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-ff672d82-64cb-4626-a56c-a0417e63d083 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:42.542731 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ff672d82-64cb-4626-a56c-a0417e63d083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:42.599501 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:42.602154 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 204/404] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:42.624720 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 201/405] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 08:09:42.634377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507777ea-e0a9-4edf-aab9-0cfa3c40eba8 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:42.650713 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff672d82-64cb-4626-a56c-a0417e63d083 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:42.673447 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:42.773864 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff672d82-64cb-4626-a56c-a0417e63d083 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:42.809964 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35987116-2ea2-454f-84b0-abcda337981e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:42.810767 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35987116-2ea2-454f-84b0-abcda337981e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:42.811049 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35987116-2ea2-454f-84b0-abcda337981e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:42.811379 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35987116-2ea2-454f-84b0-abcda337981e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:42.822785 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35987116-2ea2-454f-84b0-abcda337981e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:42.831085 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-35987116-2ea2-454f-84b0-abcda337981e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:09:42.831085 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:42.831085 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:42.831085 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:42.831085 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:42.831085 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:42.831085 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:42.831085 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:42.831085 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:42.831085 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:42.831085 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:42.831085 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:42.831085 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:42.831085 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:42.831085 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:42.831085 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:42.832041 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:42.832041 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:42.832041 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:42.832041 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:42.832041 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:42.832041 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:42.832041 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:42.832041 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:42.832041 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:42.832041 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:42.832041 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:42.832041 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:42.832041 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:42.832041 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:42.832041 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:42.832041 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:42.832850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:42.832850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:42.832850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:42.832850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:42.832850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:42.832850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:42.832850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:42.832850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:42.832850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:42.832850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:42.832850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:09:42.832850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:42.832850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 202/406] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:09:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:09:42.838050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35987116-2ea2-454f-84b0-abcda337981e None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:42.852629 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507777ea-e0a9-4edf-aab9-0cfa3c40eba8 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:42.890186 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:42.953968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35987116-2ea2-454f-84b0-abcda337981e None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:42.978927 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00fa85e-c144-46d0-bd2a-974383360303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:42.979747 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fa85e-c144-46d0-bd2a-974383360303 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:42.980025 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fa85e-c144-46d0-bd2a-974383360303 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:42.980295 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fa85e-c144-46d0-bd2a-974383360303 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:43.003488 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00fa85e-c144-46d0-bd2a-974383360303 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:43.018045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-c00fa85e-c144-46d0-bd2a-974383360303 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 08:09:43.018045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:43.018045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:43.018045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:43.018045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:43.018045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:43.018045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:43.018045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:43.018045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:43.018045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:43.018045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:43.018045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:43.018045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:43.018045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:43.018045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:43.018045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:43.020215 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:43.020215 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:43.020215 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:43.020215 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:43.020215 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:43.020215 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:43.020215 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:43.020215 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:43.020215 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:43.020215 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:43.020215 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:43.020215 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:43.020215 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:43.020215 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:43.020215 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:43.020215 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:43.022243 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:43.022243 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:43.022243 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:43.022243 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:43.022243 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:43.022243 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:43.022243 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:43.022243 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:43.022243 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:43.022243 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:43.022243 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 08:09:43.022243 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:43.022243 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 205/407] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jun 4 08:09:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:43.026674 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7834573-99e6-4d01-9000-77bd0a646a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:43.027357 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7834573-99e6-4d01-9000-77bd0a646a19 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:43.027645 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7834573-99e6-4d01-9000-77bd0a646a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:43.027925 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7834573-99e6-4d01-9000-77bd0a646a19 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:43.028688 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7834573-99e6-4d01-9000-77bd0a646a19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:43.028998 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7834573-99e6-4d01-9000-77bd0a646a19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:43.030648 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00fa85e-c144-46d0-bd2a-974383360303 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:43.031692 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7834573-99e6-4d01-9000-77bd0a646a19 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:43.047715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 203/408] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:43.053763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7834573-99e6-4d01-9000-77bd0a646a19 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:43.145972 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:43.155735 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00fa85e-c144-46d0-bd2a-974383360303 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:43.195988 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507202d4-6855-4369-9919-773d5e042d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:43.196659 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507202d4-6855-4369-9919-773d5e042d65 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:43.196942 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507202d4-6855-4369-9919-773d5e042d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:43.197217 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507202d4-6855-4369-9919-773d5e042d65 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:43.198450 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507202d4-6855-4369-9919-773d5e042d65 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:43.198822 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507202d4-6855-4369-9919-773d5e042d65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:43.200280 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507202d4-6855-4369-9919-773d5e042d65 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:43.209698 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 206/409] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:09:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:43.215543 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507202d4-6855-4369-9919-773d5e042d65 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:43.329762 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507202d4-6855-4369-9919-773d5e042d65 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:43.333792 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7834573-99e6-4d01-9000-77bd0a646a19 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:43.365113 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:43.366205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebf0c2-c7a8-4189-b59c-50605b775308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:43.367069 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebf0c2-c7a8-4189-b59c-50605b775308 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:43.367355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebf0c2-c7a8-4189-b59c-50605b775308 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:43.367628 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebf0c2-c7a8-4189-b59c-50605b775308 None admin] PATH_INFO: `/v3/groups/b8d888b135744995a345120b82c58779` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:43.368929 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ebf0c2-c7a8-4189-b59c-50605b775308 None admin] RBAC: Authorizing `identity:get_group(group_id=b8d888b135744995a345120b82c58779)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:43.370481 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ebf0c2-c7a8-4189-b59c-50605b775308 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:43.370790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8f02e-0035-40c0-8395-afeb9e85ea0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:43.371661 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8f02e-0035-40c0-8395-afeb9e85ea0b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:43.371946 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8f02e-0035-40c0-8395-afeb9e85ea0b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:43.372229 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8f02e-0035-40c0-8395-afeb9e85ea0b None admin] PATH_INFO: `/v3/groups/c966bde2cb6049db9bd93a7dade9b237` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:43.372412 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 207/410] 10.222.0.57 () {56 vars in 1180 bytes} [Sat Jun 4 08:09:43 2022] GET /identity/v3/groups/b8d888b135744995a345120b82c58779 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:43.373559 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a8f02e-0035-40c0-8395-afeb9e85ea0b None admin] RBAC: Authorizing `identity:get_group(group_id=c966bde2cb6049db9bd93a7dade9b237)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:43.373670 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f108a-714e-41f8-8f24-25f49851d760 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:43.375106 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a8f02e-0035-40c0-8395-afeb9e85ea0b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:43.378156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f108a-714e-41f8-8f24-25f49851d760 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:43.378502 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f108a-714e-41f8-8f24-25f49851d760 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:43.379800 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 208/411] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:43.380514 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f108a-714e-41f8-8f24-25f49851d760 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:43.382069 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 204/412] 10.222.0.57 () {56 vars in 1180 bytes} [Sat Jun 4 08:09:43 2022] GET /identity/v3/groups/c966bde2cb6049db9bd93a7dade9b237 => generated 229 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:43.383852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8f02e-0035-40c0-8395-afeb9e85ea0b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:43.411924 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:43.493533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f108a-714e-41f8-8f24-25f49851d760 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:43.495147 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8f02e-0035-40c0-8395-afeb9e85ea0b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:43.529531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36f878-daaf-4116-94ee-cc55b3a438c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:43.530635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36f878-daaf-4116-94ee-cc55b3a438c3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:43.531092 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36f878-daaf-4116-94ee-cc55b3a438c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:43.531588 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e025d1dc-5782-44a9-8672-7d15d527b6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:43.531716 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36f878-daaf-4116-94ee-cc55b3a438c3 None admin] PATH_INFO: `/v3/projects/626251d4d31a465b966323ca5f3905d9` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:43.532542 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025d1dc-5782-44a9-8672-7d15d527b6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:43.532840 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025d1dc-5782-44a9-8672-7d15d527b6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:43.533120 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025d1dc-5782-44a9-8672-7d15d527b6d9 None admin] PATH_INFO: `/v3/projects/51efa731295b432199d02f2f22ada384` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:43.533524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36f878-daaf-4116-94ee-cc55b3a438c3 None admin] RBAC: Authorizing `identity:get_project(project_id=626251d4d31a465b966323ca5f3905d9)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:43.534881 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e025d1dc-5782-44a9-8672-7d15d527b6d9 None admin] RBAC: Authorizing `identity:get_project(project_id=51efa731295b432199d02f2f22ada384)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:43.535869 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36f878-daaf-4116-94ee-cc55b3a438c3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:43.536317 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e025d1dc-5782-44a9-8672-7d15d527b6d9 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:43.542535 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 205/413] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:43 2022] GET /identity/v3/projects/51efa731295b432199d02f2f22ada384 => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:43.542535 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54af788-d574-499a-b85a-2fea4d932f5e None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:43.542535 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54af788-d574-499a-b85a-2fea4d932f5e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:43.542535 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54af788-d574-499a-b85a-2fea4d932f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:43.543200 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 209/414] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:43 2022] GET /identity/v3/projects/626251d4d31a465b966323ca5f3905d9 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:43.544181 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36f878-daaf-4116-94ee-cc55b3a438c3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:43.560972 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-c54af788-d574-499a-b85a-2fea4d932f5e None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:43.562186 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c54af788-d574-499a-b85a-2fea4d932f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:43.598679 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:43.636848 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 206/415] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:43.637682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54af788-d574-499a-b85a-2fea4d932f5e None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:43.642875 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:43.654281 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36f878-daaf-4116-94ee-cc55b3a438c3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:43.694999 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2294822-a20c-4ba2-a401-9906c26283a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:43.696142 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2294822-a20c-4ba2-a401-9906c26283a3 None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:43.696567 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2294822-a20c-4ba2-a401-9906c26283a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:43.697008 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2294822-a20c-4ba2-a401-9906c26283a3 None admin] PATH_INFO: `/v3/projects/626251d4d31a465b966323ca5f3905d9/groups/b8d888b135744995a345120b82c58779/roles/b6177706a26446d5b4c540a3e97dee2e` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:43.699764 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2294822-a20c-4ba2-a401-9906c26283a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=626251d4d31a465b966323ca5f3905d9, group_id=b8d888b135744995a345120b82c58779, role_id=b6177706a26446d5b4c540a3e97dee2e)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:43.701389 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2294822-a20c-4ba2-a401-9906c26283a3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:43.725958 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 210/416] 10.222.0.57 () {58 vars in 1442 bytes} [Sat Jun 4 08:09:43 2022] PUT /identity/v3/projects/626251d4d31a465b966323ca5f3905d9/groups/b8d888b135744995a345120b82c58779/roles/b6177706a26446d5b4c540a3e97dee2e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:09:43.727206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2294822-a20c-4ba2-a401-9906c26283a3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:43.785851 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54af788-d574-499a-b85a-2fea4d932f5e None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:43.816655 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e412c7d-e686-4675-82ed-3d9fce1680a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:43.821866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e412c7d-e686-4675-82ed-3d9fce1680a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:43.821866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e412c7d-e686-4675-82ed-3d9fce1680a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:43.821866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e412c7d-e686-4675-82ed-3d9fce1680a5 None admin] PATH_INFO: `/v3/projects/51efa731295b432199d02f2f22ada384/groups/c966bde2cb6049db9bd93a7dade9b237/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:43.821866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e412c7d-e686-4675-82ed-3d9fce1680a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=51efa731295b432199d02f2f22ada384, group_id=c966bde2cb6049db9bd93a7dade9b237, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:43.821866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e412c7d-e686-4675-82ed-3d9fce1680a5 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:43.838101 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 207/417] 10.222.0.57 () {58 vars in 1442 bytes} [Sat Jun 4 08:09:43 2022] PUT /identity/v3/projects/51efa731295b432199d02f2f22ada384/groups/c966bde2cb6049db9bd93a7dade9b237/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:09:43.913993 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2294822-a20c-4ba2-a401-9906c26283a3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:43.954559 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f5398-5011-4f38-a404-36fe7999bd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:43.955371 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f5398-5011-4f38-a404-36fe7999bd4e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:43.955685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f5398-5011-4f38-a404-36fe7999bd4e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:43.956498 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f5398-5011-4f38-a404-36fe7999bd4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:43.969363 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f5398-5011-4f38-a404-36fe7999bd4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:43.977455 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-be9f5398-5011-4f38-a404-36fe7999bd4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:09:43.977455 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:43.977455 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:43.977455 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:43.977455 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:43.977455 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:43.977455 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:43.977455 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:43.977455 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:43.977455 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:43.977455 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:43.977455 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:43.977455 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:43.977455 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:43.977455 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:43.977455 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:43.978478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:43.978478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:43.978478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:43.978478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:43.978478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:43.978478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:43.978478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:43.978478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:43.978478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:43.978478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:43.978478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:43.978478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:43.978478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:43.978478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:43.978478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:43.978478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:43.979302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:43.979302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:43.979302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:43.979302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:43.979302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:43.979302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:43.979302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:43.979302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:43.979302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:43.979302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:43.979302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:09:43.979302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:43.979302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 211/418] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:43.984790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e412c7d-e686-4675-82ed-3d9fce1680a5 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:44.066224 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:44.143250 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e412c7d-e686-4675-82ed-3d9fce1680a5 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:44.185512 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96defb-f5b9-486a-b243-1c1d5a1a319a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:44.186146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96defb-f5b9-486a-b243-1c1d5a1a319a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:44.186437 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96defb-f5b9-486a-b243-1c1d5a1a319a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:44.186712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96defb-f5b9-486a-b243-1c1d5a1a319a None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:44.187470 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96defb-f5b9-486a-b243-1c1d5a1a319a None admin] RBAC: Adding query filter params (name=member) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:44.187780 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96defb-f5b9-486a-b243-1c1d5a1a319a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:44.189165 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96defb-f5b9-486a-b243-1c1d5a1a319a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:44.198857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 208/419] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jun 4 08:09:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:44.204891 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f5398-5011-4f38-a404-36fe7999bd4e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:44.227112 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:44.354832 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f5398-5011-4f38-a404-36fe7999bd4e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:44.383890 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af313f-0367-42eb-a8ad-211e5b098326 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:44.384079 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af313f-0367-42eb-a8ad-211e5b098326 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:44.384362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af313f-0367-42eb-a8ad-211e5b098326 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:44.388088 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 209/420] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:44.394250 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53cd43-b735-474d-9794-dc9e7731cdc1 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:44.394532 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53cd43-b735-474d-9794-dc9e7731cdc1 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:44.394809 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53cd43-b735-474d-9794-dc9e7731cdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:44.395349 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2ec09-1b46-473b-ae5d-94f2fdd280dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:44.396339 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2ec09-1b46-473b-ae5d-94f2fdd280dc None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:44.396818 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2ec09-1b46-473b-ae5d-94f2fdd280dc None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:44.397286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2ec09-1b46-473b-ae5d-94f2fdd280dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:44.438944 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-1c53cd43-b735-474d-9794-dc9e7731cdc1 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:44.440084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1c53cd43-b735-474d-9794-dc9e7731cdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:44.468937 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2ec09-1b46-473b-ae5d-94f2fdd280dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:44.470794 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2ec09-1b46-473b-ae5d-94f2fdd280dc None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:44.494886 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:44.572578 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 210/421] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:44.590334 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 212/422] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:09:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 08:09:44.596028 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53cd43-b735-474d-9794-dc9e7731cdc1 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:44.615493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2ec09-1b46-473b-ae5d-94f2fdd280dc None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:44.644524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:44.717256 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2ec09-1b46-473b-ae5d-94f2fdd280dc None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:44.729182 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:44.753796 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3f90f-4624-4811-ac64-8bad261bda1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:44.754811 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3f90f-4624-4811-ac64-8bad261bda1a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:44.755194 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3f90f-4624-4811-ac64-8bad261bda1a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:44.755610 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3f90f-4624-4811-ac64-8bad261bda1a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:44.766901 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3f90f-4624-4811-ac64-8bad261bda1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:44.775887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-9ee3f90f-4624-4811-ac64-8bad261bda1a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 08:09:44.775887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:44.775887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:44.775887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:44.775887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:44.775887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:44.775887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:44.775887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:44.775887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:44.775887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:44.775887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:44.775887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:44.775887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:44.775887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:44.775887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:44.775887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:44.776820 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:44.776820 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:44.776820 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:44.776820 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:44.776820 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:44.776820 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:44.776820 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:44.776820 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:44.776820 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:44.776820 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:44.776820 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:44.776820 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:44.776820 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:44.776820 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:44.776820 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:44.776820 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:44.777625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:44.777625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:44.777625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:44.777625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:44.777625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:44.777625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:44.777625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:44.777625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:44.777625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:44.777625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:44.777625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 08:09:44.777625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:44.777625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 213/423] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jun 4 08:09:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:09:44.784648 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3f90f-4624-4811-ac64-8bad261bda1a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:44.848603 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53cd43-b735-474d-9794-dc9e7731cdc1 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:44.902242 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3f90f-4624-4811-ac64-8bad261bda1a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:44.914807 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4136f-9cdf-4aa8-9039-f3c2a68ab2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:44.915794 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4136f-9cdf-4aa8-9039-f3c2a68ab2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:44.916010 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4136f-9cdf-4aa8-9039-f3c2a68ab2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:44.916426 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4136f-9cdf-4aa8-9039-f3c2a68ab2d8 None admin] PATH_INFO: `/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:44.926210 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4136f-9cdf-4aa8-9039-f3c2a68ab2d8 None admin] RBAC: Authorizing `identity:get_project(project_id=a9d904b06eb24d5d8bce3f192f7927ca)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:44.926210 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4136f-9cdf-4aa8-9039-f3c2a68ab2d8 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:44.928570 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 211/424] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:44 2022] GET /identity/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca => generated 298 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:44.938811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4136f-9cdf-4aa8-9039-f3c2a68ab2d8 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:44.947132 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ba5f4-73b4-4875-b5bd-20646a833db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:44.947815 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ba5f4-73b4-4875-b5bd-20646a833db5 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:44.948099 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ba5f4-73b4-4875-b5bd-20646a833db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:44.948377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ba5f4-73b4-4875-b5bd-20646a833db5 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:44.949233 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ba5f4-73b4-4875-b5bd-20646a833db5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:44.949548 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ba5f4-73b4-4875-b5bd-20646a833db5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:44.950965 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ba5f4-73b4-4875-b5bd-20646a833db5 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:44.960445 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 214/425] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:09:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:44.966002 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ba5f4-73b4-4875-b5bd-20646a833db5 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:45.004918 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:45.064469 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:45.074383 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4136f-9cdf-4aa8-9039-f3c2a68ab2d8 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:45.075934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ba5f4-73b4-4875-b5bd-20646a833db5 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:45.112370 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53ead7-7652-428f-bb95-804de48c39c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:45.113219 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53ead7-7652-428f-bb95-804de48c39c8 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:45.113497 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53ead7-7652-428f-bb95-804de48c39c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:45.113764 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53ead7-7652-428f-bb95-804de48c39c8 None admin] PATH_INFO: `/v3/groups/b8d888b135744995a345120b82c58779` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:45.114527 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671143a3-d4eb-4731-a44a-f66fdd87332d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:45.114983 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53ead7-7652-428f-bb95-804de48c39c8 None admin] RBAC: Authorizing `identity:get_group(group_id=b8d888b135744995a345120b82c58779)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:45.115476 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671143a3-d4eb-4731-a44a-f66fdd87332d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:45.115897 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671143a3-d4eb-4731-a44a-f66fdd87332d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:45.116310 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671143a3-d4eb-4731-a44a-f66fdd87332d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:45.116433 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53ead7-7652-428f-bb95-804de48c39c8 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:45.122965 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 212/426] 10.222.0.57 () {56 vars in 1180 bytes} [Sat Jun 4 08:09:44 2022] GET /identity/v3/groups/b8d888b135744995a345120b82c58779 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:45.122965 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f5268-ecd5-4ede-9363-04c0cb65a68b None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:45.122965 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f5268-ecd5-4ede-9363-04c0cb65a68b None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:45.122965 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f5268-ecd5-4ede-9363-04c0cb65a68b None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:45.122965 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 213/427] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:45.124970 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f5268-ecd5-4ede-9363-04c0cb65a68b None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:45.215117 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671143a3-d4eb-4731-a44a-f66fdd87332d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:45.217435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671143a3-d4eb-4731-a44a-f66fdd87332d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:45.247536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f5268-ecd5-4ede-9363-04c0cb65a68b None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:45.254467 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:45.297317 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1942f-922c-4623-a58d-4a83ba615947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:45.298391 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1942f-922c-4623-a58d-4a83ba615947 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:45.300147 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1942f-922c-4623-a58d-4a83ba615947 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:45.300577 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1942f-922c-4623-a58d-4a83ba615947 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:45.301577 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1942f-922c-4623-a58d-4a83ba615947 None admin] RBAC: Adding query filter params (group.id=b8d888b135744995a345120b82c58779, role.id=314f0b44fb344a99bdda986e7b4ac3ab, scope.project.id=a9d904b06eb24d5d8bce3f192f7927ca) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:45.302057 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1942f-922c-4623-a58d-4a83ba615947 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:45.303895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1942f-922c-4623-a58d-4a83ba615947 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:45.317174 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 214/428] 10.222.0.57 () {56 vars in 1376 bytes} [Sat Jun 4 08:09:45 2022] GET /identity/v3/role_assignments?group.id=b8d888b135744995a345120b82c58779&scope.project.id=a9d904b06eb24d5d8bce3f192f7927ca&role.id=314f0b44fb344a99bdda986e7b4ac3ab => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:45.317174 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855422f-abf7-4756-9962-1222711b09a8 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:45.317174 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855422f-abf7-4756-9962-1222711b09a8 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:45.317174 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855422f-abf7-4756-9962-1222711b09a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:45.352374 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 215/429] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:09:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 08:09:45.353526 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-2855422f-abf7-4756-9962-1222711b09a8 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:45.354919 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2855422f-abf7-4756-9962-1222711b09a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:45.359083 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671143a3-d4eb-4731-a44a-f66fdd87332d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:45.391306 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:45.489528 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 215/430] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:45.521456 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671143a3-d4eb-4731-a44a-f66fdd87332d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:45.536878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855422f-abf7-4756-9962-1222711b09a8 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:45.606265 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:45.614171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2644876-7f7d-4128-a502-075036515c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:45.614989 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2644876-7f7d-4128-a502-075036515c72 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:45.615272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2644876-7f7d-4128-a502-075036515c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:45.615548 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2644876-7f7d-4128-a502-075036515c72 None admin] PATH_INFO: `/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:45.616744 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2644876-7f7d-4128-a502-075036515c72 None admin] RBAC: Authorizing `identity:get_project(project_id=a9d904b06eb24d5d8bce3f192f7927ca)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:45.618237 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2644876-7f7d-4128-a502-075036515c72 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:45.620244 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 216/431] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:45 2022] GET /identity/v3/projects/a9d904b06eb24d5d8bce3f192f7927ca => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:45.627201 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2644876-7f7d-4128-a502-075036515c72 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:45.670930 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855422f-abf7-4756-9962-1222711b09a8 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:45.718016 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc4b40-c2d6-4952-926e-6533e55de055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:45.718820 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc4b40-c2d6-4952-926e-6533e55de055 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:45.719096 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc4b40-c2d6-4952-926e-6533e55de055 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:45.719368 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc4b40-c2d6-4952-926e-6533e55de055 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:45.735533 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc4b40-c2d6-4952-926e-6533e55de055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:45.744091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-8dbc4b40-c2d6-4952-926e-6533e55de055 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:09:45.744091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:45.744091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:45.744091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:45.744091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:45.744091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:45.744091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:45.744091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:45.744091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:45.744091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:45.744091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:45.744091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:45.744091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:45.744091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:45.744091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:45.744091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:45.745006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:45.745006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:45.745006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:45.745006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:45.745006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:45.745006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:45.745006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:45.745006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:45.745006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:45.745006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:45.745006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:45.745006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:45.745006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:45.745006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:45.745006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:45.745006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:45.745847 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:45.745847 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:45.745847 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:45.745847 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:45.745847 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:45.745847 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:45.745847 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:45.745847 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:45.745847 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:45.745847 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:45.745847 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 08:09:45.745847 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:45.745847 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 216/432] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:09:45.752907 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc4b40-c2d6-4952-926e-6533e55de055 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:45.763591 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2644876-7f7d-4128-a502-075036515c72 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:45.770926 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:45.806383 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e84ee3-a40b-4212-914e-85602581a6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:45.807886 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e84ee3-a40b-4212-914e-85602581a6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:45.808398 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e84ee3-a40b-4212-914e-85602581a6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:45.808871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e84ee3-a40b-4212-914e-85602581a6c7 None admin] PATH_INFO: `/v3/groups/b8d888b135744995a345120b82c58779` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:45.810306 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e84ee3-a40b-4212-914e-85602581a6c7 None admin] RBAC: Authorizing `identity:get_group(group_id=b8d888b135744995a345120b82c58779)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:45.811967 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e84ee3-a40b-4212-914e-85602581a6c7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:45.814576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 217/433] 10.222.0.57 () {56 vars in 1180 bytes} [Sat Jun 4 08:09:45 2022] GET /identity/v3/groups/b8d888b135744995a345120b82c58779 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:45.820420 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e84ee3-a40b-4212-914e-85602581a6c7 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:45.870305 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc4b40-c2d6-4952-926e-6533e55de055 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:45.892540 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:45.914069 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c3085-7db9-4f9c-a75e-072d3c43223b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:45.915022 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c3085-7db9-4f9c-a75e-072d3c43223b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:45.915489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c3085-7db9-4f9c-a75e-072d3c43223b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:45.915900 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c3085-7db9-4f9c-a75e-072d3c43223b None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:45.916791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c3085-7db9-4f9c-a75e-072d3c43223b None admin] RBAC: Adding query filter params (name=member) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:45.917287 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c3085-7db9-4f9c-a75e-072d3c43223b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:45.918818 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c3085-7db9-4f9c-a75e-072d3c43223b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:45.929402 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 217/434] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jun 4 08:09:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:45.934431 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e84ee3-a40b-4212-914e-85602581a6c7 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:45.950891 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c3085-7db9-4f9c-a75e-072d3c43223b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:45.991923 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf838cc-e036-4911-953c-da0f013e7cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:45.992703 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf838cc-e036-4911-953c-da0f013e7cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:45.992991 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf838cc-e036-4911-953c-da0f013e7cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:45.993269 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf838cc-e036-4911-953c-da0f013e7cb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:45.994282 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf838cc-e036-4911-953c-da0f013e7cb5 None admin] RBAC: Adding query filter params (group.id=b8d888b135744995a345120b82c58779, role.id=b6177706a26446d5b4c540a3e97dee2e, scope.project.id=a9d904b06eb24d5d8bce3f192f7927ca) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:45.994669 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf838cc-e036-4911-953c-da0f013e7cb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:45.996128 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf838cc-e036-4911-953c-da0f013e7cb5 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:46.003556 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 218/435] 10.222.0.57 () {56 vars in 1376 bytes} [Sat Jun 4 08:09:45 2022] GET /identity/v3/role_assignments?group.id=b8d888b135744995a345120b82c58779&scope.project.id=a9d904b06eb24d5d8bce3f192f7927ca&role.id=b6177706a26446d5b4c540a3e97dee2e => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:46.052819 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:46.087097 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c3085-7db9-4f9c-a75e-072d3c43223b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:46.132408 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc68802d-0043-45a7-af9e-41e7ef9dd027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:46.133432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68802d-0043-45a7-af9e-41e7ef9dd027 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:46.133999 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68802d-0043-45a7-af9e-41e7ef9dd027 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:46.134482 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68802d-0043-45a7-af9e-41e7ef9dd027 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:46.217430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc68802d-0043-45a7-af9e-41e7ef9dd027 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:46.219280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc68802d-0043-45a7-af9e-41e7ef9dd027 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:46.314423 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:46.342627 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 218/436] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:09:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 08:09:46.348449 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf838cc-e036-4911-953c-da0f013e7cb5 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:46.469189 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf838cc-e036-4911-953c-da0f013e7cb5 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:46.491110 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b68d05-422b-4549-85bc-389703cac3d3 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:46.491461 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b68d05-422b-4549-85bc-389703cac3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:46.491739 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b68d05-422b-4549-85bc-389703cac3d3 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:46.493246 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 219/437] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 08:09:46.498508 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1b3b0-a37a-4e1a-bdc0-8ac9e1814ce6 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:46.499184 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1b3b0-a37a-4e1a-bdc0-8ac9e1814ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:46.499473 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1b3b0-a37a-4e1a-bdc0-8ac9e1814ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:46.509070 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:46.516365 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64a4f6-3f27-40d7-8805-b76bd977a3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:46.517195 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64a4f6-3f27-40d7-8805-b76bd977a3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:46.517480 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64a4f6-3f27-40d7-8805-b76bd977a3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:46.517757 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64a4f6-3f27-40d7-8805-b76bd977a3a9 None admin] PATH_INFO: `/v3/projects/626251d4d31a465b966323ca5f3905d9` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:46.519567 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a64a4f6-3f27-40d7-8805-b76bd977a3a9 None admin] RBAC: Authorizing `identity:get_project(project_id=626251d4d31a465b966323ca5f3905d9)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:46.520663 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-4ac1b3b0-a37a-4e1a-bdc0-8ac9e1814ce6 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:46.521018 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a64a4f6-3f27-40d7-8805-b76bd977a3a9 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:46.521961 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4ac1b3b0-a37a-4e1a-bdc0-8ac9e1814ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:46.523023 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 219/438] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:46 2022] GET /identity/v3/projects/626251d4d31a465b966323ca5f3905d9 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:46.528708 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64a4f6-3f27-40d7-8805-b76bd977a3a9 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:46.610288 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 220/439] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 08:09:46.611646 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c0d58-e198-4755-ade6-cc6d4bcaa247 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:46.611987 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c0d58-e198-4755-ade6-cc6d4bcaa247 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:46.612360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c0d58-e198-4755-ade6-cc6d4bcaa247 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:46.614717 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 221/440] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:46.621177 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd553749-b72f-49da-9e76-cb350997a94e None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:46.621471 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd553749-b72f-49da-9e76-cb350997a94e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:46.621753 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd553749-b72f-49da-9e76-cb350997a94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:46.638826 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-cd553749-b72f-49da-9e76-cb350997a94e None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:46.640003 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-cd553749-b72f-49da-9e76-cb350997a94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:46.655018 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64a4f6-3f27-40d7-8805-b76bd977a3a9 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:46.688488 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b2dd4-957e-432f-bfd2-f2df925a00ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:46.689383 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b2dd4-957e-432f-bfd2-f2df925a00ea None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:46.689662 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b2dd4-957e-432f-bfd2-f2df925a00ea None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:46.689971 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b2dd4-957e-432f-bfd2-f2df925a00ea None admin] PATH_INFO: `/v3/groups/b8d888b135744995a345120b82c58779` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:46.691713 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b2dd4-957e-432f-bfd2-f2df925a00ea None admin] RBAC: Authorizing `identity:get_group(group_id=b8d888b135744995a345120b82c58779)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:46.693148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b2dd4-957e-432f-bfd2-f2df925a00ea None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:46.694953 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 220/441] 10.222.0.57 () {56 vars in 1180 bytes} [Sat Jun 4 08:09:46 2022] GET /identity/v3/groups/b8d888b135744995a345120b82c58779 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:46.695539 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b2dd4-957e-432f-bfd2-f2df925a00ea None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:46.711365 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 222/442] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 08:09:46.712198 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd553749-b72f-49da-9e76-cb350997a94e None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:46.752359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:46.760867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:46.794446 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b2dd4-957e-432f-bfd2-f2df925a00ea None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:46.821417 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd553749-b72f-49da-9e76-cb350997a94e None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:46.828161 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68512bdb-0ab2-4d44-8e0c-d98431ac0e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:46.828971 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68512bdb-0ab2-4d44-8e0c-d98431ac0e3c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:46.829253 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68512bdb-0ab2-4d44-8e0c-d98431ac0e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:46.829527 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68512bdb-0ab2-4d44-8e0c-d98431ac0e3c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:46.839602 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68512bdb-0ab2-4d44-8e0c-d98431ac0e3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:46.848357 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-68512bdb-0ab2-4d44-8e0c-d98431ac0e3c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 08:09:46.848357 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:46.848357 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:46.848357 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:46.848357 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:46.848357 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:46.848357 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:46.848357 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:46.848357 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:46.848357 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:46.848357 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:46.848357 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:46.848357 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:46.848357 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:46.848357 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:46.848357 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:46.849297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:46.849297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:46.849297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:46.849297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:46.849297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:46.849297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:46.849297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:46.849297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:46.849297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:46.849297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:46.849297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:46.849297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:46.849297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:46.849297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:46.849297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:46.849297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:46.850143 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:46.850143 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:46.850143 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:46.850143 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:46.850143 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:46.850143 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:46.850143 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:46.850143 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:46.850143 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:46.850143 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:46.850143 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 08:09:46.850143 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:46.850143 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 221/443] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jun 4 08:09:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:46.850805 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68512bdb-0ab2-4d44-8e0c-d98431ac0e3c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:46.858730 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14deb52-5227-4dd0-8214-076e88b8faea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:46.859810 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14deb52-5227-4dd0-8214-076e88b8faea None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:46.860319 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14deb52-5227-4dd0-8214-076e88b8faea None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:46.860842 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14deb52-5227-4dd0-8214-076e88b8faea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:46.862833 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14deb52-5227-4dd0-8214-076e88b8faea None admin] RBAC: Adding query filter params (group.id=b8d888b135744995a345120b82c58779, role.id=314f0b44fb344a99bdda986e7b4ac3ab, scope.project.id=626251d4d31a465b966323ca5f3905d9) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:46.863151 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14deb52-5227-4dd0-8214-076e88b8faea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:46.864611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14deb52-5227-4dd0-8214-076e88b8faea None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:46.871974 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 223/444] 10.222.0.57 () {56 vars in 1376 bytes} [Sat Jun 4 08:09:46 2022] GET /identity/v3/role_assignments?group.id=b8d888b135744995a345120b82c58779&scope.project.id=626251d4d31a465b966323ca5f3905d9&role.id=314f0b44fb344a99bdda986e7b4ac3ab => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:46.872760 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14deb52-5227-4dd0-8214-076e88b8faea None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:46.966448 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68512bdb-0ab2-4d44-8e0c-d98431ac0e3c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:46.996388 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:47.002536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:47.006927 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50323b5e-11ab-40d9-9631-e6678d638a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:47.007308 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50323b5e-11ab-40d9-9631-e6678d638a08 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:47.007651 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50323b5e-11ab-40d9-9631-e6678d638a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:47.007996 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50323b5e-11ab-40d9-9631-e6678d638a08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:47.008833 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14deb52-5227-4dd0-8214-076e88b8faea None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:47.021712 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50323b5e-11ab-40d9-9631-e6678d638a08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:47.029685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-50323b5e-11ab-40d9-9631-e6678d638a08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:09:47.029685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:47.029685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:47.029685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:47.029685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:47.029685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:47.029685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:47.029685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:47.029685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:47.029685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:47.029685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:47.029685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:47.029685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:47.029685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:47.029685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:47.029685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:47.030650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:47.030650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:47.030650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:47.030650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:47.030650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:47.030650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:47.030650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:47.030650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:47.030650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:47.030650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:47.030650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:47.030650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:47.030650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:47.030650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:47.030650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:47.030650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:47.031464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:47.031464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:47.031464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:47.031464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:47.031464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:47.031464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:47.031464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:47.031464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:47.031464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:47.031464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:47.031464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:09:47.031464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:47.031464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 222/445] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:09:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:47.040091 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50323b5e-11ab-40d9-9631-e6678d638a08 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:47.049130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af31642-ca41-4e0a-8e40-4b7700d699fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:47.049859 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af31642-ca41-4e0a-8e40-4b7700d699fe None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:47.050747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af31642-ca41-4e0a-8e40-4b7700d699fe None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:47.051042 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af31642-ca41-4e0a-8e40-4b7700d699fe None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:47.051817 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af31642-ca41-4e0a-8e40-4b7700d699fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:47.052124 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af31642-ca41-4e0a-8e40-4b7700d699fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:47.054232 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af31642-ca41-4e0a-8e40-4b7700d699fe None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:47.066321 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 224/446] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:09:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:47.072984 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af31642-ca41-4e0a-8e40-4b7700d699fe None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:47.162314 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50323b5e-11ab-40d9-9631-e6678d638a08 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:47.197793 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af31642-ca41-4e0a-8e40-4b7700d699fe None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:47.203554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d41a8-d3ae-4ac0-9c25-5e259d49fc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:47.204238 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d41a8-d3ae-4ac0-9c25-5e259d49fc08 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:47.204524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d41a8-d3ae-4ac0-9c25-5e259d49fc08 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:47.204802 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d41a8-d3ae-4ac0-9c25-5e259d49fc08 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:47.205552 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d41a8-d3ae-4ac0-9c25-5e259d49fc08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:47.206436 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d41a8-d3ae-4ac0-9c25-5e259d49fc08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:47.208315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d41a8-d3ae-4ac0-9c25-5e259d49fc08 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:47.219705 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 223/447] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:47.226969 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d41a8-d3ae-4ac0-9c25-5e259d49fc08 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:47.240286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed297fec-c338-4f19-a651-faa8cb795408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:47.240942 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed297fec-c338-4f19-a651-faa8cb795408 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:47.241229 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed297fec-c338-4f19-a651-faa8cb795408 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:47.241515 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed297fec-c338-4f19-a651-faa8cb795408 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:47.275634 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:47.285882 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:47.319778 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed297fec-c338-4f19-a651-faa8cb795408 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:47.321251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed297fec-c338-4f19-a651-faa8cb795408 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:47.337178 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d41a8-d3ae-4ac0-9c25-5e259d49fc08 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:47.369792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccef06a-92ed-4846-9499-0100093b11d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:47.370453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccef06a-92ed-4846-9499-0100093b11d0 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:47.370741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccef06a-92ed-4846-9499-0100093b11d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:47.371022 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccef06a-92ed-4846-9499-0100093b11d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:47.416975 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 225/448] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:09:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 08:09:47.422466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed297fec-c338-4f19-a651-faa8cb795408 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:47.437127 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccef06a-92ed-4846-9499-0100093b11d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:47.438624 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccef06a-92ed-4846-9499-0100093b11d0 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:47.479698 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:47.485790 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:47.522416 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed297fec-c338-4f19-a651-faa8cb795408 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:47.541222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 224/449] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:09:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 08:09:47.546643 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccef06a-92ed-4846-9499-0100093b11d0 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:47.563645 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ddb2a-b841-46dd-9c42-7f22197f9ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:47.564535 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ddb2a-b841-46dd-9c42-7f22197f9ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:47.564814 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ddb2a-b841-46dd-9c42-7f22197f9ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:47.565115 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ddb2a-b841-46dd-9c42-7f22197f9ca0 None admin] PATH_INFO: `/v3/projects/626251d4d31a465b966323ca5f3905d9` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:47.566374 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ddb2a-b841-46dd-9c42-7f22197f9ca0 None admin] RBAC: Authorizing `identity:get_project(project_id=626251d4d31a465b966323ca5f3905d9)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:47.567840 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ddb2a-b841-46dd-9c42-7f22197f9ca0 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:47.569527 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 226/450] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:47 2022] GET /identity/v3/projects/626251d4d31a465b966323ca5f3905d9 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:47.574731 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ddb2a-b841-46dd-9c42-7f22197f9ca0 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:47.641517 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccef06a-92ed-4846-9499-0100093b11d0 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:47.672887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ddb2a-b841-46dd-9c42-7f22197f9ca0 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:47.675632 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640b69a-b5ad-4b42-b0b2-043be2d220f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:47.676491 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640b69a-b5ad-4b42-b0b2-043be2d220f0 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:47.676774 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640b69a-b5ad-4b42-b0b2-043be2d220f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:47.677048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640b69a-b5ad-4b42-b0b2-043be2d220f0 None admin] PATH_INFO: `/v3/projects/51efa731295b432199d02f2f22ada384` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:47.678511 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b640b69a-b5ad-4b42-b0b2-043be2d220f0 None admin] RBAC: Authorizing `identity:get_project(project_id=51efa731295b432199d02f2f22ada384)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:47.679948 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b640b69a-b5ad-4b42-b0b2-043be2d220f0 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:47.681636 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 225/451] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:09:47 2022] GET /identity/v3/projects/51efa731295b432199d02f2f22ada384 => generated 344 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:47.687403 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640b69a-b5ad-4b42-b0b2-043be2d220f0 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:47.700766 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:47.705466 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:47.709016 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2acd82-ff1c-4dbd-a8fc-24a10330be66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:47.709904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2acd82-ff1c-4dbd-a8fc-24a10330be66 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:47.710189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2acd82-ff1c-4dbd-a8fc-24a10330be66 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:47.710468 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2acd82-ff1c-4dbd-a8fc-24a10330be66 None admin] PATH_INFO: `/v3/groups/b8d888b135744995a345120b82c58779` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:47.711654 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2acd82-ff1c-4dbd-a8fc-24a10330be66 None admin] RBAC: Authorizing `identity:get_group(group_id=b8d888b135744995a345120b82c58779)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:47.713113 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2acd82-ff1c-4dbd-a8fc-24a10330be66 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:47.714812 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 227/452] 10.222.0.57 () {56 vars in 1180 bytes} [Sat Jun 4 08:09:47 2022] GET /identity/v3/groups/b8d888b135744995a345120b82c58779 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:47.720376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2acd82-ff1c-4dbd-a8fc-24a10330be66 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:47.786238 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640b69a-b5ad-4b42-b0b2-043be2d220f0 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:47.818665 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2acd82-ff1c-4dbd-a8fc-24a10330be66 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:47.819152 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74d93a-716a-448e-9c7c-57a6dfb6b66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:47.820011 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74d93a-716a-448e-9c7c-57a6dfb6b66a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:47.820279 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74d93a-716a-448e-9c7c-57a6dfb6b66a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:47.820546 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74d93a-716a-448e-9c7c-57a6dfb6b66a None admin] PATH_INFO: `/v3/groups/c966bde2cb6049db9bd93a7dade9b237` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:47.821708 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af74d93a-716a-448e-9c7c-57a6dfb6b66a None admin] RBAC: Authorizing `identity:get_group(group_id=c966bde2cb6049db9bd93a7dade9b237)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:47.823163 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af74d93a-716a-448e-9c7c-57a6dfb6b66a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:47.824757 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 226/453] 10.222.0.57 () {56 vars in 1180 bytes} [Sat Jun 4 08:09:47 2022] GET /identity/v3/groups/c966bde2cb6049db9bd93a7dade9b237 => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:47.830302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74d93a-716a-448e-9c7c-57a6dfb6b66a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:47.854200 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab8f50-6f06-4986-be30-2923d2f4e13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:47.854855 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab8f50-6f06-4986-be30-2923d2f4e13b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:47.855148 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab8f50-6f06-4986-be30-2923d2f4e13b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:47.855415 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab8f50-6f06-4986-be30-2923d2f4e13b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:47.856339 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab8f50-6f06-4986-be30-2923d2f4e13b None admin] RBAC: Adding query filter params (group.id=b8d888b135744995a345120b82c58779, role.id=b6177706a26446d5b4c540a3e97dee2e, scope.project.id=626251d4d31a465b966323ca5f3905d9) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:47.856659 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab8f50-6f06-4986-be30-2923d2f4e13b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:47.858119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab8f50-6f06-4986-be30-2923d2f4e13b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:47.863933 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 228/454] 10.222.0.57 () {56 vars in 1376 bytes} [Sat Jun 4 08:09:47 2022] GET /identity/v3/role_assignments?group.id=b8d888b135744995a345120b82c58779&scope.project.id=626251d4d31a465b966323ca5f3905d9&role.id=b6177706a26446d5b4c540a3e97dee2e => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:47.922154 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:47.939873 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74d93a-716a-448e-9c7c-57a6dfb6b66a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:47.978231 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda57f19-5db0-4088-95d3-33fbe7fceceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:47.978928 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda57f19-5db0-4088-95d3-33fbe7fceceb None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:47.979214 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda57f19-5db0-4088-95d3-33fbe7fceceb None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:47.979487 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda57f19-5db0-4088-95d3-33fbe7fceceb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:47.980333 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda57f19-5db0-4088-95d3-33fbe7fceceb None admin] RBAC: Adding query filter params (group.id=c966bde2cb6049db9bd93a7dade9b237, role.id=431cef539cfb476aad50d2470e763b5f, scope.project.id=51efa731295b432199d02f2f22ada384) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:47.980642 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda57f19-5db0-4088-95d3-33fbe7fceceb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:47.982133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda57f19-5db0-4088-95d3-33fbe7fceceb None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:47.988828 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 227/455] 10.222.0.57 () {56 vars in 1376 bytes} [Sat Jun 4 08:09:47 2022] GET /identity/v3/role_assignments?group.id=c966bde2cb6049db9bd93a7dade9b237&scope.project.id=51efa731295b432199d02f2f22ada384&role.id=431cef539cfb476aad50d2470e763b5f => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:50.855602 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec24a31-65a5-47d2-92d0-8428f4f0e202 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:50.856653 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec24a31-65a5-47d2-92d0-8428f4f0e202 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:50.857143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec24a31-65a5-47d2-92d0-8428f4f0e202 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:50.858738 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 229/456] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:50.871611 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21f367-69b6-4992-9dd5-07793cb0719f None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:50.872474 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21f367-69b6-4992-9dd5-07793cb0719f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:50.872998 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21f367-69b6-4992-9dd5-07793cb0719f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:50.894818 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-cb21f367-69b6-4992-9dd5-07793cb0719f None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:50.896371 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-cb21f367-69b6-4992-9dd5-07793cb0719f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:50.980120 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 228/457] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:50.997992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afdadc-0e0d-4392-9988-96a253a0adda None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:50.998281 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afdadc-0e0d-4392-9988-96a253a0adda None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:50.998552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afdadc-0e0d-4392-9988-96a253a0adda None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:51.000048 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 230/458] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:51.011669 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc9c78-b2b7-4622-892d-1bfb86056cd2 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:51.011966 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc9c78-b2b7-4622-892d-1bfb86056cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:51.012247 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc9c78-b2b7-4622-892d-1bfb86056cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:51.026560 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66afdadc-0e0d-4392-9988-96a253a0adda None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:51.036708 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-07cc9c78-b2b7-4622-892d-1bfb86056cd2 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:51.039888 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-07cc9c78-b2b7-4622-892d-1bfb86056cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:51.133414 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:51.156622 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 229/459] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:51.158629 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d7461-97f9-400d-8a5b-7876533f4e6d None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:51.159168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d7461-97f9-400d-8a5b-7876533f4e6d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:51.159645 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d7461-97f9-400d-8a5b-7876533f4e6d None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:51.161555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 230/460] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:51.167043 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8236eb2-23fd-4a61-8d8d-a241a031c27c None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:51.167564 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8236eb2-23fd-4a61-8d8d-a241a031c27c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:51.168039 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8236eb2-23fd-4a61-8d8d-a241a031c27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:51.186411 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66afdadc-0e0d-4392-9988-96a253a0adda None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:51.194169 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-c8236eb2-23fd-4a61-8d8d-a241a031c27c None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:51.195771 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c8236eb2-23fd-4a61-8d8d-a241a031c27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:51.199726 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:51.225964 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83221ef7-8455-48bc-ad09-7a4ead905647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:51.226771 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83221ef7-8455-48bc-ad09-7a4ead905647 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:51.227188 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83221ef7-8455-48bc-ad09-7a4ead905647 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:51.227428 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83221ef7-8455-48bc-ad09-7a4ead905647 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:51.238932 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83221ef7-8455-48bc-ad09-7a4ead905647 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:51.240368 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83221ef7-8455-48bc-ad09-7a4ead905647 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:51.259996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-83221ef7-8455-48bc-ad09-7a4ead905647 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:09:51.259996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:51.259996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:51.259996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:51.259996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:51.259996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:51.259996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:51.259996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:51.259996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:51.259996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:51.259996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:51.259996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:51.259996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:09:51.259996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:09:51.259996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:09:51.260960 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:09:51.260960 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:51.260960 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:51.260960 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:51.260960 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:51.260960 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:51.260960 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:51.260960 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:51.260960 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:51.260960 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:51.260960 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:51.260960 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:51.260960 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:51.260960 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:51.260960 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:51.260960 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:51.260960 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:51.261852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:09:51.261852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:09:51.261852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:09:51.261852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:51.265936 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 231/461] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:09:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:51.266938 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83221ef7-8455-48bc-ad09-7a4ead905647 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:51.278561 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 231/462] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:51.279841 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8236eb2-23fd-4a61-8d8d-a241a031c27c None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:51.395329 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8236eb2-23fd-4a61-8d8d-a241a031c27c None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:51.398823 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83221ef7-8455-48bc-ad09-7a4ead905647 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:51.412495 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:51.435178 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b2d08-74cd-41cf-971b-0b3a1b1af92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:51.435985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b2d08-74cd-41cf-971b-0b3a1b1af92b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:51.436272 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b2d08-74cd-41cf-971b-0b3a1b1af92b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:51.436546 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b2d08-74cd-41cf-971b-0b3a1b1af92b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:51.437672 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f984710-5eaf-43f6-864c-90ac957d5735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:51.438687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f984710-5eaf-43f6-864c-90ac957d5735 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:51.439288 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f984710-5eaf-43f6-864c-90ac957d5735 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:51.439765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f984710-5eaf-43f6-864c-90ac957d5735 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:51.440750 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f984710-5eaf-43f6-864c-90ac957d5735 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:51.441279 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f984710-5eaf-43f6-864c-90ac957d5735 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:51.442899 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f984710-5eaf-43f6-864c-90ac957d5735 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:51.447814 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b2d08-74cd-41cf-971b-0b3a1b1af92b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:51.449280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b2d08-74cd-41cf-971b-0b3a1b1af92b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:51.453038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:51.458647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 232/463] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:51.459687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f984710-5eaf-43f6-864c-90ac957d5735 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:51.472077 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-df1b2d08-74cd-41cf-971b-0b3a1b1af92b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:09:51.472077 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:51.472077 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:51.472077 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:51.472077 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:51.472077 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:51.472077 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:51.472077 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:51.472077 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:51.472077 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:51.472077 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:51.472077 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:51.472077 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:09:51.472077 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:09:51.472077 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:09:51.472986 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:09:51.472986 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:51.472986 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:51.472986 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:51.472986 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:51.472986 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:51.472986 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:51.472986 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:51.472986 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:51.472986 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:51.472986 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:51.472986 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:51.472986 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:51.472986 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:51.472986 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:51.472986 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:51.472986 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:51.473899 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:09:51.473899 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:09:51.473899 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:09:51.473899 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:51.473899 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 232/464] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:09:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:51.474579 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b2d08-74cd-41cf-971b-0b3a1b1af92b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:51.578815 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b2d08-74cd-41cf-971b-0b3a1b1af92b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:51.584239 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f984710-5eaf-43f6-864c-90ac957d5735 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:51.616675 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2753a-ac47-4aaf-beb2-30d75c3b9837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:51.617393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2753a-ac47-4aaf-beb2-30d75c3b9837 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:51.617653 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2753a-ac47-4aaf-beb2-30d75c3b9837 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:51.618044 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2753a-ac47-4aaf-beb2-30d75c3b9837 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:51.618725 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2753a-ac47-4aaf-beb2-30d75c3b9837 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:51.620232 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2753a-ac47-4aaf-beb2-30d75c3b9837 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:51.631746 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9529b4-a5f7-4c8e-9f7c-d574f4f43094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:51.631746 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9529b4-a5f7-4c8e-9f7c-d574f4f43094 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:51.631746 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9529b4-a5f7-4c8e-9f7c-d574f4f43094 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:51.631746 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9529b4-a5f7-4c8e-9f7c-d574f4f43094 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:51.642717 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9529b4-a5f7-4c8e-9f7c-d574f4f43094 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:51.643572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 233/465] 10.222.0.57 () {60 vars in 1132 bytes} [Sat Jun 4 08:09:51 2022] POST /identity/v3/users => generated 246 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:09:51.644408 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2753a-ac47-4aaf-beb2-30d75c3b9837 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:51.648267 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9529b4-a5f7-4c8e-9f7c-d574f4f43094 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:51.673408 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:51.685625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-1a9529b4-a5f7-4c8e-9f7c-d574f4f43094 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:09:51.685625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:51.685625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:51.685625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:51.685625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:51.685625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:51.685625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:51.685625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:51.685625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:51.685625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:51.685625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:51.685625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:51.685625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:09:51.685625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:09:51.685625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:09:51.686703 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:09:51.686703 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:51.686703 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:51.686703 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:51.686703 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:51.686703 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:51.686703 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:51.686703 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:51.686703 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:51.686703 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:51.686703 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:51.686703 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:51.686703 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:51.686703 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:51.686703 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:51.686703 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:51.686703 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:51.687597 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:09:51.687597 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:09:51.687597 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:09:51.687597 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:51.690099 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 233/466] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:09:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:51.692213 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf338cb-b9c8-4d1f-bb4c-4c26bfaedff3 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:51.693675 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf338cb-b9c8-4d1f-bb4c-4c26bfaedff3 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:51.694181 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf338cb-b9c8-4d1f-bb4c-4c26bfaedff3 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:51.701391 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 234/467] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:51 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:51.704132 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf338cb-b9c8-4d1f-bb4c-4c26bfaedff3 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:51.786007 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2753a-ac47-4aaf-beb2-30d75c3b9837 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:51.791250 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:51.836841 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692392f0-9b9a-4162-bb57-6ced9cb87fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:51.837709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692392f0-9b9a-4162-bb57-6ced9cb87fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:51.838048 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692392f0-9b9a-4162-bb57-6ced9cb87fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:51.838324 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692392f0-9b9a-4162-bb57-6ced9cb87fe8 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:51.839421 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692392f0-9b9a-4162-bb57-6ced9cb87fe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:51.839747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692392f0-9b9a-4162-bb57-6ced9cb87fe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:51.841187 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692392f0-9b9a-4162-bb57-6ced9cb87fe8 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:51.858651 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 234/468] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:51.860129 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02e5fc-d32b-4963-99c6-083e390f83b7 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:51.860417 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02e5fc-d32b-4963-99c6-083e390f83b7 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:51.860694 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02e5fc-d32b-4963-99c6-083e390f83b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:51.861320 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf338cb-b9c8-4d1f-bb4c-4c26bfaedff3 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:51.880511 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-ad02e5fc-d32b-4963-99c6-083e390f83b7 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:51.881711 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ad02e5fc-d32b-4963-99c6-083e390f83b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:51.911251 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de1824-62b1-46d5-8bd1-b6cf1f9d0773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:51.911866 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de1824-62b1-46d5-8bd1-b6cf1f9d0773 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:51.912370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de1824-62b1-46d5-8bd1-b6cf1f9d0773 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:51.912370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de1824-62b1-46d5-8bd1-b6cf1f9d0773 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:51.913112 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de1824-62b1-46d5-8bd1-b6cf1f9d0773 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:51.913484 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de1824-62b1-46d5-8bd1-b6cf1f9d0773 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:51.914932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de1824-62b1-46d5-8bd1-b6cf1f9d0773 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:51.931930 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 235/469] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:51.932945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de1824-62b1-46d5-8bd1-b6cf1f9d0773 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:51.979240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 235/470] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:51.979240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02e5fc-d32b-4963-99c6-083e390f83b7 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:51.990564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:52.042722 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de1824-62b1-46d5-8bd1-b6cf1f9d0773 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:52.057848 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:52.084397 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd6020-852f-4df3-bf90-6033edb263a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:52.084628 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02e5fc-d32b-4963-99c6-083e390f83b7 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:52.085078 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd6020-852f-4df3-bf90-6033edb263a5 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:52.085361 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd6020-852f-4df3-bf90-6033edb263a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:52.085637 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd6020-852f-4df3-bf90-6033edb263a5 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:52.086540 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd6020-852f-4df3-bf90-6033edb263a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:52.088766 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd6020-852f-4df3-bf90-6033edb263a5 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:52.121847 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 236/471] 10.222.0.57 () {60 vars in 1132 bytes} [Sat Jun 4 08:09:51 2022] POST /identity/v3/users => generated 248 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:09:52.121847 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2be8a-e7b3-4fe6-93e6-b1118417aa76 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:52.121847 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2be8a-e7b3-4fe6-93e6-b1118417aa76 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:52.121847 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2be8a-e7b3-4fe6-93e6-b1118417aa76 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:52.121847 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 237/472] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:52.121847 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2be8a-e7b3-4fe6-93e6-b1118417aa76 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:52.122340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd4bd8-337b-49b3-b9ec-667e272d61d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:52.122340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd4bd8-337b-49b3-b9ec-667e272d61d1 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:52.122340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd4bd8-337b-49b3-b9ec-667e272d61d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:52.122340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd4bd8-337b-49b3-b9ec-667e272d61d1 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:52.122611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd4bd8-337b-49b3-b9ec-667e272d61d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:52.124893 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd4bd8-337b-49b3-b9ec-667e272d61d1 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:52.153435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 236/473] 10.222.0.57 () {60 vars in 1132 bytes} [Sat Jun 4 08:09:51 2022] POST /identity/v3/users => generated 248 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:09:52.156085 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b0e01-e501-4d86-9ee7-320806b9ca94 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:52.156371 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b0e01-e501-4d86-9ee7-320806b9ca94 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:52.157024 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b0e01-e501-4d86-9ee7-320806b9ca94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:52.180563 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-522b0e01-e501-4d86-9ee7-320806b9ca94 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:52.181955 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-522b0e01-e501-4d86-9ee7-320806b9ca94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:52.258933 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 237/474] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:52.259668 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:52.270479 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2be8a-e7b3-4fe6-93e6-b1118417aa76 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:52.283264 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b0e01-e501-4d86-9ee7-320806b9ca94 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:52.317945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e4e75-ff6e-4e14-b12a-467c58d508ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:52.318955 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e4e75-ff6e-4e14-b12a-467c58d508ab None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:52.319247 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e4e75-ff6e-4e14-b12a-467c58d508ab None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:52.319929 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e4e75-ff6e-4e14-b12a-467c58d508ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:52.336604 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e4e75-ff6e-4e14-b12a-467c58d508ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:52.339809 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e4e75-ff6e-4e14-b12a-467c58d508ab None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:52.360148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-074e4e75-ff6e-4e14-b12a-467c58d508ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:09:52.360148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:52.360148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:52.360148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:52.360148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:52.360148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:52.360148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:52.360148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:52.360148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:52.360148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:52.360148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:52.360148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:52.360148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:09:52.360148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:09:52.360148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:09:52.361088 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:09:52.361088 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:52.361088 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:52.361088 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:52.361088 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:52.361088 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:52.361088 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:52.361088 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:52.361088 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:52.361088 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:52.361088 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:52.361088 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:52.361088 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:52.361088 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:52.361088 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:52.361088 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:52.361088 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:52.362541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:09:52.362541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:09:52.362541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:09:52.362541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:52.362541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 238/475] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:09:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:52.371066 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e4e75-ff6e-4e14-b12a-467c58d508ab None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:52.398810 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:52.419932 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b0e01-e501-4d86-9ee7-320806b9ca94 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:52.465652 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a21414-c1ae-49e1-ac8a-eb86225a5792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:52.466596 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a21414-c1ae-49e1-ac8a-eb86225a5792 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:52.467721 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a21414-c1ae-49e1-ac8a-eb86225a5792 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:52.468006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a21414-c1ae-49e1-ac8a-eb86225a5792 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:52.468778 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a21414-c1ae-49e1-ac8a-eb86225a5792 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:52.470989 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a21414-c1ae-49e1-ac8a-eb86225a5792 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:52.480009 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.sql.core [None req-94a21414-c1ae-49e1-ac8a-eb86225a5792 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 04 08:09:52.480009 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 04 08:09:52.480009 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [parameters: {'id': '1a582c103fd44f47b0aa40a214a293e6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 04 08:09:52.480009 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80163) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 04 08:09:52.500393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-94a21414-c1ae-49e1-ac8a-eb86225a5792 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 04 08:09:52.500393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:52.500393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 04 08:09:52.500393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 04 08:09:52.500393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 04 08:09:52.500393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 04 08:09:52.500393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 04 08:09:52.500393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application result = self._query(query) Jun 04 08:09:52.500393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 04 08:09:52.500393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application conn.query(q) Jun 04 08:09:52.500393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 04 08:09:52.500393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 04 08:09:52.500393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 04 08:09:52.500393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application result.read() Jun 04 08:09:52.500393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 04 08:09:52.501348 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 04 08:09:52.501348 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 04 08:09:52.501348 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 04 08:09:52.501348 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 04 08:09:52.501348 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 04 08:09:52.501348 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 04 08:09:52.501348 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 04 08:09:52.501348 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 04 08:09:52.501348 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:52.501348 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 04 08:09:52.501348 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:52.501348 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:52.501348 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 04 08:09:52.501348 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 04 08:09:52.501348 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 04 08:09:52.501348 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return ref.to_dict() Jun 04 08:09:52.501348 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 04 08:09:52.501348 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application next(self.gen) Jun 04 08:09:52.502286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 04 08:09:52.502286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application yield resource Jun 04 08:09:52.502286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 04 08:09:52.502286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application next(self.gen) Jun 04 08:09:52.502286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 04 08:09:52.502286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self.session.rollback() Jun 04 08:09:52.502286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 08:09:52.502286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self.force_reraise() Jun 04 08:09:52.502286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 08:09:52.502286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise self.value Jun 04 08:09:52.502286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 04 08:09:52.502286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 04 08:09:52.502286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 04 08:09:52.502286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application session.commit() Jun 04 08:09:52.502286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 04 08:09:52.502286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 04 08:09:52.502286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 04 08:09:52.503811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._prepare_impl() Jun 04 08:09:52.503811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 04 08:09:52.503811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self.session.flush() Jun 04 08:09:52.503811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 04 08:09:52.503811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._flush(objects) Jun 04 08:09:52.503811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 04 08:09:52.503811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 04 08:09:52.503811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 04 08:09:52.503811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application compat.raise_( Jun 04 08:09:52.503811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 08:09:52.503811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception Jun 04 08:09:52.503811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 04 08:09:52.503811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application flush_context.execute() Jun 04 08:09:52.503811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 04 08:09:52.503811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rec.execute(self) Jun 04 08:09:52.503811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 04 08:09:52.503811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 04 08:09:52.506469 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 04 08:09:52.506469 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 04 08:09:52.506469 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 04 08:09:52.506469 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 04 08:09:52.506469 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 04 08:09:52.506469 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 04 08:09:52.506469 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 04 08:09:52.506469 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 04 08:09:52.506469 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 04 08:09:52.506469 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 04 08:09:52.506469 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 04 08:09:52.506469 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 04 08:09:52.506469 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 04 08:09:52.506469 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 04 08:09:52.506469 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 08:09:52.506469 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception Jun 04 08:09:52.508852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 04 08:09:52.508852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 04 08:09:52.508852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 04 08:09:52.508852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 04 08:09:52.508852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 04 08:09:52.508852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application result = self._query(query) Jun 04 08:09:52.508852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 04 08:09:52.508852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application conn.query(q) Jun 04 08:09:52.508852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 04 08:09:52.508852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 04 08:09:52.508852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 04 08:09:52.508852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application result.read() Jun 04 08:09:52.508852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 04 08:09:52.508852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 04 08:09:52.508852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 04 08:09:52.508852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 04 08:09:52.510904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 04 08:09:52.510904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 04 08:09:52.510904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 04 08:09:52.510904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 04 08:09:52.510904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 04 08:09:52.510904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 04 08:09:52.510904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [parameters: {'id': '1a582c103fd44f47b0aa40a214a293e6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 04 08:09:52.510904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 04 08:09:52.510904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:52.510904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 08:09:52.510904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:52.510904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:52.510904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:52.510904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:52.510904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:52.510904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:52.513117 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:52.513117 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:52.513117 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:52.513117 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:52.513117 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:52.513117 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:52.513117 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 04 08:09:52.513117 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 04 08:09:52.513117 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:52.513117 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:52.513117 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 04 08:09:52.513117 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 04 08:09:52.513117 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 04 08:09:52.513117 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 04 08:09:52.513117 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 04 08:09:52.513117 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:52.517536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 238/476] 10.222.0.57 () {60 vars in 1131 bytes} [Sat Jun 4 08:09:52 2022] POST /identity/v3/roles => generated 144 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:52.517536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a21414-c1ae-49e1-ac8a-eb86225a5792 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:52.517797 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e4e75-ff6e-4e14-b12a-467c58d508ab None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:52.558066 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b67bb0-0dc2-4641-8475-d56f271e0d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:52.558808 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b67bb0-0dc2-4641-8475-d56f271e0d59 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:52.559148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b67bb0-0dc2-4641-8475-d56f271e0d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:52.559531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b67bb0-0dc2-4641-8475-d56f271e0d59 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:52.560260 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b67bb0-0dc2-4641-8475-d56f271e0d59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:52.560620 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b67bb0-0dc2-4641-8475-d56f271e0d59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:52.562103 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b67bb0-0dc2-4641-8475-d56f271e0d59 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:52.576686 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 239/477] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:52.582183 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b67bb0-0dc2-4641-8475-d56f271e0d59 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:52.608305 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:52.687197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:52.696665 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a21414-c1ae-49e1-ac8a-eb86225a5792 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:52.710580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b67bb0-0dc2-4641-8475-d56f271e0d59 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:52.752214 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc54cda-c083-4a1c-ba16-7c3f73f41330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:52.752934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc54cda-c083-4a1c-ba16-7c3f73f41330 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:52.753223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc54cda-c083-4a1c-ba16-7c3f73f41330 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:52.753500 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc54cda-c083-4a1c-ba16-7c3f73f41330 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:52.754814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc54cda-c083-4a1c-ba16-7c3f73f41330 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:52.756384 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc54cda-c083-4a1c-ba16-7c3f73f41330 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:52.783068 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da746d-4d32-4e7e-808f-3c1d32055bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:52.784354 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da746d-4d32-4e7e-808f-3c1d32055bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:52.784656 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da746d-4d32-4e7e-808f-3c1d32055bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:52.784945 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da746d-4d32-4e7e-808f-3c1d32055bc4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:52.788785 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 240/478] 10.222.0.57 () {60 vars in 1132 bytes} [Sat Jun 4 08:09:52 2022] POST /identity/v3/users => generated 249 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:09:52.815119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da746d-4d32-4e7e-808f-3c1d32055bc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:52.823589 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-d9da746d-4d32-4e7e-808f-3c1d32055bc4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 08:09:52.823589 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:52.823589 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:52.823589 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:52.823589 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:52.823589 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:52.823589 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:52.823589 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:52.823589 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:52.823589 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:52.823589 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:52.823589 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:52.823589 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:52.823589 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:52.823589 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:52.823589 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:52.824799 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:52.824799 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:52.824799 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:52.824799 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:52.824799 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:52.824799 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:52.824799 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:52.824799 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:52.824799 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:52.824799 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:52.824799 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:52.824799 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:52.824799 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:52.824799 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:52.824799 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:52.824799 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:52.825788 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:52.825788 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:52.825788 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:52.825788 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:52.825788 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:52.825788 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:52.825788 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:52.825788 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:52.825788 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:52.825788 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:52.825788 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 08:09:52.825788 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:52.829615 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 239/479] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jun 4 08:09:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:09:52.831123 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc54cda-c083-4a1c-ba16-7c3f73f41330 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:52.964989 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc54cda-c083-4a1c-ba16-7c3f73f41330 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:53.011644 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3394c-e830-4c2d-9a86-c4b9b4ce85fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:53.012251 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3394c-e830-4c2d-9a86-c4b9b4ce85fb None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:53.012533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3394c-e830-4c2d-9a86-c4b9b4ce85fb None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:53.012806 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3394c-e830-4c2d-9a86-c4b9b4ce85fb None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:53.013573 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3394c-e830-4c2d-9a86-c4b9b4ce85fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:53.013927 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3394c-e830-4c2d-9a86-c4b9b4ce85fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:53.015342 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3394c-e830-4c2d-9a86-c4b9b4ce85fb None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:53.018629 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:53.026805 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 241/480] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:09:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:54.473907 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de56cd8-0f24-46f0-8cf0-984aed1cd800 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:54.474464 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de56cd8-0f24-46f0-8cf0-984aed1cd800 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:54.474464 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de56cd8-0f24-46f0-8cf0-984aed1cd800 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:54.476086 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 240/481] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:54.481737 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd9cbd-1a37-4a2d-92f6-ddab36de1f16 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:54.482572 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd9cbd-1a37-4a2d-92f6-ddab36de1f16 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:54.483072 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd9cbd-1a37-4a2d-92f6-ddab36de1f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:54.507744 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e4fd9cbd-1a37-4a2d-92f6-ddab36de1f16 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:54.509312 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e4fd9cbd-1a37-4a2d-92f6-ddab36de1f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:54.593628 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 242/482] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:54.639528 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de56cd8-0f24-46f0-8cf0-984aed1cd800 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:54.783471 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de56cd8-0f24-46f0-8cf0-984aed1cd800 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:54.805264 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:54.830741 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e4252-e6f3-4812-8ce6-faf37f192db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:54.831549 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e4252-e6f3-4812-8ce6-faf37f192db9 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:54.831838 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e4252-e6f3-4812-8ce6-faf37f192db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:54.832110 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e4252-e6f3-4812-8ce6-faf37f192db9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:54.847275 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e4252-e6f3-4812-8ce6-faf37f192db9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:54.855207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-4a9e4252-e6f3-4812-8ce6-faf37f192db9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:09:54.855207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:54.855207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:54.855207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:54.855207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:54.855207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:54.855207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:54.855207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:54.855207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:54.855207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:54.855207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:54.855207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:54.855207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:54.855207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:54.855207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:54.855207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:54.856128 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:54.856128 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:54.856128 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:54.856128 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:54.856128 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:54.856128 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:54.856128 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:54.856128 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:54.856128 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:54.856128 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:54.856128 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:54.856128 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:54.856128 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:54.856128 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:54.856128 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:54.856128 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:54.856945 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:54.856945 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:54.856945 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:54.856945 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:54.856945 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:54.856945 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:54.856945 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:54.856945 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:54.856945 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:54.856945 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:54.856945 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:09:54.856945 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:54.859823 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 241/483] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jun 4 08:09:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:54.863216 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd9cbd-1a37-4a2d-92f6-ddab36de1f16 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:54.903283 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dad4bd-ca3d-4bdf-88e4-ea6269ef45df None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:54.903600 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dad4bd-ca3d-4bdf-88e4-ea6269ef45df None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:54.903849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dad4bd-ca3d-4bdf-88e4-ea6269ef45df None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:54.905547 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 242/484] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 08:09:54.911028 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68982c-f852-4b2c-bde9-951f515b2be1 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:54.911318 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68982c-f852-4b2c-bde9-951f515b2be1 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:54.911752 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68982c-f852-4b2c-bde9-951f515b2be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:54.933109 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-4c68982c-f852-4b2c-bde9-951f515b2be1 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:54.934330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4c68982c-f852-4b2c-bde9-951f515b2be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:55.067305 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 243/485] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 08:09:55.075670 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd9cbd-1a37-4a2d-92f6-ddab36de1f16 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:55.111035 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:55.124757 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ac656-ddc6-45c8-b0c1-1c7d434748ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:55.125437 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ac656-ddc6-45c8-b0c1-1c7d434748ca None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:55.125719 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ac656-ddc6-45c8-b0c1-1c7d434748ca None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:55.126019 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ac656-ddc6-45c8-b0c1-1c7d434748ca None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:55.126771 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ac656-ddc6-45c8-b0c1-1c7d434748ca None admin] RBAC: Adding query filter params (name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:55.127075 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ac656-ddc6-45c8-b0c1-1c7d434748ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:55.128490 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ac656-ddc6-45c8-b0c1-1c7d434748ca None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:55.131258 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68982c-f852-4b2c-bde9-951f515b2be1 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:55.158570 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 243/486] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jun 4 08:09:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:55.160962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ac656-ddc6-45c8-b0c1-1c7d434748ca None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:55.261325 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68982c-f852-4b2c-bde9-951f515b2be1 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:55.274889 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:55.294806 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ac656-ddc6-45c8-b0c1-1c7d434748ca None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:55.301762 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1c77f-fa1a-4b2d-b9bb-062ba501ccf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:55.302672 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1c77f-fa1a-4b2d-b9bb-062ba501ccf5 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:55.303018 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1c77f-fa1a-4b2d-b9bb-062ba501ccf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:55.303701 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1c77f-fa1a-4b2d-b9bb-062ba501ccf5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:55.315511 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1c77f-fa1a-4b2d-b9bb-062ba501ccf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:55.323937 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-daf1c77f-fa1a-4b2d-b9bb-062ba501ccf5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:09:55.323937 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:55.323937 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:55.323937 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:55.323937 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:55.323937 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:55.323937 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:55.323937 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:55.323937 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:55.323937 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:55.323937 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:55.323937 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:55.323937 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:55.323937 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:55.323937 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:55.323937 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:55.325037 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:55.325037 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:55.325037 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:55.325037 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:55.325037 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:55.325037 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:55.325037 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:55.325037 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:55.325037 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:55.325037 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:55.325037 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:55.325037 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:55.325037 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:55.325037 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:55.325037 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:55.325037 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:55.326075 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:55.326075 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:55.326075 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:55.326075 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:55.326075 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:55.326075 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:55.326075 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:55.326075 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:55.326075 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:55.326075 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:55.326075 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:09:55.326075 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:55.332336 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 244/487] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jun 4 08:09:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:55.333739 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbbe65-6262-4ce4-8a9f-76fedf4d1ba2 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:55.333945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5ee93-f6b2-4fee-a51b-baf3fd22f3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:55.334187 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbbe65-6262-4ce4-8a9f-76fedf4d1ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:55.334539 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbbe65-6262-4ce4-8a9f-76fedf4d1ba2 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:55.334697 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5ee93-f6b2-4fee-a51b-baf3fd22f3bf None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:55.334864 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5ee93-f6b2-4fee-a51b-baf3fd22f3bf None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:55.335147 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5ee93-f6b2-4fee-a51b-baf3fd22f3bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:55.336107 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 245/488] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:55.337295 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbbe65-6262-4ce4-8a9f-76fedf4d1ba2 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:55.357775 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5ee93-f6b2-4fee-a51b-baf3fd22f3bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:55.359639 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5ee93-f6b2-4fee-a51b-baf3fd22f3bf None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:55.383814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-aee5ee93-f6b2-4fee-a51b-baf3fd22f3bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:09:55.383814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:55.383814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:55.383814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:55.383814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:55.383814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:55.383814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:55.383814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:55.383814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:55.383814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:55.383814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:55.383814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:55.383814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:09:55.383814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:09:55.383814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:09:55.385656 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:09:55.385656 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:55.385656 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:55.385656 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:55.385656 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:55.385656 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:55.385656 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:55.385656 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:55.385656 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:55.385656 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:55.385656 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:55.385656 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:55.385656 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:55.385656 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:55.385656 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:55.385656 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:55.385656 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:55.387724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:09:55.387724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:09:55.387724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:09:55.387724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:55.387724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 244/489] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:09:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:09:55.387724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d717e1d-9e2e-4a94-89a3-0e29d327d2b5 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:55.387724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d717e1d-9e2e-4a94-89a3-0e29d327d2b5 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:55.387724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d717e1d-9e2e-4a94-89a3-0e29d327d2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:55.414240 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-9d717e1d-9e2e-4a94-89a3-0e29d327d2b5 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:55.415438 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9d717e1d-9e2e-4a94-89a3-0e29d327d2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:55.454117 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:55.482292 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbbe65-6262-4ce4-8a9f-76fedf4d1ba2 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:55.494625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 245/490] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:55.495584 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d717e1d-9e2e-4a94-89a3-0e29d327d2b5 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:55.544061 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d092b7-cec6-4219-9528-c37e12487852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:55.545797 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d092b7-cec6-4219-9528-c37e12487852 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:55.546143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d092b7-cec6-4219-9528-c37e12487852 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:55.546428 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d092b7-cec6-4219-9528-c37e12487852 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:55.547220 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d092b7-cec6-4219-9528-c37e12487852 None admin] RBAC: Adding query filter params (name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:55.547534 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d092b7-cec6-4219-9528-c37e12487852 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:55.548969 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d092b7-cec6-4219-9528-c37e12487852 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:55.560306 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 246/491] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jun 4 08:09:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:09:55.561229 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d092b7-cec6-4219-9528-c37e12487852 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:55.599612 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:55.681834 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d092b7-cec6-4219-9528-c37e12487852 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:55.733460 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88c0ee-a052-441f-a3f0-08f1b17342d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:55.734563 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88c0ee-a052-441f-a3f0-08f1b17342d1 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:55.734857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88c0ee-a052-441f-a3f0-08f1b17342d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:55.735135 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88c0ee-a052-441f-a3f0-08f1b17342d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:55.745415 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d717e1d-9e2e-4a94-89a3-0e29d327d2b5 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:55.750156 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d88c0ee-a052-441f-a3f0-08f1b17342d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:55.761235 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-0d88c0ee-a052-441f-a3f0-08f1b17342d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:09:55.761235 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:55.761235 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:55.761235 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:55.761235 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:55.761235 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:55.761235 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:55.761235 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:55.761235 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:55.761235 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:55.761235 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:55.761235 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:55.761235 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:55.761235 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:55.761235 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:55.761235 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:55.763084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:55.763084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:55.763084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:55.763084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:55.763084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:55.763084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:55.763084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:55.763084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:55.763084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:55.763084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:55.763084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:55.763084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:55.763084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:55.763084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:55.763084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:55.763084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:55.764772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:55.764772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:55.764772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:55.764772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:55.764772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:55.764772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:55.764772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:55.764772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:55.764772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:55.764772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:55.764772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:09:55.764772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:55.774064 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 247/492] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jun 4 08:09:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:55.774064 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88c0ee-a052-441f-a3f0-08f1b17342d1 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:55.792924 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e282df5-b365-4929-b581-173a612569ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:55.793872 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e282df5-b365-4929-b581-173a612569ed None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:55.794168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e282df5-b365-4929-b581-173a612569ed None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:55.794449 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e282df5-b365-4929-b581-173a612569ed None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:55.795626 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e282df5-b365-4929-b581-173a612569ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:55.796200 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e282df5-b365-4929-b581-173a612569ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:55.797910 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e282df5-b365-4929-b581-173a612569ed None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:55.813872 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 246/493] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:09:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:55.813872 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e282df5-b365-4929-b581-173a612569ed None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:55.847188 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:55.871498 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:55.881952 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88c0ee-a052-441f-a3f0-08f1b17342d1 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:55.917590 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e282df5-b365-4929-b581-173a612569ed None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:55.922413 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67261b6-df62-4310-9bd8-178da5ec5a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:55.923207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67261b6-df62-4310-9bd8-178da5ec5a0e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:55.923494 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67261b6-df62-4310-9bd8-178da5ec5a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:55.923773 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67261b6-df62-4310-9bd8-178da5ec5a0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:55.934594 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67261b6-df62-4310-9bd8-178da5ec5a0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:55.936047 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67261b6-df62-4310-9bd8-178da5ec5a0e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:55.950829 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2646c0-cc16-423c-919e-2d277953102a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:55.951469 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2646c0-cc16-423c-919e-2d277953102a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:55.951750 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2646c0-cc16-423c-919e-2d277953102a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:55.952022 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2646c0-cc16-423c-919e-2d277953102a None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:55.952754 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2646c0-cc16-423c-919e-2d277953102a None admin] RBAC: Adding query filter params (name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:55.953056 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2646c0-cc16-423c-919e-2d277953102a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:55.953923 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-f67261b6-df62-4310-9bd8-178da5ec5a0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:09:55.953923 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:55.953923 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:55.953923 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:55.953923 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:55.953923 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:55.953923 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:55.953923 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:55.953923 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:55.953923 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:55.953923 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:55.953923 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:55.953923 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:09:55.953923 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:09:55.953923 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:09:55.954911 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:09:55.954911 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:55.954911 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:55.954911 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:55.954911 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:55.954911 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:55.954911 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:55.954911 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:55.954911 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:55.954911 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:55.954911 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:55.954911 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:55.954911 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:55.954911 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:55.954911 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:55.954911 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:55.954911 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:55.956577 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:09:55.956577 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:09:55.956577 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:09:55.956577 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:55.956844 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2646c0-cc16-423c-919e-2d277953102a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:55.960209 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 248/494] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:09:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:55.961470 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b1e36-face-483f-934d-bdc2f769027c None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:55.961763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b1e36-face-483f-934d-bdc2f769027c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:55.962068 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b1e36-face-483f-934d-bdc2f769027c None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:55.963333 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 249/495] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:55.963922 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 247/496] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jun 4 08:09:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:55.964104 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b1e36-face-483f-934d-bdc2f769027c None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:55.965020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0eda2-dfc7-410d-b074-de5caac9216b None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:55.965307 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0eda2-dfc7-410d-b074-de5caac9216b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:55.965581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0eda2-dfc7-410d-b074-de5caac9216b None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:55.970159 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 248/497] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:09:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:09:55.970784 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0eda2-dfc7-410d-b074-de5caac9216b None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:56.064822 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:56.070520 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b1e36-face-483f-934d-bdc2f769027c None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:56.073460 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0eda2-dfc7-410d-b074-de5caac9216b None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:56.103201 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a768f5-28a9-4395-b306-cb16edd41f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:56.103984 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a768f5-28a9-4395-b306-cb16edd41f87 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:56.104265 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a768f5-28a9-4395-b306-cb16edd41f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:56.104538 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a768f5-28a9-4395-b306-cb16edd41f87 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:56.106075 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897c36a-6ada-4afd-b407-183326dfe16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:56.106733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897c36a-6ada-4afd-b407-183326dfe16d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:56.107008 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897c36a-6ada-4afd-b407-183326dfe16d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:56.107290 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897c36a-6ada-4afd-b407-183326dfe16d None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:56.108002 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897c36a-6ada-4afd-b407-183326dfe16d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:56.108309 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897c36a-6ada-4afd-b407-183326dfe16d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:56.109658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897c36a-6ada-4afd-b407-183326dfe16d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:56.112432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a768f5-28a9-4395-b306-cb16edd41f87 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:56.113956 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a768f5-28a9-4395-b306-cb16edd41f87 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:56.122002 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 249/498] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:09:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:56.123187 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957f533-ff5d-458c-9288-7915137d4387 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:56.123479 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957f533-ff5d-458c-9288-7915137d4387 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:56.123755 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957f533-ff5d-458c-9288-7915137d4387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:56.129432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-d0a768f5-28a9-4395-b306-cb16edd41f87 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 08:09:56.129432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:56.129432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:56.129432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:56.129432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:56.129432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:56.129432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:56.129432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:56.129432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:56.129432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:56.129432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:56.129432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:56.129432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:09:56.129432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:09:56.129432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:09:56.129432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:09:56.130614 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:56.130614 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:56.130614 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:09:56.130614 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:09:56.130614 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:09:56.130614 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:09:56.130614 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:56.130614 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:56.130614 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:56.130614 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:56.130614 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:56.130614 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:56.130614 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:56.130614 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:56.130614 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:56.130614 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:56.130614 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:56.130614 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:56.131646 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:56.131646 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:56.131646 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:09:56.131646 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:09:56.131646 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:09:56.131646 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:09:56.131646 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:09:56.131646 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:09:56.131646 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 08:09:56.131646 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:56.131646 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 250/499] 10.222.0.57 () {56 vars in 1093 bytes} [Sat Jun 4 08:09:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:56.131646 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a768f5-28a9-4395-b306-cb16edd41f87 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:56.135293 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:56.144768 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-a957f533-ff5d-458c-9288-7915137d4387 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:56.145969 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a957f533-ff5d-458c-9288-7915137d4387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:56.210336 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 250/500] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:56.211616 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcf104-39e5-4ddf-95e7-305c4c9c9c6d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:56.211934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcf104-39e5-4ddf-95e7-305c4c9c9c6d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:56.212183 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcf104-39e5-4ddf-95e7-305c4c9c9c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:56.227659 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-93bcf104-39e5-4ddf-95e7-305c4c9c9c6d None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:09:56.228841 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-93bcf104-39e5-4ddf-95e7-305c4c9c9c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:09:56.231476 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a768f5-28a9-4395-b306-cb16edd41f87 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:56.265427 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296cd55-ad77-4dbd-bb74-8185ce3492c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:56.266244 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296cd55-ad77-4dbd-bb74-8185ce3492c8 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:56.266526 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296cd55-ad77-4dbd-bb74-8185ce3492c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:56.266799 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296cd55-ad77-4dbd-bb74-8185ce3492c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:56.277233 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296cd55-ad77-4dbd-bb74-8185ce3492c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:56.278724 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296cd55-ad77-4dbd-bb74-8185ce3492c8 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:56.294078 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 251/501] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:09:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:09:56.294901 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bcf104-39e5-4ddf-95e7-305c4c9c9c6d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:56.299193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-6296cd55-ad77-4dbd-bb74-8185ce3492c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:09:56.299193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:56.299193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:56.299193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:56.299193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:56.299193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:56.299193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:56.299193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:56.299193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:56.299193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:56.299193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:56.299193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:56.299193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:09:56.299193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:09:56.299193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:09:56.300539 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:09:56.300539 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:56.300539 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:56.300539 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:56.300539 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:56.300539 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:56.300539 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:56.300539 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:56.300539 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:56.300539 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:56.300539 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:56.300539 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:56.300539 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:56.300539 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:56.300539 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:56.300539 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:56.300539 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:56.301402 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:09:56.301402 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:09:56.301402 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:09:56.301402 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:56.305481 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 251/502] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:09:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:56.306323 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296cd55-ad77-4dbd-bb74-8185ce3492c8 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:56.310640 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:56.364228 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:56.394441 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bcf104-39e5-4ddf-95e7-305c4c9c9c6d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:56.407319 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296cd55-ad77-4dbd-bb74-8185ce3492c8 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:56.427900 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2eb1ce-9333-431b-aeac-4044727b7fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:56.428939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2eb1ce-9333-431b-aeac-4044727b7fea None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:56.429224 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2eb1ce-9333-431b-aeac-4044727b7fea None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:56.429500 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2eb1ce-9333-431b-aeac-4044727b7fea None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:56.436389 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2eb1ce-9333-431b-aeac-4044727b7fea None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:56.437849 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2eb1ce-9333-431b-aeac-4044727b7fea None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:56.441215 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7f6bd-b437-465b-a8ab-68cb4cc7c203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:56.441905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7f6bd-b437-465b-a8ab-68cb4cc7c203 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:56.442194 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7f6bd-b437-465b-a8ab-68cb4cc7c203 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:56.442474 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7f6bd-b437-465b-a8ab-68cb4cc7c203 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:56.443300 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7f6bd-b437-465b-a8ab-68cb4cc7c203 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:56.443612 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7f6bd-b437-465b-a8ab-68cb4cc7c203 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:56.445021 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7f6bd-b437-465b-a8ab-68cb4cc7c203 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:56.453061 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-df2eb1ce-9333-431b-aeac-4044727b7fea None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 04 08:09:56.453061 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:56.453061 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:56.453061 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:56.453061 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:56.453061 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:56.453061 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:56.453061 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:56.453061 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:56.453061 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:56.453061 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:56.453061 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:56.453061 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:09:56.453061 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:09:56.453061 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:09:56.453061 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:09:56.454145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:56.454145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:56.454145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:09:56.454145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:09:56.454145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:09:56.454145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:09:56.454145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:56.454145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:56.454145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:56.454145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:56.454145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:56.454145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:56.454145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:56.454145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:56.454145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:56.454145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:56.454145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:56.454145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:56.455157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:56.455157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:56.455157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:09:56.455157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:09:56.455157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:09:56.455157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:09:56.455157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:09:56.455157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:09:56.455157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 04 08:09:56.455157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:56.455157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 252/503] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:56.455875 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2eb1ce-9333-431b-aeac-4044727b7fea None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:56.482073 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 252/504] 10.222.0.57 () {56 vars in 1133 bytes} [Sat Jun 4 08:09:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:56.482922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7f6bd-b437-465b-a8ab-68cb4cc7c203 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:56.537032 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:56.562095 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2eb1ce-9333-431b-aeac-4044727b7fea None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:56.581059 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7f6bd-b437-465b-a8ab-68cb4cc7c203 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:56.594323 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790421ed-cc88-4ab9-a638-bcec24e3003b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:56.594655 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:56.595110 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790421ed-cc88-4ab9-a638-bcec24e3003b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:56.595393 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790421ed-cc88-4ab9-a638-bcec24e3003b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:56.595670 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790421ed-cc88-4ab9-a638-bcec24e3003b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:56.606682 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790421ed-cc88-4ab9-a638-bcec24e3003b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:09:56.615038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-790421ed-cc88-4ab9-a638-bcec24e3003b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:09:56.615038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:56.615038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:56.615038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:56.615038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:56.615038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:56.615038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:56.615038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:56.615038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:56.615038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:56.615038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:56.615038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:56.615038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:09:56.615038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:09:56.615038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:09:56.615038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:09:56.616077 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:09:56.616077 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:09:56.616077 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:09:56.616077 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:09:56.616077 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:56.616077 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:56.616077 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:56.616077 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:56.616077 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:56.616077 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:56.616077 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:56.616077 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:56.616077 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:56.616077 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:56.616077 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:56.616077 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:56.616882 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:56.616882 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:56.616882 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:56.616882 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:56.616882 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:09:56.616882 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:09:56.616882 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:09:56.616882 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:09:56.616882 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:09:56.616882 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:09:56.616882 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:09:56.616882 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:56.617662 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46162a7c-49ac-48ef-b60d-43cec3fb39fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:56.617758 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 253/505] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jun 4 08:09:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:56.617852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46162a7c-49ac-48ef-b60d-43cec3fb39fb None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:56.617852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46162a7c-49ac-48ef-b60d-43cec3fb39fb None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:56.617852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46162a7c-49ac-48ef-b60d-43cec3fb39fb None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:56.618051 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790421ed-cc88-4ab9-a638-bcec24e3003b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:56.618117 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46162a7c-49ac-48ef-b60d-43cec3fb39fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:56.618117 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46162a7c-49ac-48ef-b60d-43cec3fb39fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:56.619166 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46162a7c-49ac-48ef-b60d-43cec3fb39fb None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:56.630422 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 253/506] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:56.631208 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46162a7c-49ac-48ef-b60d-43cec3fb39fb None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:56.727880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790421ed-cc88-4ab9-a638-bcec24e3003b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:56.733300 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46162a7c-49ac-48ef-b60d-43cec3fb39fb None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:56.763271 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107aaa1-26aa-46ba-84e9-df944452b311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:56.764144 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107aaa1-26aa-46ba-84e9-df944452b311 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:56.764494 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107aaa1-26aa-46ba-84e9-df944452b311 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:56.764836 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107aaa1-26aa-46ba-84e9-df944452b311 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:56.766419 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c39da0-3d18-4613-b501-194e37f0e919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:56.766730 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:56.767857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c39da0-3d18-4613-b501-194e37f0e919 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:56.768631 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c39da0-3d18-4613-b501-194e37f0e919 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:56.768923 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c39da0-3d18-4613-b501-194e37f0e919 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:56.769764 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c39da0-3d18-4613-b501-194e37f0e919 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:56.770113 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c39da0-3d18-4613-b501-194e37f0e919 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:56.771566 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c39da0-3d18-4613-b501-194e37f0e919 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:56.776577 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107aaa1-26aa-46ba-84e9-df944452b311 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:56.778047 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107aaa1-26aa-46ba-84e9-df944452b311 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:56.789361 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 254/507] 10.222.0.57 () {56 vars in 1137 bytes} [Sat Jun 4 08:09:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:56.790194 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c39da0-3d18-4613-b501-194e37f0e919 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:56.795961 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-d107aaa1-26aa-46ba-84e9-df944452b311 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:09:56.795961 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:56.795961 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:56.795961 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:56.795961 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:56.795961 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:56.795961 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:56.795961 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:56.795961 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:56.795961 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:56.795961 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:56.795961 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:56.795961 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:09:56.795961 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:09:56.795961 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:09:56.796990 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:09:56.796990 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:56.796990 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:56.796990 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:56.796990 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:56.796990 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:56.796990 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:56.796990 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:56.796990 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:56.796990 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:56.796990 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:56.796990 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:56.796990 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:56.796990 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:56.796990 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:56.796990 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:56.796990 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:56.798095 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:09:56.798095 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:09:56.798095 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:09:56.798095 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:56.798095 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 254/508] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:09:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:56.798095 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107aaa1-26aa-46ba-84e9-df944452b311 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:56.821884 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:56.890430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c39da0-3d18-4613-b501-194e37f0e919 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:56.898476 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107aaa1-26aa-46ba-84e9-df944452b311 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:56.929026 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5010e-d350-4ecc-8b32-afd81bbbc8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:56.929666 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5010e-d350-4ecc-8b32-afd81bbbc8b0 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:56.929981 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5010e-d350-4ecc-8b32-afd81bbbc8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:56.930258 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5010e-d350-4ecc-8b32-afd81bbbc8b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:56.933898 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d783788-9489-4e88-be2b-cc60390ac78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:56.934566 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d783788-9489-4e88-be2b-cc60390ac78a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:56.934848 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d783788-9489-4e88-be2b-cc60390ac78a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:56.935122 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d783788-9489-4e88-be2b-cc60390ac78a None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:56.935860 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d783788-9489-4e88-be2b-cc60390ac78a None admin] RBAC: Adding query filter params (name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:56.936164 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d783788-9489-4e88-be2b-cc60390ac78a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:56.937537 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d783788-9489-4e88-be2b-cc60390ac78a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:56.945873 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 255/509] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jun 4 08:09:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:56.946744 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d783788-9489-4e88-be2b-cc60390ac78a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:57.000435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:57.060218 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d783788-9489-4e88-be2b-cc60390ac78a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:57.093968 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f49aa4-5c35-45a8-8cc6-78d742ce6052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:57.094753 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f49aa4-5c35-45a8-8cc6-78d742ce6052 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:57.095034 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f49aa4-5c35-45a8-8cc6-78d742ce6052 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:57.095306 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f49aa4-5c35-45a8-8cc6-78d742ce6052 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:57.103199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f49aa4-5c35-45a8-8cc6-78d742ce6052 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:57.104633 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f49aa4-5c35-45a8-8cc6-78d742ce6052 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:57.118406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-d6f49aa4-5c35-45a8-8cc6-78d742ce6052 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 04 08:09:57.118406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:57.118406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:57.118406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:57.118406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:57.118406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:57.118406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:57.118406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:57.118406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:57.118406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:57.118406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:57.118406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:57.118406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:09:57.118406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:09:57.118406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:09:57.118406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:09:57.119287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:57.119287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:57.119287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:09:57.119287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:09:57.119287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:09:57.119287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:09:57.119287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:57.119287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:57.119287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:57.119287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:57.119287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:57.119287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:57.119287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:57.119287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:57.119287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:57.119287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:57.119287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:57.119287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:57.120172 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:57.120172 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:57.120172 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:09:57.120172 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:09:57.120172 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:09:57.120172 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:09:57.120172 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:09:57.120172 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:09:57.120172 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 04 08:09:57.120172 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:57.120679 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5010e-d350-4ecc-8b32-afd81bbbc8b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:57.120750 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 256/510] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:09:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:57.120822 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5010e-d350-4ecc-8b32-afd81bbbc8b0 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:57.120889 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f49aa4-5c35-45a8-8cc6-78d742ce6052 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:57.149677 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:57.216680 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 255/511] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:09:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 08:09:57.217511 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5010e-d350-4ecc-8b32-afd81bbbc8b0 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:57.226111 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f49aa4-5c35-45a8-8cc6-78d742ce6052 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:57.234874 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:57.260039 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5f470-4a48-46f4-9424-fc363703c847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:57.260618 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5f470-4a48-46f4-9424-fc363703c847 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:57.260896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5f470-4a48-46f4-9424-fc363703c847 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:57.261169 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5f470-4a48-46f4-9424-fc363703c847 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:57.315651 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5010e-d350-4ecc-8b32-afd81bbbc8b0 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:57.327102 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5f470-4a48-46f4-9424-fc363703c847 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:57.328543 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5f470-4a48-46f4-9424-fc363703c847 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:57.344090 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:57.349316 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271c7c6-e837-4073-b16c-270a474891ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:57.349996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271c7c6-e837-4073-b16c-270a474891ab None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:57.350279 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271c7c6-e837-4073-b16c-270a474891ab None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:57.350552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271c7c6-e837-4073-b16c-270a474891ab None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:57.351266 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271c7c6-e837-4073-b16c-270a474891ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:57.351574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271c7c6-e837-4073-b16c-270a474891ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:57.352923 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271c7c6-e837-4073-b16c-270a474891ab None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:57.364070 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 256/512] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:57.364862 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271c7c6-e837-4073-b16c-270a474891ab None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:57.425032 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 257/513] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:09:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 08:09:57.425890 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5f470-4a48-46f4-9424-fc363703c847 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:57.435659 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:57.468355 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271c7c6-e837-4073-b16c-270a474891ab None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:57.501592 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f01bb-d885-46f6-8da5-ede883d2b30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:57.503932 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f01bb-d885-46f6-8da5-ede883d2b30b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:57.504221 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f01bb-d885-46f6-8da5-ede883d2b30b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:57.504493 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f01bb-d885-46f6-8da5-ede883d2b30b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:57.514865 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f01bb-d885-46f6-8da5-ede883d2b30b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:57.516265 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f01bb-d885-46f6-8da5-ede883d2b30b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:57.522547 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5f470-4a48-46f4-9424-fc363703c847 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:57.532872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-0c5f01bb-d885-46f6-8da5-ede883d2b30b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:09:57.532872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:57.532872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:57.532872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:57.532872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:57.532872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:57.532872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:57.532872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:57.532872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:57.532872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:57.532872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:57.532872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:57.532872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:09:57.532872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:09:57.532872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:09:57.533992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:09:57.533992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:57.533992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:57.533992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:57.533992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:57.533992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:57.533992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:57.533992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:57.533992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:57.533992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:57.533992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:57.533992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:57.533992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:57.533992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:57.533992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:57.533992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:57.533992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:57.534884 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:09:57.534884 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:09:57.534884 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:09:57.534884 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:57.538599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 257/514] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:09:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:57.539385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f01bb-d885-46f6-8da5-ede883d2b30b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:57.556321 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672ba88-cdcc-4559-9e4a-363be1af4335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:57.556990 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672ba88-cdcc-4559-9e4a-363be1af4335 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:57.557276 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672ba88-cdcc-4559-9e4a-363be1af4335 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:57.557555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672ba88-cdcc-4559-9e4a-363be1af4335 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:57.558421 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672ba88-cdcc-4559-9e4a-363be1af4335 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:57.558730 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672ba88-cdcc-4559-9e4a-363be1af4335 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:57.560162 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672ba88-cdcc-4559-9e4a-363be1af4335 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:57.583895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:57.595815 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 258/515] 10.222.0.57 () {56 vars in 1137 bytes} [Sat Jun 4 08:09:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:57.596605 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672ba88-cdcc-4559-9e4a-363be1af4335 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:57.639692 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f01bb-d885-46f6-8da5-ede883d2b30b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:57.660690 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:57.673017 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce58ab-793c-493c-a041-c4ea8ee7fb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:57.673804 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce58ab-793c-493c-a041-c4ea8ee7fb2d None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:57.674116 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce58ab-793c-493c-a041-c4ea8ee7fb2d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:57.674931 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce58ab-793c-493c-a041-c4ea8ee7fb2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:57.685691 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce58ab-793c-493c-a041-c4ea8ee7fb2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:57.687220 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce58ab-793c-493c-a041-c4ea8ee7fb2d None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:57.695649 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672ba88-cdcc-4559-9e4a-363be1af4335 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:57.704768 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-65ce58ab-793c-493c-a041-c4ea8ee7fb2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:09:57.704768 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:57.704768 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:57.704768 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:57.704768 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:57.704768 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:57.704768 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:57.704768 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:57.704768 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:57.704768 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:57.704768 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:57.704768 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:57.704768 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:09:57.704768 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:09:57.704768 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:09:57.705947 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:09:57.705947 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:57.705947 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:57.705947 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:57.705947 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:57.705947 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:57.705947 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:57.705947 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:57.705947 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:57.705947 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:57.705947 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:57.705947 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:57.705947 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:57.705947 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:57.705947 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:57.705947 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:57.705947 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:57.706853 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:09:57.706853 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:09:57.706853 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:09:57.706853 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:57.706853 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 258/516] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:09:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:57.707124 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce58ab-793c-493c-a041-c4ea8ee7fb2d None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:57.733468 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4eeac9-37e2-44b4-8832-f00d5c862fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:57.734172 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4eeac9-37e2-44b4-8832-f00d5c862fcd None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:57.734454 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4eeac9-37e2-44b4-8832-f00d5c862fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:57.734729 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4eeac9-37e2-44b4-8832-f00d5c862fcd None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:57.735424 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4eeac9-37e2-44b4-8832-f00d5c862fcd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:57.737379 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4eeac9-37e2-44b4-8832-f00d5c862fcd None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:57.756428 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 259/517] 10.222.0.57 () {60 vars in 1132 bytes} [Sat Jun 4 08:09:57 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:09:57.757223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4eeac9-37e2-44b4-8832-f00d5c862fcd None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:57.818302 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:57.825061 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce58ab-793c-493c-a041-c4ea8ee7fb2d None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:57.867181 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a45c2-deff-4336-ae87-da9965821dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:57.867989 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a45c2-deff-4336-ae87-da9965821dbe None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:57.868269 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a45c2-deff-4336-ae87-da9965821dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:57.868429 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4eeac9-37e2-44b4-8832-f00d5c862fcd None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:57.868538 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a45c2-deff-4336-ae87-da9965821dbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:57.880349 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a45c2-deff-4336-ae87-da9965821dbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:57.881852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a45c2-deff-4336-ae87-da9965821dbe None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:57.892915 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:57.900385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-880a45c2-deff-4336-ae87-da9965821dbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:09:57.900385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:57.900385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:57.900385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:57.900385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:57.900385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:57.900385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:57.900385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:57.900385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:57.900385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:57.900385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:57.900385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:57.900385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:09:57.900385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:09:57.900385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:09:57.901330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:09:57.901330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:57.901330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:57.901330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:57.901330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:57.901330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:57.901330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:57.901330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:57.901330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:57.901330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:57.901330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:57.901330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:57.901330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:57.901330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:57.901330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:57.901330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:57.901330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:57.902227 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:09:57.902227 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:09:57.902227 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:09:57.902227 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:57.902227 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 259/518] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:09:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:57.902493 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a45c2-deff-4336-ae87-da9965821dbe None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:57.925116 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b2a63-b205-4ed5-b171-550370c9bb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:57.925806 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b2a63-b205-4ed5-b171-550370c9bb27 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:57.926130 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b2a63-b205-4ed5-b171-550370c9bb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:57.926411 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b2a63-b205-4ed5-b171-550370c9bb27 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:57.927161 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b2a63-b205-4ed5-b171-550370c9bb27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:57.927471 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b2a63-b205-4ed5-b171-550370c9bb27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:57.929147 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b2a63-b205-4ed5-b171-550370c9bb27 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:57.942460 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 260/519] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:57.943235 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b2a63-b205-4ed5-b171-550370c9bb27 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:58.018320 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a45c2-deff-4336-ae87-da9965821dbe None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:58.052471 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c3296-9abc-4d1d-8201-1bc8f4af529f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:58.053363 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c3296-9abc-4d1d-8201-1bc8f4af529f None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:58.053653 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c3296-9abc-4d1d-8201-1bc8f4af529f None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:58.053960 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c3296-9abc-4d1d-8201-1bc8f4af529f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:58.058055 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b2a63-b205-4ed5-b171-550370c9bb27 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:58.071810 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:58.094179 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2167c-9a4b-47a2-87ce-362530db160d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:58.095065 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2167c-9a4b-47a2-87ce-362530db160d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:58.095347 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2167c-9a4b-47a2-87ce-362530db160d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:58.095619 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2167c-9a4b-47a2-87ce-362530db160d None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:58.096865 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2167c-9a4b-47a2-87ce-362530db160d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:58.097168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2167c-9a4b-47a2-87ce-362530db160d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:58.098551 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2167c-9a4b-47a2-87ce-362530db160d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:58.109957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 261/520] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:58.114677 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2167c-9a4b-47a2-87ce-362530db160d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:58.127066 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c3296-9abc-4d1d-8201-1bc8f4af529f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:58.128566 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c3296-9abc-4d1d-8201-1bc8f4af529f None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:58.160327 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:58.220522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2167c-9a4b-47a2-87ce-362530db160d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:58.242682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 260/521] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:09:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 08:09:58.242682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c3296-9abc-4d1d-8201-1bc8f4af529f None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:58.267226 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01812630-b40c-4379-9e50-b6f5fdac9bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:58.268540 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01812630-b40c-4379-9e50-b6f5fdac9bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:58.268947 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01812630-b40c-4379-9e50-b6f5fdac9bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:58.269222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01812630-b40c-4379-9e50-b6f5fdac9bf5 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:58.269973 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01812630-b40c-4379-9e50-b6f5fdac9bf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:58.270279 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01812630-b40c-4379-9e50-b6f5fdac9bf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:58.271779 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01812630-b40c-4379-9e50-b6f5fdac9bf5 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:58.285612 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 262/522] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:58.286296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01812630-b40c-4379-9e50-b6f5fdac9bf5 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:58.295424 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:58.349908 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c3296-9abc-4d1d-8201-1bc8f4af529f None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:58.384374 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759eba2-f902-4483-ad97-f589bdc5eece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:58.385210 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759eba2-f902-4483-ad97-f589bdc5eece None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:58.385497 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759eba2-f902-4483-ad97-f589bdc5eece None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:58.385770 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759eba2-f902-4483-ad97-f589bdc5eece None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:58.392810 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759eba2-f902-4483-ad97-f589bdc5eece None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:58.394455 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01812630-b40c-4379-9e50-b6f5fdac9bf5 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:58.394831 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759eba2-f902-4483-ad97-f589bdc5eece None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:58.396815 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:58.410585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-c759eba2-f902-4483-ad97-f589bdc5eece None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 04 08:09:58.410585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:58.410585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:58.410585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:58.410585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:58.410585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:58.410585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:58.410585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:58.410585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:58.410585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:58.410585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:58.410585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:58.410585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:09:58.410585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:09:58.410585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:09:58.410585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:09:58.411660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:58.411660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:58.411660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:09:58.411660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:09:58.411660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:09:58.411660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:09:58.411660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:58.411660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:58.411660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:58.411660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:58.411660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:58.411660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:58.411660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:58.411660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:58.411660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:58.411660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:58.411660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:58.411660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:58.412565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:58.412565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:58.412565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:09:58.412565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:09:58.412565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:09:58.412565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:09:58.412565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:09:58.412565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:09:58.412565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 04 08:09:58.412565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:58.412565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 261/523] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jun 4 08:09:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:58.412565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759eba2-f902-4483-ad97-f589bdc5eece None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:58.435741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bec92-df8f-41d0-8f08-e9c335bd8208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:58.436772 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bec92-df8f-41d0-8f08-e9c335bd8208 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:58.437255 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bec92-df8f-41d0-8f08-e9c335bd8208 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:58.437762 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bec92-df8f-41d0-8f08-e9c335bd8208 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:58.445321 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67bec92-df8f-41d0-8f08-e9c335bd8208 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:58.447231 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67bec92-df8f-41d0-8f08-e9c335bd8208 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:58.463150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-b67bec92-df8f-41d0-8f08-e9c335bd8208 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:09:58.463150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:58.463150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:58.463150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:58.463150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:58.463150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:58.463150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:58.463150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:58.463150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:58.463150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:58.463150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:58.463150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:58.463150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:09:58.463150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:09:58.463150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:09:58.464118 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:09:58.464118 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:58.464118 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:58.464118 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:58.464118 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:58.464118 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:58.464118 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:58.464118 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:58.464118 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:58.464118 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:58.464118 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:58.464118 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:58.464118 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:58.464118 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:58.464118 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:58.464118 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:58.464118 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:58.465223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:09:58.465223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:09:58.465223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:09:58.465223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:09:58.465223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:09:58.465223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:09:58.465223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:09:58.465223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:58.467106 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 263/524] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:09:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:58.467999 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bec92-df8f-41d0-8f08-e9c335bd8208 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:58.520617 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759eba2-f902-4483-ad97-f589bdc5eece None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:58.530700 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:58.557257 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666ea9b-afcb-4df7-96cc-4de19f9a9e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:58.558234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666ea9b-afcb-4df7-96cc-4de19f9a9e50 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:58.558518 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666ea9b-afcb-4df7-96cc-4de19f9a9e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:58.558790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666ea9b-afcb-4df7-96cc-4de19f9a9e50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:58.569368 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c666ea9b-afcb-4df7-96cc-4de19f9a9e50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:58.570876 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c666ea9b-afcb-4df7-96cc-4de19f9a9e50 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:58.578055 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bec92-df8f-41d0-8f08-e9c335bd8208 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:58.588697 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-c666ea9b-afcb-4df7-96cc-4de19f9a9e50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:09:58.588697 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:58.588697 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:58.588697 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:58.588697 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:58.588697 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:58.588697 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:58.588697 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:58.588697 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:58.588697 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:58.588697 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:58.588697 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:58.588697 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:09:58.588697 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:09:58.588697 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:09:58.589756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:09:58.589756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:58.589756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:58.589756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:58.589756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:58.589756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:58.589756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:58.589756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:58.589756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:58.589756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:58.589756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:58.589756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:58.589756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:58.589756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:58.589756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:58.589756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:58.589756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:58.590826 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:09:58.590826 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:09:58.590826 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:09:58.590826 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:09:58.594227 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 262/525] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:09:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:58.595051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666ea9b-afcb-4df7-96cc-4de19f9a9e50 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:58.617206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20044484-8a41-4e67-9f69-15145012a16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:58.618371 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20044484-8a41-4e67-9f69-15145012a16b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:58.618855 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20044484-8a41-4e67-9f69-15145012a16b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:58.619315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20044484-8a41-4e67-9f69-15145012a16b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:58.626963 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20044484-8a41-4e67-9f69-15145012a16b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:58.629394 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20044484-8a41-4e67-9f69-15145012a16b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:58.645137 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-20044484-8a41-4e67-9f69-15145012a16b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:09:58.645137 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:58.645137 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:58.645137 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:58.645137 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:58.645137 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:58.645137 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:58.645137 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:58.645137 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:58.645137 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:58.645137 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:58.645137 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:58.645137 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:09:58.645137 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:09:58.645137 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:09:58.646157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:09:58.646157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:58.646157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:58.646157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:58.646157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:58.646157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:58.646157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:58.646157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:58.646157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:58.646157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:58.646157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:58.646157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:58.646157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:58.646157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:58.646157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:58.646157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:58.646157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:58.647199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:09:58.647199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:09:58.647199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:09:58.647199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:09:58.647199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:09:58.647199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:09:58.647199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:09:58.647199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:58.649023 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 264/526] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:09:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:58.649970 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20044484-8a41-4e67-9f69-15145012a16b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:58.677136 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:58.704955 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666ea9b-afcb-4df7-96cc-4de19f9a9e50 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:58.741741 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418953de-0f9e-400f-9703-b47ede22b0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:58.742435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418953de-0f9e-400f-9703-b47ede22b0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:58.742715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418953de-0f9e-400f-9703-b47ede22b0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:58.742988 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418953de-0f9e-400f-9703-b47ede22b0c5 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:58.743820 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418953de-0f9e-400f-9703-b47ede22b0c5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:58.744128 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418953de-0f9e-400f-9703-b47ede22b0c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:58.745565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418953de-0f9e-400f-9703-b47ede22b0c5 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:58.762814 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 263/527] 10.222.0.57 () {56 vars in 1139 bytes} [Sat Jun 4 08:09:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:58.763599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418953de-0f9e-400f-9703-b47ede22b0c5 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:58.770846 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20044484-8a41-4e67-9f69-15145012a16b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:58.784543 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:58.806999 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657a6f5-0f2e-4fb9-b167-f9587bd9722e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:58.807757 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657a6f5-0f2e-4fb9-b167-f9587bd9722e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:58.808095 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657a6f5-0f2e-4fb9-b167-f9587bd9722e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:58.808374 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657a6f5-0f2e-4fb9-b167-f9587bd9722e None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:58.809142 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657a6f5-0f2e-4fb9-b167-f9587bd9722e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:58.809439 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657a6f5-0f2e-4fb9-b167-f9587bd9722e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:58.810904 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657a6f5-0f2e-4fb9-b167-f9587bd9722e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:58.828712 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 265/528] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:09:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:58.829506 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657a6f5-0f2e-4fb9-b167-f9587bd9722e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:58.875793 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418953de-0f9e-400f-9703-b47ede22b0c5 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:58.919028 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c4f8a-ba11-4cb9-8ee8-4680920f0de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:58.919691 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c4f8a-ba11-4cb9-8ee8-4680920f0de0 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:58.920086 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c4f8a-ba11-4cb9-8ee8-4680920f0de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:58.920362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c4f8a-ba11-4cb9-8ee8-4680920f0de0 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:58.921089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c4f8a-ba11-4cb9-8ee8-4680920f0de0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:58.921390 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c4f8a-ba11-4cb9-8ee8-4680920f0de0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:58.922891 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c4f8a-ba11-4cb9-8ee8-4680920f0de0 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:58.923845 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:58.936585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 264/529] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:58.937399 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c4f8a-ba11-4cb9-8ee8-4680920f0de0 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:58.948216 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657a6f5-0f2e-4fb9-b167-f9587bd9722e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:58.987171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df05eb5-15b8-49e9-a40a-d7f3ffa702e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:58.987952 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df05eb5-15b8-49e9-a40a-d7f3ffa702e5 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:58.988239 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df05eb5-15b8-49e9-a40a-d7f3ffa702e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:58.988517 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df05eb5-15b8-49e9-a40a-d7f3ffa702e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:58.989308 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df05eb5-15b8-49e9-a40a-d7f3ffa702e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:58.989621 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df05eb5-15b8-49e9-a40a-d7f3ffa702e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:58.991335 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df05eb5-15b8-49e9-a40a-d7f3ffa702e5 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:59.009907 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 266/530] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:09:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:59.010914 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df05eb5-15b8-49e9-a40a-d7f3ffa702e5 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:59.019311 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:59.042218 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c4f8a-ba11-4cb9-8ee8-4680920f0de0 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:59.076543 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead807e-a834-43b3-871d-a192fc8253a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:59.077191 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead807e-a834-43b3-871d-a192fc8253a9 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:59.077475 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead807e-a834-43b3-871d-a192fc8253a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:59.077754 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead807e-a834-43b3-871d-a192fc8253a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:59.113984 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df05eb5-15b8-49e9-a40a-d7f3ffa702e5 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:59.147584 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942221fb-5594-448a-b2ad-2a4048cd288e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:59.148171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942221fb-5594-448a-b2ad-2a4048cd288e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:59.148452 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942221fb-5594-448a-b2ad-2a4048cd288e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:59.148726 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942221fb-5594-448a-b2ad-2a4048cd288e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:59.149548 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942221fb-5594-448a-b2ad-2a4048cd288e None admin] RBAC: Adding query filter params (role.id=c9ec7276464a4d87ab2b6fc52a3bfeae, scope.project.id=634c9a1745ef44c0ad66e02493d79af0, user.id=7e64d002241242928936dd0d991ecdc1) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:59.149878 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942221fb-5594-448a-b2ad-2a4048cd288e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:59.151318 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942221fb-5594-448a-b2ad-2a4048cd288e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:59.153342 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead807e-a834-43b3-871d-a192fc8253a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:59.154986 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead807e-a834-43b3-871d-a192fc8253a9 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:59.156722 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 267/531] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:09:59 2022] GET /identity/v3/role_assignments?user.id=7e64d002241242928936dd0d991ecdc1&scope.project.id=634c9a1745ef44c0ad66e02493d79af0&role.id=c9ec7276464a4d87ab2b6fc52a3bfeae => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:59.157488 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942221fb-5594-448a-b2ad-2a4048cd288e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:59.173498 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:59.263022 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:59.292771 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942221fb-5594-448a-b2ad-2a4048cd288e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:59.293520 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 265/532] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:09:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 08:09:59.294589 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead807e-a834-43b3-871d-a192fc8253a9 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:59.336485 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a47986-a9cf-4bc0-800f-4c5abe4f5e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:59.338260 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a47986-a9cf-4bc0-800f-4c5abe4f5e97 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:59.338745 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a47986-a9cf-4bc0-800f-4c5abe4f5e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:59.339229 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a47986-a9cf-4bc0-800f-4c5abe4f5e97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:59.350415 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a47986-a9cf-4bc0-800f-4c5abe4f5e97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:59.352403 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a47986-a9cf-4bc0-800f-4c5abe4f5e97 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:59.371422 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-60a47986-a9cf-4bc0-800f-4c5abe4f5e97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:09:59.371422 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:59.371422 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:59.371422 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:59.371422 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:59.371422 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:59.371422 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:59.371422 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:59.371422 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:59.371422 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:59.371422 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:59.371422 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:59.371422 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:09:59.371422 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:09:59.371422 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:09:59.372334 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:09:59.372334 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:59.372334 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:59.372334 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:59.372334 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:59.372334 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:59.372334 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:59.372334 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:59.372334 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:59.372334 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:59.372334 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:59.372334 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:59.372334 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:59.372334 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:59.372334 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:59.372334 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:59.372334 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:59.373188 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:09:59.373188 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:09:59.373188 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:09:59.373188 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:09:59.373188 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:09:59.373188 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:09:59.373188 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:09:59.373188 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:59.375828 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 268/533] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:09:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:59.376851 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a47986-a9cf-4bc0-800f-4c5abe4f5e97 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:59.418164 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead807e-a834-43b3-871d-a192fc8253a9 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:59.459000 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334b67a-fe69-40e1-9654-d16911e4cf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:59.459797 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334b67a-fe69-40e1-9654-d16911e4cf8b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:59.460150 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334b67a-fe69-40e1-9654-d16911e4cf8b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:59.460498 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334b67a-fe69-40e1-9654-d16911e4cf8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:59.461401 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334b67a-fe69-40e1-9654-d16911e4cf8b None admin] RBAC: Adding query filter params (role.id=c9ec7276464a4d87ab2b6fc52a3bfeae, scope.project.id=634c9a1745ef44c0ad66e02493d79af0, user.id=3ab0603fbcd54121b543fbf2a44fecf0) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:59.461781 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334b67a-fe69-40e1-9654-d16911e4cf8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:59.463074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:59.463819 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334b67a-fe69-40e1-9654-d16911e4cf8b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:59.477850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 266/534] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:09:59 2022] GET /identity/v3/role_assignments?user.id=3ab0603fbcd54121b543fbf2a44fecf0&scope.project.id=634c9a1745ef44c0ad66e02493d79af0&role.id=c9ec7276464a4d87ab2b6fc52a3bfeae => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:59.477850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334b67a-fe69-40e1-9654-d16911e4cf8b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:59.539956 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a47986-a9cf-4bc0-800f-4c5abe4f5e97 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:59.565506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:59.610303 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943f7dd-8dbe-4dfd-adf5-1f0c45f47619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:59.611117 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943f7dd-8dbe-4dfd-adf5-1f0c45f47619 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:59.611407 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943f7dd-8dbe-4dfd-adf5-1f0c45f47619 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:59.611737 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943f7dd-8dbe-4dfd-adf5-1f0c45f47619 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:59.634685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943f7dd-8dbe-4dfd-adf5-1f0c45f47619 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:59.637836 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943f7dd-8dbe-4dfd-adf5-1f0c45f47619 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:59.670735 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-f943f7dd-8dbe-4dfd-adf5-1f0c45f47619 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:09:59.670735 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:09:59.670735 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:09:59.670735 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:09:59.670735 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:09:59.670735 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:09:59.670735 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:09:59.670735 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:09:59.670735 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:09:59.670735 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:09:59.670735 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:09:59.670735 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:09:59.670735 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:09:59.670735 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:09:59.670735 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:09:59.671637 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:09:59.671637 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:09:59.671637 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:09:59.671637 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:09:59.671637 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:09:59.671637 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:09:59.671637 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:09:59.671637 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:09:59.671637 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:09:59.671637 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:09:59.671637 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:09:59.671637 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:09:59.671637 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:09:59.671637 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:09:59.671637 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:09:59.671637 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:09:59.671637 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:09:59.672921 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:09:59.672921 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:09:59.672921 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:09:59.672921 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:09:59.672921 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 269/535] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:09:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:09:59.682289 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943f7dd-8dbe-4dfd-adf5-1f0c45f47619 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:59.684752 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334b67a-fe69-40e1-9654-d16911e4cf8b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:59.765701 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56f9d9-7a8d-4a67-9f37-8591d5d87bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:59.766444 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56f9d9-7a8d-4a67-9f37-8591d5d87bac None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:59.766724 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56f9d9-7a8d-4a67-9f37-8591d5d87bac None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:59.766997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56f9d9-7a8d-4a67-9f37-8591d5d87bac None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:59.767786 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56f9d9-7a8d-4a67-9f37-8591d5d87bac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:59.768639 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56f9d9-7a8d-4a67-9f37-8591d5d87bac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:59.770358 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56f9d9-7a8d-4a67-9f37-8591d5d87bac None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:59.810193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 267/536] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:09:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:59.815537 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56f9d9-7a8d-4a67-9f37-8591d5d87bac None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:59.852924 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943f7dd-8dbe-4dfd-adf5-1f0c45f47619 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:59.885103 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:09:59.916956 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8566ea6-424d-4552-9291-64fcd66523e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:09:59.917650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8566ea6-424d-4552-9291-64fcd66523e3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:09:59.917914 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8566ea6-424d-4552-9291-64fcd66523e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:09:59.918194 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8566ea6-424d-4552-9291-64fcd66523e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:09:59.918929 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8566ea6-424d-4552-9291-64fcd66523e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:09:59.924281 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8566ea6-424d-4552-9291-64fcd66523e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:09:59.924281 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8566ea6-424d-4552-9291-64fcd66523e3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:09:59.948823 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 270/537] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:09:59.954973 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8566ea6-424d-4552-9291-64fcd66523e3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:09:59.984178 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56f9d9-7a8d-4a67-9f37-8591d5d87bac None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:09:59.985996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:00.049958 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fca59e-7347-4f8c-ba83-f9dfef2a0169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:00.050619 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fca59e-7347-4f8c-ba83-f9dfef2a0169 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:00.050898 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fca59e-7347-4f8c-ba83-f9dfef2a0169 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:00.051171 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fca59e-7347-4f8c-ba83-f9dfef2a0169 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:00.052013 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fca59e-7347-4f8c-ba83-f9dfef2a0169 None admin] RBAC: Adding query filter params (role.id=c9ec7276464a4d87ab2b6fc52a3bfeae, scope.project.id=634c9a1745ef44c0ad66e02493d79af0, user.id=5cd24a726e4e4ce687d150a3bdc5948f) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:00.052324 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fca59e-7347-4f8c-ba83-f9dfef2a0169 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:00.054067 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fca59e-7347-4f8c-ba83-f9dfef2a0169 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:00.064035 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 268/538] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:09:59 2022] GET /identity/v3/role_assignments?user.id=5cd24a726e4e4ce687d150a3bdc5948f&scope.project.id=634c9a1745ef44c0ad66e02493d79af0&role.id=c9ec7276464a4d87ab2b6fc52a3bfeae => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:00.065451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1fb19-ea00-4fd8-b861-5a151a150ed2 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:00.065890 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1fb19-ea00-4fd8-b861-5a151a150ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:00.066176 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1fb19-ea00-4fd8-b861-5a151a150ed2 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:00.067843 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 269/539] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:00.074237 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116d598-514b-4ebf-997e-d75aa6261c0b None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:00.074611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116d598-514b-4ebf-997e-d75aa6261c0b None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:00.074962 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116d598-514b-4ebf-997e-d75aa6261c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:00.103718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-3116d598-514b-4ebf-997e-d75aa6261c0b None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:00.104972 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-3116d598-514b-4ebf-997e-d75aa6261c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:00.133938 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8566ea6-424d-4552-9291-64fcd66523e3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:00.216173 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711df9f-34c6-4cd8-afc0-2e93e2ee24bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:00.216916 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711df9f-34c6-4cd8-afc0-2e93e2ee24bd None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:00.217198 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711df9f-34c6-4cd8-afc0-2e93e2ee24bd None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:00.217472 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711df9f-34c6-4cd8-afc0-2e93e2ee24bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:00.233466 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711df9f-34c6-4cd8-afc0-2e93e2ee24bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:00.234988 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711df9f-34c6-4cd8-afc0-2e93e2ee24bd None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:00.266175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 270/540] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:10:00.266956 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-0711df9f-34c6-4cd8-afc0-2e93e2ee24bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:00.266956 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:00.266956 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:00.266956 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:00.266956 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:00.266956 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:00.266956 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:00.266956 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:00.266956 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:00.266956 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:00.266956 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:00.266956 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:00.266956 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:10:00.266956 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:10:00.266956 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:10:00.267793 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:10:00.267793 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:00.267793 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:00.267793 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:00.267793 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:00.267793 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:00.267793 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:00.267793 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:00.267793 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:00.267793 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:00.267793 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:00.267793 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:00.267793 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:00.267793 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:00.267793 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:00.267793 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:00.267793 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:00.270076 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:10:00.270076 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:10:00.270076 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:10:00.270076 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:10:00.270076 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:10:00.270076 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:10:00.270076 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:00.270076 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:00.270076 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 271/541] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:09:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:10:00.274733 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116d598-514b-4ebf-997e-d75aa6261c0b None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:00.289501 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711df9f-34c6-4cd8-afc0-2e93e2ee24bd None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:00.334188 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:00.398612 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:00.404557 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116d598-514b-4ebf-997e-d75aa6261c0b None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:00.466258 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a2b90-4e20-4c96-bd3d-3d02753f40ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:00.466849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a2b90-4e20-4c96-bd3d-3d02753f40ac None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:00.467127 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a2b90-4e20-4c96-bd3d-3d02753f40ac None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:00.467398 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a2b90-4e20-4c96-bd3d-3d02753f40ac None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:00.468193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a2b90-4e20-4c96-bd3d-3d02753f40ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:00.468501 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a2b90-4e20-4c96-bd3d-3d02753f40ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:00.469971 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a2b90-4e20-4c96-bd3d-3d02753f40ac None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:00.490041 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 271/542] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:10:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:00.493065 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711df9f-34c6-4cd8-afc0-2e93e2ee24bd None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:00.495361 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a2b90-4e20-4c96-bd3d-3d02753f40ac None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:00.554035 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f9dff-00ee-4dc9-82df-252b7b5fa59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:00.554842 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f9dff-00ee-4dc9-82df-252b7b5fa59a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:00.555125 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f9dff-00ee-4dc9-82df-252b7b5fa59a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:00.555401 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f9dff-00ee-4dc9-82df-252b7b5fa59a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:00.576985 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f9dff-00ee-4dc9-82df-252b7b5fa59a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:10:00.584797 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-1e8f9dff-00ee-4dc9-82df-252b7b5fa59a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:10:00.584797 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:00.584797 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:00.584797 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:00.584797 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:00.584797 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:00.584797 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:00.584797 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:00.584797 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:00.584797 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:00.584797 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:00.584797 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:00.584797 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:10:00.584797 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:10:00.584797 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:10:00.584797 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:10:00.585677 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:10:00.585677 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:10:00.585677 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:10:00.585677 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:10:00.585677 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:00.585677 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:00.585677 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:00.585677 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:00.585677 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:00.585677 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:00.585677 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:00.585677 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:00.585677 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:00.585677 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:00.585677 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:00.585677 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:00.586497 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:00.586497 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:00.586497 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:00.586497 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:00.586497 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:10:00.586497 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:10:00.586497 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:10:00.586497 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:10:00.586497 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:10:00.586497 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:10:00.586497 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:10:00.586497 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:00.588710 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 272/543] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jun 4 08:10:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:10:00.597024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f9dff-00ee-4dc9-82df-252b7b5fa59a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:00.686181 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a2b90-4e20-4c96-bd3d-3d02753f40ac None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:00.759266 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbfe33-71b6-46a6-bf70-69b60325c436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:00.763210 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbfe33-71b6-46a6-bf70-69b60325c436 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:00.763697 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbfe33-71b6-46a6-bf70-69b60325c436 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:00.764186 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbfe33-71b6-46a6-bf70-69b60325c436 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:00.765212 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbfe33-71b6-46a6-bf70-69b60325c436 None admin] RBAC: Adding query filter params (role.id=c9ec7276464a4d87ab2b6fc52a3bfeae, scope.project.id=634c9a1745ef44c0ad66e02493d79af0, user.id=5fd5768a512c4177abae05f4ccd5c59f) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:00.765719 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbfe33-71b6-46a6-bf70-69b60325c436 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:00.769588 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbfe33-71b6-46a6-bf70-69b60325c436 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:00.779690 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 272/544] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:10:00 2022] GET /identity/v3/role_assignments?user.id=5fd5768a512c4177abae05f4ccd5c59f&scope.project.id=634c9a1745ef44c0ad66e02493d79af0&role.id=c9ec7276464a4d87ab2b6fc52a3bfeae => generated 259 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:00.789842 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:00.794991 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f9dff-00ee-4dc9-82df-252b7b5fa59a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:00.840161 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba5a52-0aa9-4318-bb6b-84dcfa95d49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:00.841197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba5a52-0aa9-4318-bb6b-84dcfa95d49d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:00.841696 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba5a52-0aa9-4318-bb6b-84dcfa95d49d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:00.842225 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba5a52-0aa9-4318-bb6b-84dcfa95d49d None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:00.843166 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba5a52-0aa9-4318-bb6b-84dcfa95d49d None admin] RBAC: Adding query filter params (name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:00.843661 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba5a52-0aa9-4318-bb6b-84dcfa95d49d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:00.845238 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba5a52-0aa9-4318-bb6b-84dcfa95d49d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:00.859323 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 273/545] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jun 4 08:10:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:00.864612 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbfe33-71b6-46a6-bf70-69b60325c436 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:00.894633 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:01.007331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbfe33-71b6-46a6-bf70-69b60325c436 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:01.054811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac173be-9b79-4418-9dc9-d40d987f8cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:01.055604 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac173be-9b79-4418-9dc9-d40d987f8cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:01.055893 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac173be-9b79-4418-9dc9-d40d987f8cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:01.056171 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac173be-9b79-4418-9dc9-d40d987f8cd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:01.068669 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac173be-9b79-4418-9dc9-d40d987f8cd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:01.070169 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac173be-9b79-4418-9dc9-d40d987f8cd0 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:01.088826 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-9ac173be-9b79-4418-9dc9-d40d987f8cd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:01.088826 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:01.088826 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:01.088826 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:01.088826 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:01.088826 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:01.088826 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:01.088826 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:01.088826 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:01.088826 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:01.088826 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:01.088826 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:01.088826 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:01.088826 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:01.088826 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:01.089795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:01.089795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:01.089795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:01.089795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:01.089795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:01.089795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:01.089795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:01.089795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:01.089795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:01.089795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:01.089795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:01.089795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:01.089795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:01.089795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:01.089795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:01.089795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:01.089795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:01.090679 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:01.090679 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:01.090679 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:01.090679 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:01.090679 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 273/546] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:01.095845 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba5a52-0aa9-4318-bb6b-84dcfa95d49d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:01.241620 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba5a52-0aa9-4318-bb6b-84dcfa95d49d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:01.288417 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47561b1-2bee-4eae-a3d7-a1151e6c637f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:01.289156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47561b1-2bee-4eae-a3d7-a1151e6c637f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:01.289440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47561b1-2bee-4eae-a3d7-a1151e6c637f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:01.289717 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47561b1-2bee-4eae-a3d7-a1151e6c637f None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:01.290518 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47561b1-2bee-4eae-a3d7-a1151e6c637f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:01.290823 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47561b1-2bee-4eae-a3d7-a1151e6c637f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:01.292196 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47561b1-2bee-4eae-a3d7-a1151e6c637f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:01.315812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 274/547] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:01.320915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac173be-9b79-4418-9dc9-d40d987f8cd0 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:01.435471 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:01.474114 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac173be-9b79-4418-9dc9-d40d987f8cd0 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:01.524448 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ab9b0-69d7-4b74-bbe5-19083e518b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:01.525260 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ab9b0-69d7-4b74-bbe5-19083e518b01 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:01.525539 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ab9b0-69d7-4b74-bbe5-19083e518b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:01.525813 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ab9b0-69d7-4b74-bbe5-19083e518b01 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:01.539254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ab9b0-69d7-4b74-bbe5-19083e518b01 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:01.540716 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ab9b0-69d7-4b74-bbe5-19083e518b01 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:01.556149 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-260ab9b0-69d7-4b74-bbe5-19083e518b01 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 04 08:10:01.556149 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:01.556149 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:01.556149 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:01.556149 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:01.556149 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:01.556149 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:01.556149 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:01.556149 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:01.556149 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:01.556149 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:01.556149 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:01.556149 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:10:01.556149 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:10:01.556149 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:10:01.556149 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:10:01.557115 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:01.557115 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:01.557115 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:10:01.557115 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:01.557115 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:10:01.557115 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:01.557115 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:01.557115 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:01.557115 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:01.557115 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:01.557115 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:01.557115 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:01.557115 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:01.557115 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:01.557115 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:01.557115 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:01.557115 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:01.557115 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:01.558616 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:01.558616 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:01.558616 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:10:01.558616 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:10:01.558616 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:10:01.558616 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:10:01.558616 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:10:01.558616 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:10:01.558616 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 04 08:10:01.558616 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:01.558616 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 274/548] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:10:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:01.566541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47561b1-2bee-4eae-a3d7-a1151e6c637f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:01.598443 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:01.711026 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47561b1-2bee-4eae-a3d7-a1151e6c637f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:01.762705 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9514e-a2a1-4100-829e-00047c3a0840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:01.763389 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9514e-a2a1-4100-829e-00047c3a0840 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:01.763674 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9514e-a2a1-4100-829e-00047c3a0840 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:01.763953 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9514e-a2a1-4100-829e-00047c3a0840 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:01.764795 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb9514e-a2a1-4100-829e-00047c3a0840 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:01.765199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb9514e-a2a1-4100-829e-00047c3a0840 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:01.766672 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb9514e-a2a1-4100-829e-00047c3a0840 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:01.786670 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 275/549] 10.222.0.57 () {56 vars in 1135 bytes} [Sat Jun 4 08:10:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:01.792503 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ab9b0-69d7-4b74-bbe5-19083e518b01 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:01.823145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05654829-9e06-4176-823b-132b8845f44d None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:01.823635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05654829-9e06-4176-823b-132b8845f44d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:01.823711 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05654829-9e06-4176-823b-132b8845f44d None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:01.825320 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 276/550] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 08:10:01.830500 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6ff35-668f-4e83-860b-2d5bad5e4407 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:01.830793 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6ff35-668f-4e83-860b-2d5bad5e4407 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:01.831072 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6ff35-668f-4e83-860b-2d5bad5e4407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:01.864985 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-b6a6ff35-668f-4e83-860b-2d5bad5e4407 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:01.866296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b6a6ff35-668f-4e83-860b-2d5bad5e4407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:01.913372 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ab9b0-69d7-4b74-bbe5-19083e518b01 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:01.946221 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:01.950295 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5f8fd-732e-49a4-9522-1c934471e436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:01.950952 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5f8fd-732e-49a4-9522-1c934471e436 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:01.951234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5f8fd-732e-49a4-9522-1c934471e436 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:01.951511 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5f8fd-732e-49a4-9522-1c934471e436 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:02.026409 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5f8fd-732e-49a4-9522-1c934471e436 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:02.028153 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5f8fd-732e-49a4-9522-1c934471e436 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:02.052814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 277/551] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 04 08:10:02.087974 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6ff35-668f-4e83-860b-2d5bad5e4407 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:02.108264 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:02.135401 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 275/552] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:10:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 08:10:02.141141 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5f8fd-732e-49a4-9522-1c934471e436 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:02.176745 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:02.289018 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5f8fd-732e-49a4-9522-1c934471e436 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:02.302817 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6ff35-668f-4e83-860b-2d5bad5e4407 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:02.337389 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa106cea-db34-42d2-b64c-2a2efba2b71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:02.338543 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa106cea-db34-42d2-b64c-2a2efba2b71b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:02.339242 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa106cea-db34-42d2-b64c-2a2efba2b71b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:02.339971 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa106cea-db34-42d2-b64c-2a2efba2b71b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:02.348104 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830d67f-e568-4293-babd-b893d41d7485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:02.349699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830d67f-e568-4293-babd-b893d41d7485 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:02.350138 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830d67f-e568-4293-babd-b893d41d7485 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:02.350504 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830d67f-e568-4293-babd-b893d41d7485 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:02.357377 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa106cea-db34-42d2-b64c-2a2efba2b71b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:02.358945 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa106cea-db34-42d2-b64c-2a2efba2b71b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:02.366054 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830d67f-e568-4293-babd-b893d41d7485 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:10:02.375932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-a830d67f-e568-4293-babd-b893d41d7485 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:10:02.375932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:02.375932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:02.375932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:02.375932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:02.375932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:02.375932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:02.375932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:02.375932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:02.375932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:02.375932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:02.375932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:02.375932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:10:02.375932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:10:02.375932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:10:02.375932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:10:02.377160 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:10:02.377160 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:10:02.377160 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:10:02.377160 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:10:02.377160 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:02.377160 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:02.377160 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:02.377160 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:02.377160 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:02.377160 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:02.377160 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:02.377160 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:02.377160 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:02.377160 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:02.377160 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:02.377160 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:02.378580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:02.378580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:02.378580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:02.378580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:02.378580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:10:02.378580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:10:02.378580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:10:02.378580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:10:02.378580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:10:02.378580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:10:02.378580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:10:02.378580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:02.379228 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 278/553] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jun 4 08:10:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:02.380707 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638c350-0985-4270-9c40-d1689d73c3fb None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:02.381056 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638c350-0985-4270-9c40-d1689d73c3fb None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:02.381401 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638c350-0985-4270-9c40-d1689d73c3fb None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:02.383200 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 279/554] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:02.384140 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638c350-0985-4270-9c40-d1689d73c3fb None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:02.384574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-fa106cea-db34-42d2-b64c-2a2efba2b71b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:02.384574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:02.384574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:02.384574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:02.384574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:02.384574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:02.384574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:02.384574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:02.384574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:02.384574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:02.384574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:02.384574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:02.384574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:02.384574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:02.384574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:02.385580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:02.385580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:02.385580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:02.385580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:02.385580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:02.385580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:02.385580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:02.385580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:02.385580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:02.385580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:02.385580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:02.385580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:02.385580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:02.385580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:02.385580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:02.385580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:02.385580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:02.386765 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:02.386765 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:02.386765 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:02.386765 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:02.388357 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 276/555] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:02.394073 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff007c7b-83ac-4d46-8b61-c98e774aee56 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:02.394594 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff007c7b-83ac-4d46-8b61-c98e774aee56 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:02.394973 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff007c7b-83ac-4d46-8b61-c98e774aee56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:02.413816 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-ff007c7b-83ac-4d46-8b61-c98e774aee56 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:02.415192 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ff007c7b-83ac-4d46-8b61-c98e774aee56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:02.480362 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:02.489086 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 277/556] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:10:02.490358 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff007c7b-83ac-4d46-8b61-c98e774aee56 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:02.507585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:02.528618 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638c350-0985-4270-9c40-d1689d73c3fb None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:02.579202 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3d655-7a49-4fe4-851a-70c7736fa883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:02.579880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3d655-7a49-4fe4-851a-70c7736fa883 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:02.580161 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3d655-7a49-4fe4-851a-70c7736fa883 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:02.580988 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3d655-7a49-4fe4-851a-70c7736fa883 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:02.582179 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3d655-7a49-4fe4-851a-70c7736fa883 None admin] RBAC: Adding query filter params (name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:02.582489 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3d655-7a49-4fe4-851a-70c7736fa883 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:02.584183 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3d655-7a49-4fe4-851a-70c7736fa883 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:02.595666 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 280/557] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jun 4 08:10:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:02.596860 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3d655-7a49-4fe4-851a-70c7736fa883 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:02.610952 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff007c7b-83ac-4d46-8b61-c98e774aee56 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:02.658321 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccbfdad-4d90-46f9-a5be-55f6fbc6c39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:02.659015 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbfdad-4d90-46f9-a5be-55f6fbc6c39a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:02.659297 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbfdad-4d90-46f9-a5be-55f6fbc6c39a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:02.659573 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbfdad-4d90-46f9-a5be-55f6fbc6c39a None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:02.660709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccbfdad-4d90-46f9-a5be-55f6fbc6c39a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:02.661015 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccbfdad-4d90-46f9-a5be-55f6fbc6c39a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:02.662998 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccbfdad-4d90-46f9-a5be-55f6fbc6c39a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:02.683025 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 278/558] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:02.683025 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccbfdad-4d90-46f9-a5be-55f6fbc6c39a None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:02.713664 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3d655-7a49-4fe4-851a-70c7736fa883 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:02.752261 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:02.759573 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac21164-a3ef-43bb-81b7-2edc318cef2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:02.760375 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac21164-a3ef-43bb-81b7-2edc318cef2b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:02.760658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac21164-a3ef-43bb-81b7-2edc318cef2b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:02.760933 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac21164-a3ef-43bb-81b7-2edc318cef2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:02.771447 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac21164-a3ef-43bb-81b7-2edc318cef2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:10:02.774452 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:02.779667 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-4ac21164-a3ef-43bb-81b7-2edc318cef2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:10:02.779667 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:02.779667 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:02.779667 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:02.779667 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:02.779667 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:02.779667 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:02.779667 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:02.779667 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:02.779667 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:02.779667 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:02.779667 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:02.779667 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:10:02.779667 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:10:02.779667 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:10:02.779667 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:10:02.781062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:10:02.781062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:10:02.781062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:10:02.781062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:10:02.781062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:02.781062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:02.781062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:02.781062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:02.781062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:02.781062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:02.781062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:02.781062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:02.781062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:02.781062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:02.781062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:02.781062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:02.781935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:02.781935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:02.781935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:02.781935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:02.781935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:10:02.781935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:10:02.781935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:10:02.781935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:10:02.781935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:10:02.781935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:10:02.781935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:10:02.781935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:02.781935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 281/559] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jun 4 08:10:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:02.782623 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac21164-a3ef-43bb-81b7-2edc318cef2b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:02.807071 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccbfdad-4d90-46f9-a5be-55f6fbc6c39a None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:02.842341 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e38bb2-06c1-481b-bdfe-1dff4d11f00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:02.843371 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e38bb2-06c1-481b-bdfe-1dff4d11f00a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:02.843654 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e38bb2-06c1-481b-bdfe-1dff4d11f00a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:02.844040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e38bb2-06c1-481b-bdfe-1dff4d11f00a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:02.854771 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e38bb2-06c1-481b-bdfe-1dff4d11f00a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:02.857080 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e38bb2-06c1-481b-bdfe-1dff4d11f00a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:02.875091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-09e38bb2-06c1-481b-bdfe-1dff4d11f00a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:02.875091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:02.875091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:02.875091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:02.875091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:02.875091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:02.875091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:02.875091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:02.875091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:02.875091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:02.875091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:02.875091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:02.875091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:02.875091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:02.875091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:02.876240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:02.876240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:02.876240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:02.876240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:02.876240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:02.876240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:02.876240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:02.876240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:02.876240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:02.876240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:02.876240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:02.876240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:02.876240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:02.876240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:02.876240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:02.876240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:02.876240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:02.877318 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:02.877318 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:02.877318 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:02.877318 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:02.879397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 279/560] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:02.880775 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc49501-8897-418a-ba93-007e3c4b536a None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:02.881063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc49501-8897-418a-ba93-007e3c4b536a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:02.881339 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc49501-8897-418a-ba93-007e3c4b536a None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:02.885851 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 280/561] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:02.885851 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc49501-8897-418a-ba93-007e3c4b536a None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:02.895053 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac21164-a3ef-43bb-81b7-2edc318cef2b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:02.937699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23078be2-3aed-42ca-9728-e8949a787189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:02.939233 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23078be2-3aed-42ca-9728-e8949a787189 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:02.939795 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23078be2-3aed-42ca-9728-e8949a787189 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:02.940953 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23078be2-3aed-42ca-9728-e8949a787189 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:02.949662 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23078be2-3aed-42ca-9728-e8949a787189 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:02.951564 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23078be2-3aed-42ca-9728-e8949a787189 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:02.966589 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-23078be2-3aed-42ca-9728-e8949a787189 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:02.966589 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:02.966589 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:02.966589 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:02.966589 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:02.966589 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:02.966589 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:02.966589 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:02.966589 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:02.966589 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:02.966589 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:02.966589 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:02.966589 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:10:02.966589 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:10:02.966589 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:10:02.967525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:10:02.967525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:02.967525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:02.967525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:02.967525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:02.967525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:02.967525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:02.967525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:02.967525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:02.967525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:02.967525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:02.967525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:02.967525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:02.967525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:02.967525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:02.967525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:02.967525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:02.968491 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:10:02.968491 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:10:02.968491 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:10:02.968491 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:10:02.968491 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:10:02.968491 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:10:02.968491 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:02.968491 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:02.968491 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 282/562] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:10:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:02.968973 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23078be2-3aed-42ca-9728-e8949a787189 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:02.999436 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc49501-8897-418a-ba93-007e3c4b536a None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:03.028798 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:03.031861 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:03.040907 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148299d-e48b-44e2-8c6b-f023781d371f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:03.041923 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148299d-e48b-44e2-8c6b-f023781d371f None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:03.042218 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148299d-e48b-44e2-8c6b-f023781d371f None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:03.042761 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148299d-e48b-44e2-8c6b-f023781d371f None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:03.043516 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148299d-e48b-44e2-8c6b-f023781d371f None admin] RBAC: Adding query filter params (name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:03.043976 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148299d-e48b-44e2-8c6b-f023781d371f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:03.045943 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148299d-e48b-44e2-8c6b-f023781d371f None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:03.061183 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 281/563] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jun 4 08:10:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:03.061183 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8943e1-22ec-476d-8060-d0f7e0d85f1a None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:03.061183 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8943e1-22ec-476d-8060-d0f7e0d85f1a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:03.061183 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8943e1-22ec-476d-8060-d0f7e0d85f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:03.079931 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-4a8943e1-22ec-476d-8060-d0f7e0d85f1a None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:03.081435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4a8943e1-22ec-476d-8060-d0f7e0d85f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:03.084662 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23078be2-3aed-42ca-9728-e8949a787189 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:03.120451 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bed0f1-4ffa-4305-8afd-dd9ebe6b4aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:03.121045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bed0f1-4ffa-4305-8afd-dd9ebe6b4aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:03.121439 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bed0f1-4ffa-4305-8afd-dd9ebe6b4aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:03.121623 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bed0f1-4ffa-4305-8afd-dd9ebe6b4aa8 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:03.122371 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bed0f1-4ffa-4305-8afd-dd9ebe6b4aa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:03.122683 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bed0f1-4ffa-4305-8afd-dd9ebe6b4aa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:03.124065 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bed0f1-4ffa-4305-8afd-dd9ebe6b4aa8 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:03.140200 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 283/564] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:03.140200 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bed0f1-4ffa-4305-8afd-dd9ebe6b4aa8 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:03.161599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 282/565] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:10:03.162538 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8943e1-22ec-476d-8060-d0f7e0d85f1a None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:03.243583 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bed0f1-4ffa-4305-8afd-dd9ebe6b4aa8 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:03.255079 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:03.281445 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8943e1-22ec-476d-8060-d0f7e0d85f1a None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:03.282031 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c76f4-156b-4a8c-bf54-337ea6421609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:03.282698 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c76f4-156b-4a8c-bf54-337ea6421609 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:03.283232 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c76f4-156b-4a8c-bf54-337ea6421609 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:03.284039 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c76f4-156b-4a8c-bf54-337ea6421609 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:03.285696 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c76f4-156b-4a8c-bf54-337ea6421609 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:03.286040 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c76f4-156b-4a8c-bf54-337ea6421609 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:03.287479 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c76f4-156b-4a8c-bf54-337ea6421609 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:03.301362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:03.304107 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 284/566] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:10:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:03.305401 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c76f4-156b-4a8c-bf54-337ea6421609 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:03.321312 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c1252-f845-4595-99b5-883626b8d80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:03.322327 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c1252-f845-4595-99b5-883626b8d80c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:03.322605 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c1252-f845-4595-99b5-883626b8d80c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:03.322873 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c1252-f845-4595-99b5-883626b8d80c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:03.334199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c1252-f845-4595-99b5-883626b8d80c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:03.335641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c1252-f845-4595-99b5-883626b8d80c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:03.354535 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-f85c1252-f845-4595-99b5-883626b8d80c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:03.354535 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:03.354535 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:03.354535 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:03.354535 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:03.354535 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:03.354535 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:03.354535 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:03.354535 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:03.354535 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:03.354535 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:03.354535 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:03.354535 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:03.354535 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:03.354535 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:03.355637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:03.355637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:03.355637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:03.355637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:03.355637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:03.355637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:03.355637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:03.355637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:03.355637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:03.355637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:03.355637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:03.355637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:03.355637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:03.355637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:03.355637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:03.355637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:03.355637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:03.356567 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:03.356567 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:03.356567 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:03.356567 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:03.356567 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 283/567] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:03.356850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c1252-f845-4595-99b5-883626b8d80c None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:03.419995 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c76f4-156b-4a8c-bf54-337ea6421609 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:03.455834 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad27a89-2058-430c-9b4d-60568a8c461d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:03.456627 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad27a89-2058-430c-9b4d-60568a8c461d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:03.456946 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad27a89-2058-430c-9b4d-60568a8c461d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:03.457229 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad27a89-2058-430c-9b4d-60568a8c461d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:03.459066 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c1252-f845-4595-99b5-883626b8d80c None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:03.464708 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad27a89-2058-430c-9b4d-60568a8c461d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:03.466197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad27a89-2058-430c-9b4d-60568a8c461d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:03.481062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-6ad27a89-2058-430c-9b4d-60568a8c461d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 08:10:03.481062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:03.481062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:03.481062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:03.481062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:03.481062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:03.481062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:03.481062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:03.481062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:03.481062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:03.481062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:03.481062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:03.481062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:10:03.481062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:10:03.481062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:10:03.481062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:10:03.482287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:03.482287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:03.482287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:10:03.482287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:03.482287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:10:03.482287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:03.482287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:03.482287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:03.482287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:03.482287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:03.482287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:03.482287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:03.482287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:03.482287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:03.482287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:03.482287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:03.482287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:03.482287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:03.483672 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:03.483672 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:03.483672 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:10:03.483672 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:10:03.483672 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:10:03.483672 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:10:03.483672 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:10:03.483672 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:10:03.483672 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 08:10:03.483672 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:03.483672 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 285/568] 10.222.0.57 () {56 vars in 1093 bytes} [Sat Jun 4 08:10:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:03.483672 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad27a89-2058-430c-9b4d-60568a8c461d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:03.501275 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788ffdb-126f-4d3f-ba21-162547b6987c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:03.502175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788ffdb-126f-4d3f-ba21-162547b6987c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:03.502484 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788ffdb-126f-4d3f-ba21-162547b6987c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:03.502752 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788ffdb-126f-4d3f-ba21-162547b6987c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:03.512789 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788ffdb-126f-4d3f-ba21-162547b6987c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:10:03.512910 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:03.521040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-d788ffdb-126f-4d3f-ba21-162547b6987c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:10:03.521040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:03.521040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:03.521040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:03.521040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:03.521040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:03.521040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:03.521040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:03.521040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:03.521040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:03.521040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:03.521040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:03.521040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:10:03.521040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:10:03.521040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:10:03.521040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:10:03.522078 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:10:03.522078 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:10:03.522078 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:10:03.522078 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:10:03.522078 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:03.522078 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:03.522078 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:03.522078 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:03.522078 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:03.522078 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:03.522078 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:03.522078 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:03.522078 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:03.522078 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:03.522078 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:03.522078 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:03.522942 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:03.522942 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:03.522942 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:03.522942 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:03.522942 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:10:03.522942 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:10:03.522942 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:10:03.522942 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:10:03.522942 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:10:03.522942 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:10:03.522942 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:10:03.522942 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:03.526421 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 284/569] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jun 4 08:10:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:03.526887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788ffdb-126f-4d3f-ba21-162547b6987c None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:03.557782 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:03.583688 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad27a89-2058-430c-9b4d-60568a8c461d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:03.616737 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8e64d-8bae-41d8-aa14-af4a240e823c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:03.617393 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8e64d-8bae-41d8-aa14-af4a240e823c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:03.617675 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8e64d-8bae-41d8-aa14-af4a240e823c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:03.617984 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8e64d-8bae-41d8-aa14-af4a240e823c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:03.618807 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8e64d-8bae-41d8-aa14-af4a240e823c None admin] RBAC: Adding query filter params (role.id=c9ec7276464a4d87ab2b6fc52a3bfeae, scope.project.id=634c9a1745ef44c0ad66e02493d79af0, user.id=05ea412cab4244c58a2670c66f5a311c) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:03.619115 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8e64d-8bae-41d8-aa14-af4a240e823c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:03.620546 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8e64d-8bae-41d8-aa14-af4a240e823c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:03.625786 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 286/570] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:10:03 2022] GET /identity/v3/role_assignments?user.id=05ea412cab4244c58a2670c66f5a311c&scope.project.id=634c9a1745ef44c0ad66e02493d79af0&role.id=c9ec7276464a4d87ab2b6fc52a3bfeae => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:03.626568 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8e64d-8bae-41d8-aa14-af4a240e823c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:03.627489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788ffdb-126f-4d3f-ba21-162547b6987c None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:03.669085 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c081af6-5fb1-4e88-8881-7717c0f1c568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:03.669969 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c081af6-5fb1-4e88-8881-7717c0f1c568 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:03.670313 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c081af6-5fb1-4e88-8881-7717c0f1c568 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:03.670905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c081af6-5fb1-4e88-8881-7717c0f1c568 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:03.672007 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c081af6-5fb1-4e88-8881-7717c0f1c568 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:03.672327 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c081af6-5fb1-4e88-8881-7717c0f1c568 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:03.674711 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c081af6-5fb1-4e88-8881-7717c0f1c568 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:03.689493 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 285/571] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:03.691086 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f52d2-d42c-4375-b444-0f752fb908bd None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:03.691382 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f52d2-d42c-4375-b444-0f752fb908bd None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:03.691664 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f52d2-d42c-4375-b444-0f752fb908bd None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:03.694237 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 286/572] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:03.695225 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f52d2-d42c-4375-b444-0f752fb908bd None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:03.754972 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:03.762222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8e64d-8bae-41d8-aa14-af4a240e823c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:03.801430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:03.802231 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfa6e2-d17a-4b0c-8cf7-53ffd21eff82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:03.803721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfa6e2-d17a-4b0c-8cf7-53ffd21eff82 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:03.804333 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfa6e2-d17a-4b0c-8cf7-53ffd21eff82 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:03.804618 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfa6e2-d17a-4b0c-8cf7-53ffd21eff82 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:03.805469 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdfa6e2-d17a-4b0c-8cf7-53ffd21eff82 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:03.805783 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdfa6e2-d17a-4b0c-8cf7-53ffd21eff82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:03.807279 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdfa6e2-d17a-4b0c-8cf7-53ffd21eff82 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:03.813856 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f52d2-d42c-4375-b444-0f752fb908bd None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:03.826276 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 287/573] 10.222.0.57 () {56 vars in 1133 bytes} [Sat Jun 4 08:10:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:03.827359 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfa6e2-d17a-4b0c-8cf7-53ffd21eff82 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:03.856899 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857a65f-9bed-47c4-bb29-ed2ca56ac895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:03.857843 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857a65f-9bed-47c4-bb29-ed2ca56ac895 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:03.858129 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857a65f-9bed-47c4-bb29-ed2ca56ac895 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:03.858407 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857a65f-9bed-47c4-bb29-ed2ca56ac895 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:03.859147 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857a65f-9bed-47c4-bb29-ed2ca56ac895 None admin] RBAC: Adding query filter params (name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:03.859455 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857a65f-9bed-47c4-bb29-ed2ca56ac895 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:03.860821 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857a65f-9bed-47c4-bb29-ed2ca56ac895 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:03.868864 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 287/574] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jun 4 08:10:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:03.870083 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3d013-bbb2-4a95-a24f-baba7652e64c None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:03.870370 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3d013-bbb2-4a95-a24f-baba7652e64c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:03.870689 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3d013-bbb2-4a95-a24f-baba7652e64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:03.887823 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-d4e3d013-bbb2-4a95-a24f-baba7652e64c None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:03.889001 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d4e3d013-bbb2-4a95-a24f-baba7652e64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:03.949251 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfa6e2-d17a-4b0c-8cf7-53ffd21eff82 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:03.966948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 288/575] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:10:03.967792 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3d013-bbb2-4a95-a24f-baba7652e64c None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:03.998271 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a9e81-b9bb-463b-b5ad-4928f93c0819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:04.000075 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a9e81-b9bb-463b-b5ad-4928f93c0819 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:04.000566 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a9e81-b9bb-463b-b5ad-4928f93c0819 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:04.001066 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a9e81-b9bb-463b-b5ad-4928f93c0819 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:04.012224 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a9e81-b9bb-463b-b5ad-4928f93c0819 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:04.014539 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a9e81-b9bb-463b-b5ad-4928f93c0819 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:04.031156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-4c4a9e81-b9bb-463b-b5ad-4928f93c0819 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 04 08:10:04.031156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:04.031156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:04.031156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:04.031156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:04.031156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:04.031156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:04.031156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:04.031156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:04.031156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:04.031156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:04.031156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:04.031156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:10:04.031156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:10:04.031156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:10:04.031156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:10:04.032109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:04.032109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:04.032109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:10:04.032109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:04.032109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:10:04.032109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:04.032109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:04.032109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:04.032109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:04.032109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:04.032109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:04.032109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:04.032109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:04.032109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:04.032109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:04.032109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:04.032109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:04.032109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:04.033054 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:04.033054 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:04.033054 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:10:04.033054 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:10:04.033054 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:10:04.033054 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:10:04.033054 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:10:04.033054 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:10:04.033054 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 04 08:10:04.033054 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:04.033054 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 288/576] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:10:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:04.033675 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a9e81-b9bb-463b-b5ad-4928f93c0819 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:04.048744 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:04.060579 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:04.081574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3d013-bbb2-4a95-a24f-baba7652e64c None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:04.115725 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1cd7f-b1c2-4f31-a3df-a33f8726c0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:04.116642 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1cd7f-b1c2-4f31-a3df-a33f8726c0fb None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:04.116924 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1cd7f-b1c2-4f31-a3df-a33f8726c0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:04.117198 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1cd7f-b1c2-4f31-a3df-a33f8726c0fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:04.129453 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1cd7f-b1c2-4f31-a3df-a33f8726c0fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:04.130941 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1cd7f-b1c2-4f31-a3df-a33f8726c0fb None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:04.144777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a9e81-b9bb-463b-b5ad-4928f93c0819 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:04.150978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-fdd1cd7f-b1c2-4f31-a3df-a33f8726c0fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:04.150978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:04.150978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:04.150978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:04.150978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:04.150978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:04.150978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:04.150978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:04.150978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:04.150978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:04.150978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:04.150978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:04.150978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:04.150978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:04.150978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:04.151857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:04.151857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:04.151857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:04.151857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:04.151857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:04.151857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:04.151857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:04.151857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:04.151857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:04.151857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:04.151857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:04.151857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:04.151857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:04.151857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:04.151857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:04.151857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:04.151857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:04.152754 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:04.152754 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:04.152754 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:04.152754 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:04.152754 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 289/577] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:04.153438 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1cd7f-b1c2-4f31-a3df-a33f8726c0fb None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:04.185862 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd9cb3-a041-44af-8804-54ac37f066fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:04.186664 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd9cb3-a041-44af-8804-54ac37f066fa None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:04.186945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd9cb3-a041-44af-8804-54ac37f066fa None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:04.187218 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd9cb3-a041-44af-8804-54ac37f066fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:04.198456 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd9cb3-a041-44af-8804-54ac37f066fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:04.200090 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd9cb3-a041-44af-8804-54ac37f066fa None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:04.220236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-42fd9cb3-a041-44af-8804-54ac37f066fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:04.220236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:04.220236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:04.220236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:04.220236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:04.220236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:04.220236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:04.220236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:04.220236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:04.220236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:04.220236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:04.220236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:04.220236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:04.220236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:04.220236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:04.221208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:04.221208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:04.221208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:04.221208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:04.221208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:04.221208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:04.221208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:04.221208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:04.221208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:04.221208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:04.221208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:04.221208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:04.221208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:04.221208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:04.221208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:04.221208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:04.221208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:04.222137 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:04.222137 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:04.222137 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:04.222137 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:04.222137 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 289/578] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:04.223150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd9cb3-a041-44af-8804-54ac37f066fa None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:04.263848 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1cd7f-b1c2-4f31-a3df-a33f8726c0fb None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:04.286791 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:04.300956 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564dae42-92c3-4ffe-9bff-314bd8e43fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:04.301899 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dae42-92c3-4ffe-9bff-314bd8e43fba None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:04.302187 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dae42-92c3-4ffe-9bff-314bd8e43fba None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:04.302466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dae42-92c3-4ffe-9bff-314bd8e43fba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:04.304785 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:04.317521 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564dae42-92c3-4ffe-9bff-314bd8e43fba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:10:04.325844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-564dae42-92c3-4ffe-9bff-314bd8e43fba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:10:04.325844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:04.325844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:04.325844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:04.325844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:04.325844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:04.325844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:04.325844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:04.325844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:04.325844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:04.325844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:04.325844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:04.325844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:10:04.325844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:10:04.325844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:10:04.325844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:10:04.326786 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:10:04.326786 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:10:04.326786 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:10:04.326786 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:10:04.326786 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:04.326786 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:04.326786 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:04.326786 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:04.326786 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:04.326786 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:04.326786 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:04.326786 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:04.326786 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:04.326786 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:04.326786 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:04.326786 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:04.327639 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:04.327639 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:04.327639 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:04.327639 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:04.327639 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:10:04.327639 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:10:04.327639 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:10:04.327639 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:10:04.327639 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:10:04.327639 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:10:04.327639 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:10:04.327639 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:04.327639 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 290/579] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jun 4 08:10:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:04.328566 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564dae42-92c3-4ffe-9bff-314bd8e43fba None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:04.334436 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd9cb3-a041-44af-8804-54ac37f066fa None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:04.370786 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe30d1-4b31-4fe5-b48e-b2ea2bfd1cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:04.371461 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe30d1-4b31-4fe5-b48e-b2ea2bfd1cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:04.371745 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe30d1-4b31-4fe5-b48e-b2ea2bfd1cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:04.372021 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe30d1-4b31-4fe5-b48e-b2ea2bfd1cf6 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:04.372849 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe30d1-4b31-4fe5-b48e-b2ea2bfd1cf6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:04.373158 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe30d1-4b31-4fe5-b48e-b2ea2bfd1cf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:04.374659 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe30d1-4b31-4fe5-b48e-b2ea2bfd1cf6 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:04.392928 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 290/580] 10.222.0.57 () {56 vars in 1137 bytes} [Sat Jun 4 08:10:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:04.393841 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe30d1-4b31-4fe5-b48e-b2ea2bfd1cf6 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:04.455710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564dae42-92c3-4ffe-9bff-314bd8e43fba None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:04.490965 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c563b-39db-407a-bcc7-579f09fd8867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:04.491762 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c563b-39db-407a-bcc7-579f09fd8867 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:04.492116 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c563b-39db-407a-bcc7-579f09fd8867 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:04.492867 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c563b-39db-407a-bcc7-579f09fd8867 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:04.493669 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c563b-39db-407a-bcc7-579f09fd8867 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:04.494032 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c563b-39db-407a-bcc7-579f09fd8867 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:04.495392 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c563b-39db-407a-bcc7-579f09fd8867 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:04.508321 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 291/581] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:04.508926 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c563b-39db-407a-bcc7-579f09fd8867 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:04.520946 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe30d1-4b31-4fe5-b48e-b2ea2bfd1cf6 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:04.544559 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:04.558627 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfda555-99f3-49c3-b2ee-18abdc84fdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:04.559288 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfda555-99f3-49c3-b2ee-18abdc84fdd0 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:04.559687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfda555-99f3-49c3-b2ee-18abdc84fdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:04.559964 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfda555-99f3-49c3-b2ee-18abdc84fdd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:04.560681 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfda555-99f3-49c3-b2ee-18abdc84fdd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:04.560991 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfda555-99f3-49c3-b2ee-18abdc84fdd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:04.562406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfda555-99f3-49c3-b2ee-18abdc84fdd0 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:04.565953 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:04.574566 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 291/582] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:04.579435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfda555-99f3-49c3-b2ee-18abdc84fdd0 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:04.613063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c563b-39db-407a-bcc7-579f09fd8867 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:04.650017 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fde98-0e32-4104-be66-d5612e080c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:04.650679 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fde98-0e32-4104-be66-d5612e080c52 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:04.650972 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fde98-0e32-4104-be66-d5612e080c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:04.651252 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fde98-0e32-4104-be66-d5612e080c52 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:04.651995 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fde98-0e32-4104-be66-d5612e080c52 None admin] RBAC: Adding query filter params (name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:04.652299 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fde98-0e32-4104-be66-d5612e080c52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:04.653664 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fde98-0e32-4104-be66-d5612e080c52 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:04.661561 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 292/583] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jun 4 08:10:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:04.662383 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fde98-0e32-4104-be66-d5612e080c52 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:04.689651 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfda555-99f3-49c3-b2ee-18abdc84fdd0 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:04.726935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7d0b4-b778-456f-8a75-67d5e2c6b4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:04.727752 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7d0b4-b778-456f-8a75-67d5e2c6b4ff None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:04.728042 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7d0b4-b778-456f-8a75-67d5e2c6b4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:04.728332 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7d0b4-b778-456f-8a75-67d5e2c6b4ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:04.743626 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f7d0b4-b778-456f-8a75-67d5e2c6b4ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:04.745373 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f7d0b4-b778-456f-8a75-67d5e2c6b4ff None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:04.765958 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-f9f7d0b4-b778-456f-8a75-67d5e2c6b4ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:04.765958 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:04.765958 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:04.765958 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:04.765958 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:04.765958 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:04.765958 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:04.765958 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:04.765958 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:04.765958 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:04.765958 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:04.765958 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:04.765958 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:04.765958 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:04.765958 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:04.766944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:04.766944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:04.766944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:04.766944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:04.766944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:04.766944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:04.766944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:04.766944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:04.766944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:04.766944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:04.766944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:04.766944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:04.766944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:04.766944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:04.766944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:04.766944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:04.766944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:04.767914 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:04.767914 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:04.767914 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:04.767914 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:04.767914 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 292/584] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:04.769291 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7d0b4-b778-456f-8a75-67d5e2c6b4ff None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:04.779297 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fde98-0e32-4104-be66-d5612e080c52 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:04.796795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:04.805173 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:04.819334 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ff350-5a3b-4422-b8e9-066c96d4dcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:04.820136 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ff350-5a3b-4422-b8e9-066c96d4dcc2 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:04.820423 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ff350-5a3b-4422-b8e9-066c96d4dcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:04.820700 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ff350-5a3b-4422-b8e9-066c96d4dcc2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:04.828295 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ff350-5a3b-4422-b8e9-066c96d4dcc2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:04.829753 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ff350-5a3b-4422-b8e9-066c96d4dcc2 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:04.845251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-cb2ff350-5a3b-4422-b8e9-066c96d4dcc2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:04.845251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:04.845251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:04.845251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:04.845251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:04.845251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:04.845251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:04.845251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:04.845251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:04.845251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:04.845251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:04.845251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:04.845251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:10:04.845251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:10:04.845251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:10:04.846524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:10:04.846524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:04.846524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:04.846524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:04.846524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:04.846524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:04.846524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:04.846524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:04.846524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:04.846524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:04.846524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:04.846524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:04.846524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:04.846524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:04.846524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:04.846524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:04.846524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:04.847473 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:10:04.847473 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:10:04.847473 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:10:04.847473 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:10:04.847473 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:10:04.847473 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:10:04.847473 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:04.847473 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:04.851187 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 293/585] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:10:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:04.851916 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ff350-5a3b-4422-b8e9-066c96d4dcc2 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:04.875081 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7d0b4-b778-456f-8a75-67d5e2c6b4ff None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:04.911164 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b745eb-0432-493f-ae26-2e117390065f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:04.911976 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b745eb-0432-493f-ae26-2e117390065f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:04.912256 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b745eb-0432-493f-ae26-2e117390065f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:04.912530 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b745eb-0432-493f-ae26-2e117390065f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:04.924596 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b745eb-0432-493f-ae26-2e117390065f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:04.926256 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b745eb-0432-493f-ae26-2e117390065f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:04.941368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-86b745eb-0432-493f-ae26-2e117390065f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 04 08:10:04.941368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:04.941368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:04.941368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:04.941368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:04.941368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:04.941368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:04.941368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:04.941368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:04.941368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:04.941368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:04.941368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:04.941368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:10:04.941368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:10:04.941368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:10:04.941368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:10:04.942377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:04.942377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:04.942377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:10:04.942377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:04.942377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:10:04.942377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:04.942377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:04.942377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:04.942377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:04.942377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:04.942377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:04.942377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:04.942377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:04.942377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:04.942377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:04.942377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:04.942377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:04.942377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:04.950060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:04.950060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:04.950060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:10:04.950060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:10:04.950060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:10:04.950060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:10:04.950060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:10:04.950060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:10:04.950060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 04 08:10:04.950060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:04.950060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 293/586] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:10:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:04.950060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b745eb-0432-493f-ae26-2e117390065f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:04.967278 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ff350-5a3b-4422-b8e9-066c96d4dcc2 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:05.006472 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c703a2-ecee-467a-9f15-58a7ecdeb460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:05.007259 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c703a2-ecee-467a-9f15-58a7ecdeb460 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:05.007538 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c703a2-ecee-467a-9f15-58a7ecdeb460 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:05.007809 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c703a2-ecee-467a-9f15-58a7ecdeb460 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:05.017545 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c703a2-ecee-467a-9f15-58a7ecdeb460 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:05.019038 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c703a2-ecee-467a-9f15-58a7ecdeb460 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:05.036289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-82c703a2-ecee-467a-9f15-58a7ecdeb460 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:05.036289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:05.036289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:05.036289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:05.036289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:05.036289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:05.036289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:05.036289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:05.036289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:05.036289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:05.036289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:05.036289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:05.036289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:05.036289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:05.036289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:05.037214 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:05.037214 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:05.037214 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:05.037214 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:05.037214 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:05.037214 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:05.037214 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:05.037214 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:05.037214 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:05.037214 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:05.037214 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:05.037214 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:05.037214 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:05.037214 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:05.037214 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:05.037214 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:05.037214 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:05.038332 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:05.038332 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:05.038332 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:05.038332 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:05.038332 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 294/587] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:05.044457 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c703a2-ecee-467a-9f15-58a7ecdeb460 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:05.059623 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:05.067441 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b745eb-0432-493f-ae26-2e117390065f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:05.077144 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:05.100630 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a84995-ec20-4711-a037-d5ce073ee69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:05.101287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a84995-ec20-4711-a037-d5ce073ee69f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:05.101567 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a84995-ec20-4711-a037-d5ce073ee69f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:05.101852 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a84995-ec20-4711-a037-d5ce073ee69f None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:05.102567 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a84995-ec20-4711-a037-d5ce073ee69f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:05.102871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a84995-ec20-4711-a037-d5ce073ee69f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:05.104235 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a84995-ec20-4711-a037-d5ce073ee69f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:05.121043 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 294/588] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:05.121043 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a84995-ec20-4711-a037-d5ce073ee69f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:05.158670 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c703a2-ecee-467a-9f15-58a7ecdeb460 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:05.197111 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db070c7d-22b9-47ce-aa42-fabcc007c0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:05.198118 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db070c7d-22b9-47ce-aa42-fabcc007c0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:05.198118 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db070c7d-22b9-47ce-aa42-fabcc007c0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:05.198406 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db070c7d-22b9-47ce-aa42-fabcc007c0c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:05.199162 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db070c7d-22b9-47ce-aa42-fabcc007c0c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:05.199469 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db070c7d-22b9-47ce-aa42-fabcc007c0c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:05.200889 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db070c7d-22b9-47ce-aa42-fabcc007c0c3 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:05.216910 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 295/589] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:10:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:05.216910 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db070c7d-22b9-47ce-aa42-fabcc007c0c3 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:05.230312 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a84995-ec20-4711-a037-d5ce073ee69f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:05.266459 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f62dc-9bc0-4a75-9dd5-5e03cb086f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:05.267137 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f62dc-9bc0-4a75-9dd5-5e03cb086f72 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:05.267423 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f62dc-9bc0-4a75-9dd5-5e03cb086f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:05.267695 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f62dc-9bc0-4a75-9dd5-5e03cb086f72 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:05.269066 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f62dc-9bc0-4a75-9dd5-5e03cb086f72 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:05.269374 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f62dc-9bc0-4a75-9dd5-5e03cb086f72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:05.270840 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f62dc-9bc0-4a75-9dd5-5e03cb086f72 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:05.295588 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 295/590] 10.222.0.57 () {56 vars in 1137 bytes} [Sat Jun 4 08:10:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:05.295588 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f62dc-9bc0-4a75-9dd5-5e03cb086f72 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:05.308990 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:05.316140 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:05.330149 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db070c7d-22b9-47ce-aa42-fabcc007c0c3 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:05.369195 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5b223-085f-4fba-b7a4-b6f0f0770c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:05.370367 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5b223-085f-4fba-b7a4-b6f0f0770c3e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:05.370852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5b223-085f-4fba-b7a4-b6f0f0770c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:05.371403 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5b223-085f-4fba-b7a4-b6f0f0770c3e None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:05.372329 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5b223-085f-4fba-b7a4-b6f0f0770c3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:05.372836 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5b223-085f-4fba-b7a4-b6f0f0770c3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:05.374682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5b223-085f-4fba-b7a4-b6f0f0770c3e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:05.388311 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 296/591] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:05.389456 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5b223-085f-4fba-b7a4-b6f0f0770c3e None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:05.400364 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f62dc-9bc0-4a75-9dd5-5e03cb086f72 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:05.434461 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4222a62-19d9-42db-9a57-14cbcae8fe15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:05.435259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4222a62-19d9-42db-9a57-14cbcae8fe15 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:05.435540 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4222a62-19d9-42db-9a57-14cbcae8fe15 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:05.435816 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4222a62-19d9-42db-9a57-14cbcae8fe15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:05.443429 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4222a62-19d9-42db-9a57-14cbcae8fe15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:05.444843 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4222a62-19d9-42db-9a57-14cbcae8fe15 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:05.458878 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-b4222a62-19d9-42db-9a57-14cbcae8fe15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:05.458878 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:05.458878 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:05.458878 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:05.458878 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:05.458878 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:05.458878 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:05.458878 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:05.458878 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:05.458878 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:05.458878 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:05.458878 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:05.458878 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:10:05.458878 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:10:05.458878 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:10:05.460006 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:10:05.460006 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:05.460006 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:05.460006 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:05.460006 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:05.460006 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:05.460006 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:05.460006 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:05.460006 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:05.460006 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:05.460006 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:05.460006 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:05.460006 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:05.460006 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:05.460006 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:05.460006 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:05.460006 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:05.461167 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:10:05.461167 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:10:05.461167 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:10:05.461167 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:10:05.461167 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:10:05.461167 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:10:05.461167 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:05.461167 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:05.464586 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 296/592] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:10:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:05.465356 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4222a62-19d9-42db-9a57-14cbcae8fe15 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:05.500450 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5b223-085f-4fba-b7a4-b6f0f0770c3e None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:05.537888 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8edb2-14dc-48c4-a781-9bd89d7e2684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:05.538714 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8edb2-14dc-48c4-a781-9bd89d7e2684 None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:05.538998 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8edb2-14dc-48c4-a781-9bd89d7e2684 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:05.539277 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8edb2-14dc-48c4-a781-9bd89d7e2684 None admin] PATH_INFO: `/v3/projects/634c9a1745ef44c0ad66e02493d79af0/users/7e64d002241242928936dd0d991ecdc1/roles/c9ec7276464a4d87ab2b6fc52a3bfeae` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:05.540495 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:05.556909 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8edb2-14dc-48c4-a781-9bd89d7e2684 None admin] RBAC: Authorizing `identity:create_grant(project_id=634c9a1745ef44c0ad66e02493d79af0, user_id=7e64d002241242928936dd0d991ecdc1, role_id=c9ec7276464a4d87ab2b6fc52a3bfeae)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:05.558449 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8edb2-14dc-48c4-a781-9bd89d7e2684 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:05.568855 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:05.574802 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 297/593] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jun 4 08:10:05 2022] PUT /identity/v3/projects/634c9a1745ef44c0ad66e02493d79af0/users/7e64d002241242928936dd0d991ecdc1/roles/c9ec7276464a4d87ab2b6fc52a3bfeae => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:10:05.575606 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8edb2-14dc-48c4-a781-9bd89d7e2684 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:05.576644 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4222a62-19d9-42db-9a57-14cbcae8fe15 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:05.621927 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06ba2f-a156-43de-bef3-21ce4fe7dece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:05.623036 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06ba2f-a156-43de-bef3-21ce4fe7dece None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:05.623475 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06ba2f-a156-43de-bef3-21ce4fe7dece None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:05.623903 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06ba2f-a156-43de-bef3-21ce4fe7dece None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:05.638798 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06ba2f-a156-43de-bef3-21ce4fe7dece None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:05.640753 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06ba2f-a156-43de-bef3-21ce4fe7dece None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:05.670236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-fb06ba2f-a156-43de-bef3-21ce4fe7dece None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:05.670236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:05.670236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:05.670236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:05.670236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:05.670236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:05.670236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:05.670236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:05.670236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:05.670236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:05.670236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:05.670236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:05.670236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:05.670236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:05.670236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:05.671429 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:05.671429 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:05.671429 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:05.671429 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:05.671429 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:05.671429 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:05.671429 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:05.671429 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:05.671429 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:05.671429 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:05.671429 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:05.671429 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:05.671429 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:05.671429 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:05.671429 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:05.671429 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:05.671429 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:05.672568 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:05.672568 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:05.672568 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:05.672568 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:05.675007 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 297/594] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:05.676128 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06ba2f-a156-43de-bef3-21ce4fe7dece None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:05.723770 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8edb2-14dc-48c4-a781-9bd89d7e2684 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:05.777766 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80615d93-7486-467d-a697-7791c9ecd3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:05.779107 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80615d93-7486-467d-a697-7791c9ecd3f5 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:05.779500 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80615d93-7486-467d-a697-7791c9ecd3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:05.780141 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80615d93-7486-467d-a697-7791c9ecd3f5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:05.793518 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80615d93-7486-467d-a697-7791c9ecd3f5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:05.795539 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80615d93-7486-467d-a697-7791c9ecd3f5 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:05.816552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-80615d93-7486-467d-a697-7791c9ecd3f5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 04 08:10:05.816552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:05.816552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:05.816552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:05.816552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:05.816552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:05.816552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:05.816552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:05.816552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:05.816552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:05.816552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:05.816552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:05.816552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:10:05.816552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:10:05.816552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:10:05.816552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:10:05.817575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:05.817575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:05.817575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:10:05.817575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:05.817575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:10:05.817575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:05.817575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:05.817575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:05.817575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:05.817575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:05.817575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:05.817575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:05.817575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:05.817575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:05.817575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:05.817575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:05.817575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:05.817575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:05.818575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:05.818575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:05.818575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:10:05.818575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:10:05.818575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:10:05.818575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:10:05.818575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:10:05.818575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:10:05.818575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 04 08:10:05.818575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:05.818575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 298/595] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jun 4 08:10:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:05.818575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80615d93-7486-467d-a697-7791c9ecd3f5 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:05.829380 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06ba2f-a156-43de-bef3-21ce4fe7dece None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:05.858127 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:05.868038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b9592-3a0f-4897-a44d-0f37a97fc17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:05.868704 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b9592-3a0f-4897-a44d-0f37a97fc17e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:05.869022 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b9592-3a0f-4897-a44d-0f37a97fc17e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:05.869622 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b9592-3a0f-4897-a44d-0f37a97fc17e None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:05.870104 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b9592-3a0f-4897-a44d-0f37a97fc17e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:05.870386 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b9592-3a0f-4897-a44d-0f37a97fc17e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:05.871836 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b9592-3a0f-4897-a44d-0f37a97fc17e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:05.885809 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 298/596] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:10:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:05.890945 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:05.891472 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b9592-3a0f-4897-a44d-0f37a97fc17e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:05.939471 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80615d93-7486-467d-a697-7791c9ecd3f5 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:05.975067 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa3714-5f0b-4efe-a75d-1383e148d5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:05.975730 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa3714-5f0b-4efe-a75d-1383e148d5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:05.976015 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa3714-5f0b-4efe-a75d-1383e148d5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:05.976293 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa3714-5f0b-4efe-a75d-1383e148d5f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:05.977017 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa3714-5f0b-4efe-a75d-1383e148d5f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:05.977328 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa3714-5f0b-4efe-a75d-1383e148d5f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:05.978738 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa3714-5f0b-4efe-a75d-1383e148d5f1 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:05.995681 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 299/597] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:05.995681 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77965f62-d1e5-4bd7-9549-18cbe1314bbd None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:05.995681 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77965f62-d1e5-4bd7-9549-18cbe1314bbd None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:05.995681 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77965f62-d1e5-4bd7-9549-18cbe1314bbd None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:05.995681 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 300/598] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:05.995681 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77965f62-d1e5-4bd7-9549-18cbe1314bbd None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:06.008889 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b9592-3a0f-4897-a44d-0f37a97fc17e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:06.046874 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b165d9-d9ae-4a21-9487-72793e225450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:06.047291 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b165d9-d9ae-4a21-9487-72793e225450 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:06.047576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b165d9-d9ae-4a21-9487-72793e225450 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:06.047863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b165d9-d9ae-4a21-9487-72793e225450 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:06.048684 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b165d9-d9ae-4a21-9487-72793e225450 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:06.048997 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b165d9-d9ae-4a21-9487-72793e225450 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:06.051009 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b165d9-d9ae-4a21-9487-72793e225450 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:06.069056 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 299/599] 10.222.0.57 () {56 vars in 1139 bytes} [Sat Jun 4 08:10:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:06.070049 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b165d9-d9ae-4a21-9487-72793e225450 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:06.112655 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77965f62-d1e5-4bd7-9549-18cbe1314bbd None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:06.118441 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:06.131556 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:06.151581 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213a9f2-67c6-4f0b-b175-502e61bddf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:06.152472 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213a9f2-67c6-4f0b-b175-502e61bddf00 None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:06.152753 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213a9f2-67c6-4f0b-b175-502e61bddf00 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:06.153024 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213a9f2-67c6-4f0b-b175-502e61bddf00 None admin] PATH_INFO: `/v3/projects/634c9a1745ef44c0ad66e02493d79af0/users/3ab0603fbcd54121b543fbf2a44fecf0/roles/c9ec7276464a4d87ab2b6fc52a3bfeae` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:06.167614 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213a9f2-67c6-4f0b-b175-502e61bddf00 None admin] RBAC: Authorizing `identity:create_grant(project_id=634c9a1745ef44c0ad66e02493d79af0, user_id=3ab0603fbcd54121b543fbf2a44fecf0, role_id=c9ec7276464a4d87ab2b6fc52a3bfeae)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:06.169047 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213a9f2-67c6-4f0b-b175-502e61bddf00 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:06.184594 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b165d9-d9ae-4a21-9487-72793e225450 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:06.190391 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 301/600] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jun 4 08:10:05 2022] PUT /identity/v3/projects/634c9a1745ef44c0ad66e02493d79af0/users/3ab0603fbcd54121b543fbf2a44fecf0/roles/c9ec7276464a4d87ab2b6fc52a3bfeae => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:10:06.191932 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9d9d4-14c0-4f36-99cc-b349a6a8fed9 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:06.192223 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9d9d4-14c0-4f36-99cc-b349a6a8fed9 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:06.192501 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9d9d4-14c0-4f36-99cc-b349a6a8fed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:06.221712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-15a9d9d4-14c0-4f36-99cc-b349a6a8fed9 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:06.223697 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-15a9d9d4-14c0-4f36-99cc-b349a6a8fed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:06.226402 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c524dc7-6a6a-4b85-8271-8827072de5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:06.227273 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c524dc7-6a6a-4b85-8271-8827072de5eb None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:06.227631 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c524dc7-6a6a-4b85-8271-8827072de5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:06.228771 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c524dc7-6a6a-4b85-8271-8827072de5eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:06.236392 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c524dc7-6a6a-4b85-8271-8827072de5eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:06.238076 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c524dc7-6a6a-4b85-8271-8827072de5eb None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:06.254444 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-1c524dc7-6a6a-4b85-8271-8827072de5eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:06.254444 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:06.254444 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:06.254444 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:06.254444 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:06.254444 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:06.254444 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:06.254444 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:06.254444 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:06.254444 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:06.254444 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:06.254444 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:06.254444 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:10:06.254444 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:10:06.254444 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:10:06.255435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:10:06.255435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:06.255435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:06.255435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:06.255435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:06.255435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:06.255435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:06.255435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:06.255435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:06.255435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:06.255435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:06.255435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:06.255435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:06.255435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:06.255435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:06.255435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:06.255435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:06.256331 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:10:06.256331 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:10:06.256331 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:10:06.256331 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:10:06.256331 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:10:06.256331 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:10:06.256331 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:06.256331 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:06.260832 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 300/601] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:10:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:06.262359 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c524dc7-6a6a-4b85-8271-8827072de5eb None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:06.319239 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 302/602] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:10:06.320278 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9d9d4-14c0-4f36-99cc-b349a6a8fed9 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:06.411353 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c524dc7-6a6a-4b85-8271-8827072de5eb None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:06.413708 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:06.436546 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:06.441563 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9d9d4-14c0-4f36-99cc-b349a6a8fed9 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:06.463036 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1ecb7-1416-4c7d-b3bd-b22742f43aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:06.464488 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1ecb7-1416-4c7d-b3bd-b22742f43aed None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:06.464932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1ecb7-1416-4c7d-b3bd-b22742f43aed None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:06.465378 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1ecb7-1416-4c7d-b3bd-b22742f43aed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:06.480315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a1ecb7-1416-4c7d-b3bd-b22742f43aed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:06.482480 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a1ecb7-1416-4c7d-b3bd-b22742f43aed None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:06.486268 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b35f17-f886-400c-bc94-8c0334f0e622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:06.487655 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b35f17-f886-400c-bc94-8c0334f0e622 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:06.488111 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b35f17-f886-400c-bc94-8c0334f0e622 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:06.488538 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b35f17-f886-400c-bc94-8c0334f0e622 None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:06.489478 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b35f17-f886-400c-bc94-8c0334f0e622 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:06.489963 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b35f17-f886-400c-bc94-8c0334f0e622 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:06.491998 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b35f17-f886-400c-bc94-8c0334f0e622 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:06.502895 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-b8a1ecb7-1416-4c7d-b3bd-b22742f43aed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:06.502895 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:06.502895 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:06.502895 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:06.502895 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:06.502895 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:06.502895 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:06.502895 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:06.502895 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:06.502895 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:06.502895 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:06.502895 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:06.502895 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:06.502895 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:06.502895 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:06.504004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:06.504004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:06.504004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:06.504004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:06.504004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:06.504004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:06.504004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:06.504004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:06.504004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:06.504004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:06.504004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:06.504004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:06.504004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:06.504004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:06.504004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:06.504004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:06.504004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:06.505128 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:06.505128 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:06.505128 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:06.505128 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:06.508607 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 303/604] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:10:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:06.509583 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b35f17-f886-400c-bc94-8c0334f0e622 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:06.514017 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 301/604] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:06.517101 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1ecb7-1416-4c7d-b3bd-b22742f43aed None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:06.625842 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1ecb7-1416-4c7d-b3bd-b22742f43aed None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:06.634370 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b35f17-f886-400c-bc94-8c0334f0e622 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:06.661762 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17dd86-a61b-43c5-9ee6-37d0713c7828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:06.662708 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17dd86-a61b-43c5-9ee6-37d0713c7828 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:06.663148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17dd86-a61b-43c5-9ee6-37d0713c7828 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:06.663559 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17dd86-a61b-43c5-9ee6-37d0713c7828 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:06.664417 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17dd86-a61b-43c5-9ee6-37d0713c7828 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:06.664986 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17dd86-a61b-43c5-9ee6-37d0713c7828 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:06.666552 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17dd86-a61b-43c5-9ee6-37d0713c7828 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:06.671997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea1395-f502-4960-8c89-c96bc8a7bef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:06.672903 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea1395-f502-4960-8c89-c96bc8a7bef6 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:06.673332 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea1395-f502-4960-8c89-c96bc8a7bef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:06.673711 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea1395-f502-4960-8c89-c96bc8a7bef6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:06.682599 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 302/605] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:06.683576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17dd86-a61b-43c5-9ee6-37d0713c7828 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:06.691037 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea1395-f502-4960-8c89-c96bc8a7bef6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:10:06.699791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-2fea1395-f502-4960-8c89-c96bc8a7bef6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:10:06.699791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:06.699791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:06.699791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:06.699791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:06.699791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:06.699791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:06.699791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:06.699791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:06.699791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:06.699791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:06.699791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:06.699791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:10:06.699791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:10:06.699791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:10:06.699791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:10:06.700948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:10:06.700948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:10:06.700948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:10:06.700948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:10:06.700948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:06.700948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:06.700948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:06.700948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:06.700948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:06.700948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:06.700948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:06.700948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:06.700948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:06.700948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:06.700948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:06.700948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:06.702012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:06.702012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:06.702012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:06.702012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:06.702012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:10:06.702012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:10:06.702012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:10:06.702012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:10:06.702012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:10:06.702012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:10:06.702012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:10:06.702012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:06.702704 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:06.703308 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 304/606] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jun 4 08:10:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:06.705973 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea1395-f502-4960-8c89-c96bc8a7bef6 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:06.730333 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:06.826004 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea1395-f502-4960-8c89-c96bc8a7bef6 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:06.833100 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17dd86-a61b-43c5-9ee6-37d0713c7828 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:06.868905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83094f1e-5eaf-48d3-82df-23e13735656f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:06.871292 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83094f1e-5eaf-48d3-82df-23e13735656f None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:06.871582 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83094f1e-5eaf-48d3-82df-23e13735656f None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:06.871862 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83094f1e-5eaf-48d3-82df-23e13735656f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:06.878493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b762635-f729-4c97-964a-b3a003a6a1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:06.879688 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b762635-f729-4c97-964a-b3a003a6a1ed None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:06.880165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b762635-f729-4c97-964a-b3a003a6a1ed None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:06.880630 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b762635-f729-4c97-964a-b3a003a6a1ed None admin] PATH_INFO: `/v3/projects/634c9a1745ef44c0ad66e02493d79af0/users/5cd24a726e4e4ce687d150a3bdc5948f/roles/c9ec7276464a4d87ab2b6fc52a3bfeae` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:06.880734 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83094f1e-5eaf-48d3-82df-23e13735656f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:06.882456 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83094f1e-5eaf-48d3-82df-23e13735656f None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:06.896316 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b762635-f729-4c97-964a-b3a003a6a1ed None admin] RBAC: Authorizing `identity:create_grant(project_id=634c9a1745ef44c0ad66e02493d79af0, user_id=5cd24a726e4e4ce687d150a3bdc5948f, role_id=c9ec7276464a4d87ab2b6fc52a3bfeae)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:06.898124 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b762635-f729-4c97-964a-b3a003a6a1ed None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:06.899905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-83094f1e-5eaf-48d3-82df-23e13735656f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:06.899905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:06.899905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:06.899905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:06.899905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:06.899905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:06.899905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:06.899905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:06.899905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:06.899905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:06.899905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:06.899905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:06.899905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:10:06.899905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:10:06.899905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:10:06.901119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:10:06.901119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:06.901119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:06.901119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:06.901119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:06.901119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:06.901119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:06.901119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:06.901119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:06.901119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:06.901119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:06.901119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:06.901119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:06.901119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:06.901119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:06.901119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:06.901119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:06.902068 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:10:06.902068 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:10:06.902068 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:10:06.902068 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:10:06.902068 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:10:06.902068 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:10:06.902068 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:06.902068 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:06.905970 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 305/607] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:10:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:06.906832 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83094f1e-5eaf-48d3-82df-23e13735656f None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:06.929742 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 303/608] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jun 4 08:10:06 2022] PUT /identity/v3/projects/634c9a1745ef44c0ad66e02493d79af0/users/5cd24a726e4e4ce687d150a3bdc5948f/roles/c9ec7276464a4d87ab2b6fc52a3bfeae => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:10:06.930993 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b762635-f729-4c97-964a-b3a003a6a1ed None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:07.076633 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:07.079871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:07.129465 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83094f1e-5eaf-48d3-82df-23e13735656f None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:07.164012 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b762635-f729-4c97-964a-b3a003a6a1ed None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:07.196747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e09e0f-4666-40ea-9f26-975eac839006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:07.197869 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e09e0f-4666-40ea-9f26-975eac839006 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:07.198364 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e09e0f-4666-40ea-9f26-975eac839006 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:07.199381 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e09e0f-4666-40ea-9f26-975eac839006 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:07.200330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e09e0f-4666-40ea-9f26-975eac839006 None admin] RBAC: Adding query filter params (name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:07.200851 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e09e0f-4666-40ea-9f26-975eac839006 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:07.202576 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e09e0f-4666-40ea-9f26-975eac839006 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:07.217468 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b93b9-a31e-46aa-bcf3-262067c9f1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:07.218184 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b93b9-a31e-46aa-bcf3-262067c9f1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:07.218467 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b93b9-a31e-46aa-bcf3-262067c9f1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:07.218745 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b93b9-a31e-46aa-bcf3-262067c9f1b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:07.219611 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b93b9-a31e-46aa-bcf3-262067c9f1b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:07.219820 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 306/609] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jun 4 08:10:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:07.219929 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b93b9-a31e-46aa-bcf3-262067c9f1b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:07.222012 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b93b9-a31e-46aa-bcf3-262067c9f1b3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:07.227326 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e09e0f-4666-40ea-9f26-975eac839006 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:07.240532 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 304/610] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:10:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:07.245842 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b93b9-a31e-46aa-bcf3-262067c9f1b3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:07.410643 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e09e0f-4666-40ea-9f26-975eac839006 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:07.440860 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b93b9-a31e-46aa-bcf3-262067c9f1b3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:07.453621 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f7c81-2099-43d6-9ae0-8a5dd90ce950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:07.454653 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f7c81-2099-43d6-9ae0-8a5dd90ce950 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:07.454937 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f7c81-2099-43d6-9ae0-8a5dd90ce950 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:07.455215 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f7c81-2099-43d6-9ae0-8a5dd90ce950 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:07.465721 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:07.468700 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f7c81-2099-43d6-9ae0-8a5dd90ce950 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:07.470301 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f7c81-2099-43d6-9ae0-8a5dd90ce950 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:07.472651 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:07.485777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57677eb6-4a11-440b-a9f7-409c1f498ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:07.486859 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57677eb6-4a11-440b-a9f7-409c1f498ac4 None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:07.487235 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57677eb6-4a11-440b-a9f7-409c1f498ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:07.487605 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57677eb6-4a11-440b-a9f7-409c1f498ac4 None admin] PATH_INFO: `/v3/projects/634c9a1745ef44c0ad66e02493d79af0/users/5fd5768a512c4177abae05f4ccd5c59f/roles/c9ec7276464a4d87ab2b6fc52a3bfeae` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:07.493530 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-3e0f7c81-2099-43d6-9ae0-8a5dd90ce950 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:07.493530 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:07.493530 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:07.493530 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:07.493530 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:07.493530 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:07.493530 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:07.493530 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:07.493530 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:07.493530 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:07.493530 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:07.493530 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:07.493530 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:07.493530 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:07.493530 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:07.494506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:07.494506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:07.494506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:07.494506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:07.494506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:07.494506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:07.494506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:07.494506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:07.494506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:07.494506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:07.494506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:07.494506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:07.494506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:07.494506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:07.494506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:07.494506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:07.494506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:07.495429 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:07.495429 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:07.495429 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:07.495429 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:07.497536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 307/611] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:10:07.505322 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f7c81-2099-43d6-9ae0-8a5dd90ce950 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:07.508304 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57677eb6-4a11-440b-a9f7-409c1f498ac4 None admin] RBAC: Authorizing `identity:create_grant(project_id=634c9a1745ef44c0ad66e02493d79af0, user_id=5fd5768a512c4177abae05f4ccd5c59f, role_id=c9ec7276464a4d87ab2b6fc52a3bfeae)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:07.510538 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57677eb6-4a11-440b-a9f7-409c1f498ac4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:07.529507 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 305/612] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jun 4 08:10:07 2022] PUT /identity/v3/projects/634c9a1745ef44c0ad66e02493d79af0/users/5fd5768a512c4177abae05f4ccd5c59f/roles/c9ec7276464a4d87ab2b6fc52a3bfeae => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:10:07.652340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f7c81-2099-43d6-9ae0-8a5dd90ce950 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:07.692486 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea73e0-c755-4ddb-a652-13b64ee54ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:07.693426 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea73e0-c755-4ddb-a652-13b64ee54ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:07.693894 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea73e0-c755-4ddb-a652-13b64ee54ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:07.694362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea73e0-c755-4ddb-a652-13b64ee54ad7 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:07.697613 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea73e0-c755-4ddb-a652-13b64ee54ad7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:07.697613 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea73e0-c755-4ddb-a652-13b64ee54ad7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:07.697613 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea73e0-c755-4ddb-a652-13b64ee54ad7 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:07.710991 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 308/613] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:07.716571 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57677eb6-4a11-440b-a9f7-409c1f498ac4 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:07.873717 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57677eb6-4a11-440b-a9f7-409c1f498ac4 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:07.944757 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf5393-4999-4246-873e-fc4ae5ca75b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:07.945486 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf5393-4999-4246-873e-fc4ae5ca75b7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:07.945770 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf5393-4999-4246-873e-fc4ae5ca75b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:07.946073 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf5393-4999-4246-873e-fc4ae5ca75b7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:07.959310 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf5393-4999-4246-873e-fc4ae5ca75b7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:07.960772 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf5393-4999-4246-873e-fc4ae5ca75b7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:07.976548 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-f6cf5393-4999-4246-873e-fc4ae5ca75b7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 04 08:10:07.976548 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:07.976548 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:07.976548 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:07.976548 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:07.976548 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:07.976548 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:07.976548 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:07.976548 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:07.976548 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:07.976548 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:07.976548 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:07.976548 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:10:07.976548 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:10:07.976548 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:10:07.976548 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:10:07.977552 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:07.977552 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:07.977552 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:10:07.977552 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:07.977552 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:10:07.977552 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:07.977552 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:07.977552 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:07.977552 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:07.977552 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:07.977552 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:07.977552 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:07.977552 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:07.977552 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:07.977552 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:07.977552 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:07.977552 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:07.977552 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:07.978523 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:07.978523 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:07.978523 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:10:07.978523 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:10:07.978523 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:10:07.978523 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:10:07.978523 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:10:07.978523 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:10:07.978523 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 04 08:10:07.978523 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:07.978523 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 306/614] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:10:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:07.985426 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea73e0-c755-4ddb-a652-13b64ee54ad7 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:08.022505 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcaf4c-ecb5-4eef-86b3-07b8cc54d516 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:08.022890 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcaf4c-ecb5-4eef-86b3-07b8cc54d516 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:08.023057 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcaf4c-ecb5-4eef-86b3-07b8cc54d516 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:08.024670 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 307/615] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:08.029897 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd0579-ed3e-4068-82ad-578ec93708c9 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:08.030186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd0579-ed3e-4068-82ad-578ec93708c9 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:08.030459 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd0579-ed3e-4068-82ad-578ec93708c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:08.052846 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:08.053159 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-1fcd0579-ed3e-4068-82ad-578ec93708c9 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:08.054508 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-1fcd0579-ed3e-4068-82ad-578ec93708c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:08.083179 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:08.124654 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea73e0-c755-4ddb-a652-13b64ee54ad7 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:08.173119 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 308/616] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:10:08.188829 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50fdcec-fa67-42b5-bde6-159599ab0397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:08.189505 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fdcec-fa67-42b5-bde6-159599ab0397 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:08.190393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fdcec-fa67-42b5-bde6-159599ab0397 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:08.190669 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fdcec-fa67-42b5-bde6-159599ab0397 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:08.191519 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50fdcec-fa67-42b5-bde6-159599ab0397 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:08.191827 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50fdcec-fa67-42b5-bde6-159599ab0397 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:08.193259 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50fdcec-fa67-42b5-bde6-159599ab0397 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:08.222233 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 309/617] 10.222.0.57 () {56 vars in 1135 bytes} [Sat Jun 4 08:10:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:08.227982 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd0579-ed3e-4068-82ad-578ec93708c9 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:08.238995 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50fdcec-fa67-42b5-bde6-159599ab0397 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:08.386300 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd0579-ed3e-4068-82ad-578ec93708c9 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:08.422006 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15471acd-52f9-49aa-8327-d4cdbedf0399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:08.422809 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15471acd-52f9-49aa-8327-d4cdbedf0399 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:08.423093 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15471acd-52f9-49aa-8327-d4cdbedf0399 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:08.423365 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15471acd-52f9-49aa-8327-d4cdbedf0399 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:08.434766 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15471acd-52f9-49aa-8327-d4cdbedf0399 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:08.436324 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15471acd-52f9-49aa-8327-d4cdbedf0399 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:08.437719 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50fdcec-fa67-42b5-bde6-159599ab0397 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:08.454131 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:08.455524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-15471acd-52f9-49aa-8327-d4cdbedf0399 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:08.455524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:08.455524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:08.455524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:08.455524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:08.455524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:08.455524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:08.455524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:08.455524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:08.455524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:08.455524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:08.455524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:08.455524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:08.455524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:08.455524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:08.456569 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:08.456569 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:08.456569 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:08.456569 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:08.456569 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:08.456569 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:08.456569 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:08.456569 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:08.456569 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:08.456569 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:08.456569 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:08.456569 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:08.456569 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:08.456569 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:08.456569 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:08.456569 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:08.456569 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:08.457877 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:08.457877 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:08.457877 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:08.457877 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:08.457877 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 309/618] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:08.463801 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15471acd-52f9-49aa-8327-d4cdbedf0399 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:08.494325 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:08.542551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b79536-5330-4800-a345-3da01a7f8e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:08.543367 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b79536-5330-4800-a345-3da01a7f8e0b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:08.543646 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b79536-5330-4800-a345-3da01a7f8e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:08.543902 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b79536-5330-4800-a345-3da01a7f8e0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:08.566884 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b79536-5330-4800-a345-3da01a7f8e0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:10:08.573609 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15471acd-52f9-49aa-8327-d4cdbedf0399 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:08.574976 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-50b79536-5330-4800-a345-3da01a7f8e0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:10:08.574976 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:08.574976 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:08.574976 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:08.574976 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:08.574976 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:08.574976 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:08.574976 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:08.574976 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:08.574976 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:08.574976 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:08.574976 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:08.574976 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:10:08.574976 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:10:08.574976 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:10:08.574976 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:10:08.576197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:10:08.576197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:10:08.576197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:10:08.576197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:10:08.576197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:08.576197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:08.576197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:08.576197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:08.576197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:08.576197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:08.576197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:08.576197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:08.576197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:08.576197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:08.576197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:08.576197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:08.577139 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:08.577139 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:08.577139 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:08.577139 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:08.577139 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:10:08.577139 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:10:08.577139 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:10:08.577139 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:10:08.577139 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:10:08.577139 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:10:08.577139 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:10:08.577139 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:08.577795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 310/619] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jun 4 08:10:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:08.581871 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693c4f3-85bd-46a0-8a4f-b5c6ef47f6e4 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:08.581871 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693c4f3-85bd-46a0-8a4f-b5c6ef47f6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:08.581871 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693c4f3-85bd-46a0-8a4f-b5c6ef47f6e4 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:08.581871 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 311/620] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:08.584191 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693c4f3-85bd-46a0-8a4f-b5c6ef47f6e4 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:08.619842 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e8ee1-8317-4540-8a01-56b86ea96eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:08.620816 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e8ee1-8317-4540-8a01-56b86ea96eec None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:08.621257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e8ee1-8317-4540-8a01-56b86ea96eec None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:08.621934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e8ee1-8317-4540-8a01-56b86ea96eec None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:08.622746 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e8ee1-8317-4540-8a01-56b86ea96eec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:08.623123 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e8ee1-8317-4540-8a01-56b86ea96eec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:08.624658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e8ee1-8317-4540-8a01-56b86ea96eec None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:08.637481 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 310/621] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:08.641973 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1081a-7c91-4531-be89-5cfc797de542 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:08.641973 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1081a-7c91-4531-be89-5cfc797de542 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:08.641973 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1081a-7c91-4531-be89-5cfc797de542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:08.662930 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-41f1081a-7c91-4531-be89-5cfc797de542 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:08.664619 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-41f1081a-7c91-4531-be89-5cfc797de542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:08.709243 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693c4f3-85bd-46a0-8a4f-b5c6ef47f6e4 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:08.751030 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c7268-fc69-4c66-abf7-c2ceef750233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:08.752037 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c7268-fc69-4c66-abf7-c2ceef750233 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:08.752566 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c7268-fc69-4c66-abf7-c2ceef750233 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:08.753050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c7268-fc69-4c66-abf7-c2ceef750233 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:08.754030 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c7268-fc69-4c66-abf7-c2ceef750233 None admin] RBAC: Adding query filter params (name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:08.754533 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c7268-fc69-4c66-abf7-c2ceef750233 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:08.756090 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c7268-fc69-4c66-abf7-c2ceef750233 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:08.758041 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 311/622] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:10:08.759437 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1081a-7c91-4531-be89-5cfc797de542 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:08.776012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 312/623] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jun 4 08:10:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:08.776189 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:08.782173 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c7268-fc69-4c66-abf7-c2ceef750233 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:08.822245 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:08.883568 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1081a-7c91-4531-be89-5cfc797de542 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:08.899099 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c7268-fc69-4c66-abf7-c2ceef750233 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:08.928986 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b3d2b-9611-4bc8-b712-0bdb68b300fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:08.930147 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b3d2b-9611-4bc8-b712-0bdb68b300fb None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:08.930643 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b3d2b-9611-4bc8-b712-0bdb68b300fb None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:08.931121 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b3d2b-9611-4bc8-b712-0bdb68b300fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:08.936529 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a39db-14e5-49b3-a009-48e37864206e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:08.937324 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a39db-14e5-49b3-a009-48e37864206e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:08.937618 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a39db-14e5-49b3-a009-48e37864206e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:08.937951 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a39db-14e5-49b3-a009-48e37864206e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:08.939228 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b3d2b-9611-4bc8-b712-0bdb68b300fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:08.940987 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b3d2b-9611-4bc8-b712-0bdb68b300fb None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:08.948661 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a39db-14e5-49b3-a009-48e37864206e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:08.950130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a39db-14e5-49b3-a009-48e37864206e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:08.956315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-ec5b3d2b-9611-4bc8-b712-0bdb68b300fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:08.956315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:08.956315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:08.956315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:08.956315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:08.956315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:08.956315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:08.956315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:08.956315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:08.956315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:08.956315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:08.956315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:08.956315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:10:08.956315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:10:08.956315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:10:08.957208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:10:08.957208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:08.957208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:08.957208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:08.957208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:08.957208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:08.957208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:08.957208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:08.957208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:08.957208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:08.957208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:08.957208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:08.957208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:08.957208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:08.957208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:08.957208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:08.957208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:08.958149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:10:08.958149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:10:08.958149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:10:08.958149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:10:08.958149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:10:08.958149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:10:08.958149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:08.958149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:08.964934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 312/624] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:10:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:08.965996 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b3d2b-9611-4bc8-b712-0bdb68b300fb None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:08.968878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-285a39db-14e5-49b3-a009-48e37864206e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:08.968878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:08.968878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:08.968878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:08.968878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:08.968878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:08.968878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:08.968878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:08.968878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:08.968878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:08.968878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:08.968878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:08.968878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:08.968878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:08.968878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:08.969751 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:08.969751 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:08.969751 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:08.969751 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:08.969751 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:08.969751 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:08.969751 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:08.969751 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:08.969751 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:08.969751 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:08.969751 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:08.969751 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:08.969751 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:08.969751 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:08.969751 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:08.969751 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:08.969751 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:08.970713 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:08.970713 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:08.970713 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:08.970713 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:08.975098 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 313/625] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:10:08.975900 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a39db-14e5-49b3-a009-48e37864206e None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:09.038603 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:09.064514 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:09.078097 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b3d2b-9611-4bc8-b712-0bdb68b300fb None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:09.083885 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a39db-14e5-49b3-a009-48e37864206e None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:09.117277 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d2652-5f17-4c44-b56c-bb83b853ee6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:09.119220 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d2652-5f17-4c44-b56c-bb83b853ee6f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:09.119650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d2652-5f17-4c44-b56c-bb83b853ee6f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:09.120103 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d2652-5f17-4c44-b56c-bb83b853ee6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:09.123044 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f381c-23f4-4622-8dc3-4e9958a7e7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:09.123902 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f381c-23f4-4622-8dc3-4e9958a7e7be None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:09.124300 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f381c-23f4-4622-8dc3-4e9958a7e7be None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:09.124677 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f381c-23f4-4622-8dc3-4e9958a7e7be None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:09.125566 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f381c-23f4-4622-8dc3-4e9958a7e7be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:09.126015 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f381c-23f4-4622-8dc3-4e9958a7e7be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:09.128106 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f381c-23f4-4622-8dc3-4e9958a7e7be None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:09.133512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d2652-5f17-4c44-b56c-bb83b853ee6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:10:09.145842 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 314/626] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:10:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:09.145842 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f381c-23f4-4622-8dc3-4e9958a7e7be None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:09.149296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-796d2652-5f17-4c44-b56c-bb83b853ee6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:10:09.149296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:09.149296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:09.149296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:09.149296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:09.149296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:09.149296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:09.149296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:09.149296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:09.149296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:09.149296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:09.149296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:09.149296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:10:09.149296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:10:09.149296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:10:09.149296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:10:09.150453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:10:09.150453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:10:09.150453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:10:09.150453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:10:09.150453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:09.150453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:09.150453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:09.150453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:09.150453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:09.150453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:09.150453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:09.150453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:09.150453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:09.150453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:09.150453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:09.150453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:09.151492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:09.151492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:09.151492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:09.151492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:09.151492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:10:09.151492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:10:09.151492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:10:09.151492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:10:09.151492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:10:09.151492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:10:09.151492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:10:09.151492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:09.154242 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 313/627] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jun 4 08:10:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:09.155530 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d2652-5f17-4c44-b56c-bb83b853ee6f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:09.292527 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d2652-5f17-4c44-b56c-bb83b853ee6f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:09.296311 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f381c-23f4-4622-8dc3-4e9958a7e7be None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:09.320887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:09.332124 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c71126-8c9e-46ab-99a9-83756ef5c6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:09.333286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c71126-8c9e-46ab-99a9-83756ef5c6bb None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:09.333806 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c71126-8c9e-46ab-99a9-83756ef5c6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:09.334315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c71126-8c9e-46ab-99a9-83756ef5c6bb None admin] PATH_INFO: `/v3/projects/634c9a1745ef44c0ad66e02493d79af0/users/05ea412cab4244c58a2670c66f5a311c/roles/c9ec7276464a4d87ab2b6fc52a3bfeae` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:09.342584 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df80d38-1361-45b5-9dee-be49edd1a8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:09.343753 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df80d38-1361-45b5-9dee-be49edd1a8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:09.344048 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df80d38-1361-45b5-9dee-be49edd1a8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:09.344331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df80d38-1361-45b5-9dee-be49edd1a8a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:09.345060 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df80d38-1361-45b5-9dee-be49edd1a8a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:09.345370 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df80d38-1361-45b5-9dee-be49edd1a8a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:09.347085 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df80d38-1361-45b5-9dee-be49edd1a8a6 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:09.351368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c71126-8c9e-46ab-99a9-83756ef5c6bb None admin] RBAC: Authorizing `identity:create_grant(project_id=634c9a1745ef44c0ad66e02493d79af0, user_id=05ea412cab4244c58a2670c66f5a311c, role_id=c9ec7276464a4d87ab2b6fc52a3bfeae)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:09.353030 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c71126-8c9e-46ab-99a9-83756ef5c6bb None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:09.362338 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 315/628] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:09.364294 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df80d38-1361-45b5-9dee-be49edd1a8a6 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:09.371994 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:09.374964 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 314/629] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jun 4 08:10:09 2022] PUT /identity/v3/projects/634c9a1745ef44c0ad66e02493d79af0/users/05ea412cab4244c58a2670c66f5a311c/roles/c9ec7276464a4d87ab2b6fc52a3bfeae => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:10:09.375962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c71126-8c9e-46ab-99a9-83756ef5c6bb None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:09.515743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c71126-8c9e-46ab-99a9-83756ef5c6bb None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:09.559476 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df80d38-1361-45b5-9dee-be49edd1a8a6 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:09.567312 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f7282-dec6-4933-8334-42290894ffe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:09.569131 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f7282-dec6-4933-8334-42290894ffe9 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:09.570171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f7282-dec6-4933-8334-42290894ffe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:09.570950 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f7282-dec6-4933-8334-42290894ffe9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:09.580675 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f7282-dec6-4933-8334-42290894ffe9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:09.582692 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f7282-dec6-4933-8334-42290894ffe9 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:09.599743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-497f7282-dec6-4933-8334-42290894ffe9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 08:10:09.599743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:09.599743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:09.599743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:09.599743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:09.599743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:09.599743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:09.599743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:09.599743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:09.599743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:09.599743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:09.599743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:09.599743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:10:09.599743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:10:09.599743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:10:09.599743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:10:09.600802 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:09.600802 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:09.600802 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:10:09.600802 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:09.600802 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:10:09.600802 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:09.600802 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:09.600802 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:09.600802 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:09.600802 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:09.600802 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:09.600802 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:09.600802 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:09.600802 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:09.600802 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:09.600802 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:09.600802 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:09.600802 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:09.601759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:09.601759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:09.601759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:10:09.601759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:10:09.601759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:10:09.601759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:10:09.601759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:10:09.601759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:10:09.601759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 08:10:09.601759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:09.604968 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 315/630] 10.222.0.57 () {56 vars in 1093 bytes} [Sat Jun 4 08:10:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:09.606755 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806cf37-8527-4bf4-a155-8eaffaf6f0a4 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:09.607269 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806cf37-8527-4bf4-a155-8eaffaf6f0a4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:09.607763 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806cf37-8527-4bf4-a155-8eaffaf6f0a4 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:09.613939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 316/631] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:09.613939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806cf37-8527-4bf4-a155-8eaffaf6f0a4 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:09.615465 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825f81e-d25c-41b6-b3fe-234fece2987a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:09.616209 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825f81e-d25c-41b6-b3fe-234fece2987a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:09.616498 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825f81e-d25c-41b6-b3fe-234fece2987a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:09.616777 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825f81e-d25c-41b6-b3fe-234fece2987a None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:09.617546 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825f81e-d25c-41b6-b3fe-234fece2987a None admin] RBAC: Adding query filter params (name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:09.617891 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825f81e-d25c-41b6-b3fe-234fece2987a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:09.620375 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825f81e-d25c-41b6-b3fe-234fece2987a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:09.631205 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 316/632] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jun 4 08:10:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:09.632536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4e832-ddaf-41d9-89bb-72d247563deb None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:09.632826 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4e832-ddaf-41d9-89bb-72d247563deb None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:09.633112 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4e832-ddaf-41d9-89bb-72d247563deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:09.654972 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-6eb4e832-ddaf-41d9-89bb-72d247563deb None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:09.656179 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-6eb4e832-ddaf-41d9-89bb-72d247563deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:09.657865 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:09.737932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806cf37-8527-4bf4-a155-8eaffaf6f0a4 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:09.740139 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:09.749889 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 317/633] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:10:09.751175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4e832-ddaf-41d9-89bb-72d247563deb None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:09.801207 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3010d-49fd-4777-9a48-fce6d76a0b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:09.801930 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3010d-49fd-4777-9a48-fce6d76a0b75 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:09.802207 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3010d-49fd-4777-9a48-fce6d76a0b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:09.802483 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3010d-49fd-4777-9a48-fce6d76a0b75 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:09.803689 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3010d-49fd-4777-9a48-fce6d76a0b75 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:09.803999 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3010d-49fd-4777-9a48-fce6d76a0b75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:09.805669 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3010d-49fd-4777-9a48-fce6d76a0b75 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:09.826534 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 317/634] 10.222.0.57 () {56 vars in 1133 bytes} [Sat Jun 4 08:10:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:09.827405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3010d-49fd-4777-9a48-fce6d76a0b75 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:09.875517 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4e832-ddaf-41d9-89bb-72d247563deb None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:09.946616 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23c924-88b5-4c87-8a8d-7deb207936fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:09.947536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23c924-88b5-4c87-8a8d-7deb207936fe None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:09.947971 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23c924-88b5-4c87-8a8d-7deb207936fe None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:09.948866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23c924-88b5-4c87-8a8d-7deb207936fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:09.969599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23c924-88b5-4c87-8a8d-7deb207936fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:09.969599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23c924-88b5-4c87-8a8d-7deb207936fe None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:09.980357 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:09.988942 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3010d-49fd-4777-9a48-fce6d76a0b75 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:10.001153 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-4b23c924-88b5-4c87-8a8d-7deb207936fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:10.001153 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:10.001153 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:10.001153 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:10.001153 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:10.001153 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:10.001153 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:10.001153 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:10.001153 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:10.001153 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:10.001153 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:10.001153 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:10.001153 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:10.001153 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:10.001153 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:10.002254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:10.002254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:10.002254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:10.002254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:10.002254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:10.002254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:10.002254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:10.002254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:10.002254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:10.002254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:10.002254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:10.002254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:10.002254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:10.002254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:10.002254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:10.002254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:10.002254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:10.003164 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:10.003164 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:10.003164 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:10.003164 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:10.006617 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 318/635] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:10.007791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23c924-88b5-4c87-8a8d-7deb207936fe None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:10.065611 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851549d7-f680-486f-9872-39d6a14da11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:10.066450 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851549d7-f680-486f-9872-39d6a14da11c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:10.066733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851549d7-f680-486f-9872-39d6a14da11c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:10.067007 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851549d7-f680-486f-9872-39d6a14da11c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:10.082263 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:10.089152 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851549d7-f680-486f-9872-39d6a14da11c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:10:10.100765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-851549d7-f680-486f-9872-39d6a14da11c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:10:10.100765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:10.100765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:10.100765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:10.100765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:10.100765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:10.100765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:10.100765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:10.100765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:10.100765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:10.100765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:10.100765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:10.100765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:10:10.100765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:10:10.100765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:10:10.100765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:10:10.101787 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:10:10.101787 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:10:10.101787 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:10:10.101787 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:10:10.101787 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:10.101787 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:10.101787 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:10.101787 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:10.101787 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:10.101787 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:10.101787 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:10.101787 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:10.101787 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:10.101787 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:10.101787 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:10.101787 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:10.102679 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:10.102679 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:10.102679 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:10.102679 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:10.102679 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:10:10.102679 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:10:10.102679 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:10:10.102679 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:10:10.102679 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:10:10.102679 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:10:10.102679 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:10:10.102679 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:10.108023 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 318/636] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jun 4 08:10:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:10.108898 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851549d7-f680-486f-9872-39d6a14da11c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:10.149680 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23c924-88b5-4c87-8a8d-7deb207936fe None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:10.200048 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b62e07-7912-4dc7-b83b-03c5e5010d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:10.202218 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b62e07-7912-4dc7-b83b-03c5e5010d10 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:10.202794 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b62e07-7912-4dc7-b83b-03c5e5010d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:10.203551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b62e07-7912-4dc7-b83b-03c5e5010d10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:10.293458 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851549d7-f680-486f-9872-39d6a14da11c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:10.320710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b62e07-7912-4dc7-b83b-03c5e5010d10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:10.322239 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b62e07-7912-4dc7-b83b-03c5e5010d10 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:10.342544 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed35fe-4950-4ffd-a9db-e93f28827043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:10.343136 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed35fe-4950-4ffd-a9db-e93f28827043 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:10.343423 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed35fe-4950-4ffd-a9db-e93f28827043 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:10.343700 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed35fe-4950-4ffd-a9db-e93f28827043 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:10.344426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed35fe-4950-4ffd-a9db-e93f28827043 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:10.344738 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed35fe-4950-4ffd-a9db-e93f28827043 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:10.346689 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed35fe-4950-4ffd-a9db-e93f28827043 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:10.361930 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 319/637] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:10.361930 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed35fe-4950-4ffd-a9db-e93f28827043 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:10.383166 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:10.404402 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:10.477855 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 319/638] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:10:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 08:10:10.478321 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d51667-25ff-4c0c-85bc-76ac07253b2d None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:10.478608 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d51667-25ff-4c0c-85bc-76ac07253b2d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:10.478890 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d51667-25ff-4c0c-85bc-76ac07253b2d None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:10.484368 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 320/639] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:10.485051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d51667-25ff-4c0c-85bc-76ac07253b2d None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:10.486773 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed35fe-4950-4ffd-a9db-e93f28827043 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:10.520355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6a595-9c5c-434c-87f7-a5ae69569774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:10.521010 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6a595-9c5c-434c-87f7-a5ae69569774 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:10.521289 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6a595-9c5c-434c-87f7-a5ae69569774 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:10.521556 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6a595-9c5c-434c-87f7-a5ae69569774 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:10.522315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6a595-9c5c-434c-87f7-a5ae69569774 None admin] RBAC: Adding query filter params (name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:10.522615 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6a595-9c5c-434c-87f7-a5ae69569774 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:10.523972 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6a595-9c5c-434c-87f7-a5ae69569774 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:10.531637 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 320/640] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jun 4 08:10:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:10.532411 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6a595-9c5c-434c-87f7-a5ae69569774 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:10.598357 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d51667-25ff-4c0c-85bc-76ac07253b2d None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:10.611243 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:10.637214 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6a595-9c5c-434c-87f7-a5ae69569774 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:10.638517 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa48d66-e0b5-42b8-a8e0-391c0553c2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:10.639748 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa48d66-e0b5-42b8-a8e0-391c0553c2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:10.640029 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa48d66-e0b5-42b8-a8e0-391c0553c2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:10.640303 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa48d66-e0b5-42b8-a8e0-391c0553c2b1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:10.649636 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa48d66-e0b5-42b8-a8e0-391c0553c2b1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:10.651135 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa48d66-e0b5-42b8-a8e0-391c0553c2b1 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:10.669790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-5fa48d66-e0b5-42b8-a8e0-391c0553c2b1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 04 08:10:10.669790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:10.669790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:10.669790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:10.669790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:10.669790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:10.669790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:10.669790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:10.669790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:10.669790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:10.669790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:10.669790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:10.669790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:10:10.669790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:10:10.669790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:10:10.669790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:10:10.670801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:10.670801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:10.670801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:10:10.670801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:10.670801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:10:10.670801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:10.670801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:10.670801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:10.670801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:10.670801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:10.670801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:10.670801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:10.670801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:10.670801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:10.670801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:10.670801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:10.670801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:10.670801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:10.671735 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:10.671735 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:10.671735 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:10:10.671735 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:10:10.671735 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:10:10.671735 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:10:10.671735 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:10:10.671735 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:10:10.671735 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 04 08:10:10.671735 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:10.671735 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 321/641] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:10:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:10.672349 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1260520-62a0-46ac-aff6-bc3b247fee9e None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:10.673054 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1260520-62a0-46ac-aff6-bc3b247fee9e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:10.673054 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1260520-62a0-46ac-aff6-bc3b247fee9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:10.681442 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64d50f-37ad-4f98-8aff-d33a9becdaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:10.682288 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64d50f-37ad-4f98-8aff-d33a9becdaf3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:10.682573 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64d50f-37ad-4f98-8aff-d33a9becdaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:10.682851 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64d50f-37ad-4f98-8aff-d33a9becdaf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:10.690396 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-e1260520-62a0-46ac-aff6-bc3b247fee9e None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:10.691626 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e1260520-62a0-46ac-aff6-bc3b247fee9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:10.693994 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:10.695128 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64d50f-37ad-4f98-8aff-d33a9becdaf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:10.696796 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64d50f-37ad-4f98-8aff-d33a9becdaf3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:10.715580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-3b64d50f-37ad-4f98-8aff-d33a9becdaf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:10.715580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:10.715580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:10.715580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:10.715580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:10.715580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:10.715580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:10.715580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:10.715580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:10.715580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:10.715580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:10.715580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:10.715580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:10.715580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:10.715580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:10.716781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:10.716781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:10.716781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:10.716781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:10.716781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:10.716781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:10.716781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:10.716781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:10.716781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:10.716781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:10.716781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:10.716781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:10.716781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:10.716781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:10.716781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:10.716781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:10.716781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:10.717962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:10.717962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:10.717962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:10.717962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:10.722985 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 321/642] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:10.722985 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64d50f-37ad-4f98-8aff-d33a9becdaf3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:10.773853 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 322/643] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:10:10.773853 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1260520-62a0-46ac-aff6-bc3b247fee9e None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:10.828592 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64d50f-37ad-4f98-8aff-d33a9becdaf3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:10.855716 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:10.865484 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa175b5-99c2-4c1b-927e-f885ff37fdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:10.866516 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa175b5-99c2-4c1b-927e-f885ff37fdf3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:10.866949 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa175b5-99c2-4c1b-927e-f885ff37fdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:10.867390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa175b5-99c2-4c1b-927e-f885ff37fdf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:10.878896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa175b5-99c2-4c1b-927e-f885ff37fdf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:10.880354 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa175b5-99c2-4c1b-927e-f885ff37fdf3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:10.889851 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1260520-62a0-46ac-aff6-bc3b247fee9e None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:10.898772 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-7aa175b5-99c2-4c1b-927e-f885ff37fdf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:10.898772 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:10.898772 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:10.898772 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:10.898772 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:10.898772 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:10.898772 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:10.898772 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:10.898772 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:10.898772 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:10.898772 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:10.898772 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:10.898772 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:10.898772 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:10.898772 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:10.899674 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:10.899674 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:10.899674 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:10.899674 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:10.899674 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:10.899674 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:10.899674 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:10.899674 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:10.899674 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:10.899674 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:10.899674 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:10.899674 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:10.899674 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:10.899674 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:10.899674 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:10.899674 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:10.899674 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:10.900655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:10.900655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:10.900655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:10.900655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:10.900655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 322/644] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:10.901024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa175b5-99c2-4c1b-927e-f885ff37fdf3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:10.936302 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb8534-a49d-4d6e-8bea-867206260824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:10.937192 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb8534-a49d-4d6e-8bea-867206260824 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:10.937521 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb8534-a49d-4d6e-8bea-867206260824 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:10.937739 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb8534-a49d-4d6e-8bea-867206260824 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:10.938596 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb8534-a49d-4d6e-8bea-867206260824 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:10.938902 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb8534-a49d-4d6e-8bea-867206260824 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:10.940346 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb8534-a49d-4d6e-8bea-867206260824 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:10.948201 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:10.964321 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 323/645] 10.222.0.57 () {56 vars in 1137 bytes} [Sat Jun 4 08:10:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:10.964321 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb8534-a49d-4d6e-8bea-867206260824 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:11.018553 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa175b5-99c2-4c1b-927e-f885ff37fdf3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:11.052927 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afb875-ffb4-4142-98e7-3c586455bfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:11.053867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afb875-ffb4-4142-98e7-3c586455bfb4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:11.054157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afb875-ffb4-4142-98e7-3c586455bfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:11.054434 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afb875-ffb4-4142-98e7-3c586455bfb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:11.055150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afb875-ffb4-4142-98e7-3c586455bfb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:11.055455 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afb875-ffb4-4142-98e7-3c586455bfb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:11.056832 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afb875-ffb4-4142-98e7-3c586455bfb4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:11.072744 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 323/646] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:11.072898 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb8534-a49d-4d6e-8bea-867206260824 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:11.072982 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afb875-ffb4-4142-98e7-3c586455bfb4 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:11.109147 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0a9ea-906a-4c10-8bc1-2364f061b79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:11.109900 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0a9ea-906a-4c10-8bc1-2364f061b79c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:11.110191 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0a9ea-906a-4c10-8bc1-2364f061b79c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:11.110469 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0a9ea-906a-4c10-8bc1-2364f061b79c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:11.114699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:11.121072 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0a9ea-906a-4c10-8bc1-2364f061b79c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:10:11.129343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-a2f0a9ea-906a-4c10-8bc1-2364f061b79c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:10:11.129343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:11.129343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:11.129343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:11.129343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:11.129343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:11.129343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:11.129343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:11.129343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:11.129343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:11.129343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:11.129343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:11.129343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:10:11.129343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:10:11.129343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:10:11.129343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:10:11.130360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:10:11.130360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:10:11.130360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:10:11.130360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:10:11.130360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:11.130360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:11.130360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:11.130360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:11.130360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:11.130360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:11.130360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:11.130360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:11.130360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:11.130360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:11.130360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:11.130360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:11.131232 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:11.131232 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:11.131232 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:11.131232 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:11.131232 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:10:11.131232 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:10:11.131232 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:10:11.131232 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:10:11.131232 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:10:11.131232 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:10:11.131232 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:10:11.131232 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:11.131232 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 324/647] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jun 4 08:10:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:11.131944 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0a9ea-906a-4c10-8bc1-2364f061b79c None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:11.182669 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afb875-ffb4-4142-98e7-3c586455bfb4 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:11.199720 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:11.219676 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b56e77-2784-4350-8b62-6cecfc3be6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:11.220347 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b56e77-2784-4350-8b62-6cecfc3be6dc None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:11.220634 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b56e77-2784-4350-8b62-6cecfc3be6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:11.221477 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b56e77-2784-4350-8b62-6cecfc3be6dc None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:11.222244 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b56e77-2784-4350-8b62-6cecfc3be6dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:11.222790 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b56e77-2784-4350-8b62-6cecfc3be6dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:11.223923 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b56e77-2784-4350-8b62-6cecfc3be6dc None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:11.235956 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 324/648] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:11.237109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b56e77-2784-4350-8b62-6cecfc3be6dc None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:11.253445 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0a9ea-906a-4c10-8bc1-2364f061b79c None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:11.288060 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207e428-d314-4b79-8c54-449def4abd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:11.288705 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207e428-d314-4b79-8c54-449def4abd50 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:11.288983 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207e428-d314-4b79-8c54-449def4abd50 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:11.289257 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207e428-d314-4b79-8c54-449def4abd50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:11.344467 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:11.348227 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b56e77-2784-4350-8b62-6cecfc3be6dc None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:11.359113 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207e428-d314-4b79-8c54-449def4abd50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:11.360608 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207e428-d314-4b79-8c54-449def4abd50 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:11.390893 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4269f6-0be6-4d48-938e-a5fd9b76dac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:11.392191 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4269f6-0be6-4d48-938e-a5fd9b76dac6 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:11.392629 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4269f6-0be6-4d48-938e-a5fd9b76dac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:11.393079 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4269f6-0be6-4d48-938e-a5fd9b76dac6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:11.402334 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4269f6-0be6-4d48-938e-a5fd9b76dac6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:11.404420 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4269f6-0be6-4d48-938e-a5fd9b76dac6 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:11.415219 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:11.424957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-3a4269f6-0be6-4d48-938e-a5fd9b76dac6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:11.424957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:11.424957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:11.424957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:11.424957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:11.424957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:11.424957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:11.424957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:11.424957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:11.424957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:11.424957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:11.424957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:11.424957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:10:11.424957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:10:11.424957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:10:11.426021 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:10:11.426021 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:11.426021 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:11.426021 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:11.426021 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:11.426021 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:11.426021 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:11.426021 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:11.426021 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:11.426021 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:11.426021 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:11.426021 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:11.426021 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:11.426021 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:11.426021 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:11.426021 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:11.426021 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:11.426973 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:10:11.426973 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:10:11.426973 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:10:11.426973 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:10:11.426973 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:10:11.426973 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:10:11.426973 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:11.426973 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:11.428163 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 325/649] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:10:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:11.429564 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4269f6-0be6-4d48-938e-a5fd9b76dac6 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:11.470181 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 325/650] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:10:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 08:10:11.471867 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207e428-d314-4b79-8c54-449def4abd50 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:11.555999 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4269f6-0be6-4d48-938e-a5fd9b76dac6 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:11.577784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207e428-d314-4b79-8c54-449def4abd50 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:11.591904 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a23eb-8eee-452f-9158-56a858a54471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:11.592574 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a23eb-8eee-452f-9158-56a858a54471 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:11.592859 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a23eb-8eee-452f-9158-56a858a54471 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:11.593137 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a23eb-8eee-452f-9158-56a858a54471 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:11.593912 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a23eb-8eee-452f-9158-56a858a54471 None admin] RBAC: Adding query filter params (name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:11.594225 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a23eb-8eee-452f-9158-56a858a54471 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:11.595590 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a23eb-8eee-452f-9158-56a858a54471 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:11.607906 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 326/651] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jun 4 08:10:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:11.607906 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a23eb-8eee-452f-9158-56a858a54471 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:11.620143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa335fe-3fda-422b-bb1f-9b97efc7c1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:11.620870 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa335fe-3fda-422b-bb1f-9b97efc7c1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:11.621150 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa335fe-3fda-422b-bb1f-9b97efc7c1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:11.621437 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa335fe-3fda-422b-bb1f-9b97efc7c1a4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:11.629221 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa335fe-3fda-422b-bb1f-9b97efc7c1a4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:11.630695 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa335fe-3fda-422b-bb1f-9b97efc7c1a4 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:11.632715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:11.647748 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-3aa335fe-3fda-422b-bb1f-9b97efc7c1a4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 04 08:10:11.647748 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:11.647748 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:11.647748 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:11.647748 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:11.647748 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:11.647748 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:11.647748 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:11.647748 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:11.647748 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:11.647748 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:11.647748 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:11.647748 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:10:11.647748 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:10:11.647748 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:10:11.647748 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:10:11.648774 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:11.648774 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:11.648774 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:10:11.648774 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:11.648774 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:10:11.648774 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:11.648774 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:11.648774 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:11.648774 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:11.648774 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:11.648774 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:11.648774 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:11.648774 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:11.648774 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:11.648774 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:11.648774 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:11.648774 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:11.648774 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:11.649763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:11.649763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:11.649763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:10:11.649763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:10:11.649763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:10:11.649763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:10:11.649763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:10:11.649763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:10:11.649763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 04 08:10:11.649763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:11.653377 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 326/652] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:10:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:11.654150 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa335fe-3fda-422b-bb1f-9b97efc7c1a4 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:11.672029 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:11.717444 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a23eb-8eee-452f-9158-56a858a54471 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:11.752908 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc93e59-e329-496e-be5d-df24bdc50364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:11.753574 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc93e59-e329-496e-be5d-df24bdc50364 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:11.753973 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc93e59-e329-496e-be5d-df24bdc50364 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:11.754166 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc93e59-e329-496e-be5d-df24bdc50364 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:11.754953 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc93e59-e329-496e-be5d-df24bdc50364 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:11.755267 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc93e59-e329-496e-be5d-df24bdc50364 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:11.756715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc93e59-e329-496e-be5d-df24bdc50364 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:11.761372 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa335fe-3fda-422b-bb1f-9b97efc7c1a4 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:11.769086 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 327/653] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:10:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:11.769928 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc93e59-e329-496e-be5d-df24bdc50364 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:11.800822 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e43d0-e202-4529-b02d-d1a0a851d958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:11.801602 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e43d0-e202-4529-b02d-d1a0a851d958 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:11.801913 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e43d0-e202-4529-b02d-d1a0a851d958 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:11.802184 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e43d0-e202-4529-b02d-d1a0a851d958 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:11.812194 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4e43d0-e202-4529-b02d-d1a0a851d958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:11.813631 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4e43d0-e202-4529-b02d-d1a0a851d958 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:11.831344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-1a4e43d0-e202-4529-b02d-d1a0a851d958 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:11.831344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:11.831344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:11.831344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:11.831344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:11.831344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:11.831344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:11.831344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:11.831344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:11.831344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:11.831344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:11.831344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:11.831344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:11.831344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:11.831344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:11.832422 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:11.832422 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:11.832422 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:11.832422 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:11.832422 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:11.832422 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:11.832422 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:11.832422 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:11.832422 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:11.832422 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:11.832422 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:11.832422 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:11.832422 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:11.832422 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:11.832422 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:11.832422 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:11.832422 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:11.833574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:11.833574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:11.833574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:11.833574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:11.833574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 327/654] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:11.833574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e43d0-e202-4529-b02d-d1a0a851d958 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:11.853299 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:11.871372 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc93e59-e329-496e-be5d-df24bdc50364 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:11.898579 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:11.904774 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b495b2-b7f1-4a39-9d91-88f3034542b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:11.905564 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b495b2-b7f1-4a39-9d91-88f3034542b9 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:11.905871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b495b2-b7f1-4a39-9d91-88f3034542b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:11.906152 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b495b2-b7f1-4a39-9d91-88f3034542b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:11.918484 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b495b2-b7f1-4a39-9d91-88f3034542b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:11.919944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b495b2-b7f1-4a39-9d91-88f3034542b9 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:11.932382 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e43d0-e202-4529-b02d-d1a0a851d958 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:11.938197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-18b495b2-b7f1-4a39-9d91-88f3034542b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:11.938197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:11.938197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:11.938197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:11.938197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:11.938197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:11.938197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:11.938197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:11.938197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:11.938197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:11.938197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:11.938197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:11.938197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:11.938197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:11.938197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:11.939279 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:11.939279 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:11.939279 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:11.939279 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:11.939279 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:11.939279 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:11.939279 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:11.939279 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:11.939279 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:11.939279 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:11.939279 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:11.939279 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:11.939279 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:11.939279 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:11.939279 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:11.939279 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:11.939279 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:11.940822 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:11.940822 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:11.940822 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:11.940822 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:11.940822 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 328/655] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:11.941243 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83ebc2-9706-4bb2-b497-55c2c4048565 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:11.941524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83ebc2-9706-4bb2-b497-55c2c4048565 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:11.941794 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83ebc2-9706-4bb2-b497-55c2c4048565 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:11.943210 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 329/656] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:11.943800 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83ebc2-9706-4bb2-b497-55c2c4048565 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:11.972131 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1f6a3-a7b2-4504-8642-500c4f9bb572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:11.972803 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1f6a3-a7b2-4504-8642-500c4f9bb572 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:11.973091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1f6a3-a7b2-4504-8642-500c4f9bb572 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:11.973371 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1f6a3-a7b2-4504-8642-500c4f9bb572 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:11.974251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1f6a3-a7b2-4504-8642-500c4f9bb572 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:11.974563 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1f6a3-a7b2-4504-8642-500c4f9bb572 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:11.975990 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1f6a3-a7b2-4504-8642-500c4f9bb572 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:11.993149 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 328/657] 10.222.0.57 () {56 vars in 1137 bytes} [Sat Jun 4 08:10:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:11.993989 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1f6a3-a7b2-4504-8642-500c4f9bb572 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:12.048576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83ebc2-9706-4bb2-b497-55c2c4048565 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:12.085550 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061f20e-248c-44f9-a157-e4d0ee26ab67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:12.086235 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061f20e-248c-44f9-a157-e4d0ee26ab67 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:12.086521 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061f20e-248c-44f9-a157-e4d0ee26ab67 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:12.086796 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061f20e-248c-44f9-a157-e4d0ee26ab67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:12.087615 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061f20e-248c-44f9-a157-e4d0ee26ab67 None admin] RBAC: Adding query filter params (role.id=c9ec7276464a4d87ab2b6fc52a3bfeae, scope.project.id=634c9a1745ef44c0ad66e02493d79af0, user.id=7e64d002241242928936dd0d991ecdc1) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:12.087929 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061f20e-248c-44f9-a157-e4d0ee26ab67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:12.089357 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061f20e-248c-44f9-a157-e4d0ee26ab67 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:12.091181 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:12.094716 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1f6a3-a7b2-4504-8642-500c4f9bb572 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:12.098127 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 330/658] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:10:11 2022] GET /identity/v3/role_assignments?user.id=7e64d002241242928936dd0d991ecdc1&scope.project.id=634c9a1745ef44c0ad66e02493d79af0&role.id=c9ec7276464a4d87ab2b6fc52a3bfeae => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:12.098795 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061f20e-248c-44f9-a157-e4d0ee26ab67 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:12.125708 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:12.137596 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec18d3e-c377-44da-b8f5-4bfa5df16999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:12.138904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec18d3e-c377-44da-b8f5-4bfa5df16999 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:12.138904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec18d3e-c377-44da-b8f5-4bfa5df16999 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:12.138904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec18d3e-c377-44da-b8f5-4bfa5df16999 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:12.139589 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec18d3e-c377-44da-b8f5-4bfa5df16999 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:12.139898 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec18d3e-c377-44da-b8f5-4bfa5df16999 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:12.141317 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec18d3e-c377-44da-b8f5-4bfa5df16999 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:12.159766 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 329/659] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:12.159766 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f27784-d302-4197-83f9-e4a986bd7f69 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:12.159766 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f27784-d302-4197-83f9-e4a986bd7f69 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:12.159766 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f27784-d302-4197-83f9-e4a986bd7f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:12.176759 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-25f27784-d302-4197-83f9-e4a986bd7f69 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:12.178031 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-25f27784-d302-4197-83f9-e4a986bd7f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:12.220657 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061f20e-248c-44f9-a157-e4d0ee26ab67 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:12.254740 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 330/660] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:10:12.255613 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f27784-d302-4197-83f9-e4a986bd7f69 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:12.270206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670f62a-b1f3-4c3c-88f3-08dbfa4636a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:12.271200 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670f62a-b1f3-4c3c-88f3-08dbfa4636a2 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:12.272071 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670f62a-b1f3-4c3c-88f3-08dbfa4636a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:12.272532 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670f62a-b1f3-4c3c-88f3-08dbfa4636a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:12.273789 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9670f62a-b1f3-4c3c-88f3-08dbfa4636a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:12.274638 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9670f62a-b1f3-4c3c-88f3-08dbfa4636a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:12.276408 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9670f62a-b1f3-4c3c-88f3-08dbfa4636a2 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:12.295533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 331/661] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:12.296568 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670f62a-b1f3-4c3c-88f3-08dbfa4636a2 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:12.370555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:12.381470 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f27784-d302-4197-83f9-e4a986bd7f69 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:12.400245 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:12.415887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670f62a-b1f3-4c3c-88f3-08dbfa4636a2 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:12.419304 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f053b-ced4-495f-9ed6-c8760ec3697d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:12.419950 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f053b-ced4-495f-9ed6-c8760ec3697d None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:12.420235 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f053b-ced4-495f-9ed6-c8760ec3697d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:12.420514 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f053b-ced4-495f-9ed6-c8760ec3697d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:12.453567 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58085e47-cfbd-4b3d-bf54-bb0ec8adffa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:12.454393 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58085e47-cfbd-4b3d-bf54-bb0ec8adffa7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:12.454676 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58085e47-cfbd-4b3d-bf54-bb0ec8adffa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:12.454950 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58085e47-cfbd-4b3d-bf54-bb0ec8adffa7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:12.463113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58085e47-cfbd-4b3d-bf54-bb0ec8adffa7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:12.464576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58085e47-cfbd-4b3d-bf54-bb0ec8adffa7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:12.478251 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-58085e47-cfbd-4b3d-bf54-bb0ec8adffa7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:12.478251 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:12.478251 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:12.478251 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:12.478251 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:12.478251 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:12.478251 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:12.478251 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:12.478251 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:12.478251 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:12.478251 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:12.478251 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:12.478251 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:10:12.478251 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:10:12.478251 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:10:12.479344 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:10:12.479344 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:12.479344 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:12.479344 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:12.479344 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:12.479344 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:12.479344 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:12.479344 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:12.479344 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:12.479344 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:12.479344 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:12.479344 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:12.479344 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:12.479344 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:12.479344 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:12.479344 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:12.479344 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:12.480269 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:10:12.480269 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:10:12.480269 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:10:12.480269 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:10:12.480269 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:10:12.480269 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:10:12.480269 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:12.480269 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:12.480269 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 332/662] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:10:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:12.480269 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58085e47-cfbd-4b3d-bf54-bb0ec8adffa7 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:12.498847 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f053b-ced4-495f-9ed6-c8760ec3697d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:12.500419 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f053b-ced4-495f-9ed6-c8760ec3697d None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:12.584423 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58085e47-cfbd-4b3d-bf54-bb0ec8adffa7 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:12.602657 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:12.613352 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 331/663] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:10:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 08:10:12.613352 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f053b-ced4-495f-9ed6-c8760ec3697d None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:12.629492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0d05e-8a0e-427b-9b5b-591b1afd01dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:12.630118 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:12.630566 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0d05e-8a0e-427b-9b5b-591b1afd01dc None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:12.630914 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0d05e-8a0e-427b-9b5b-591b1afd01dc None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:12.631249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0d05e-8a0e-427b-9b5b-591b1afd01dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:12.642577 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0d05e-8a0e-427b-9b5b-591b1afd01dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:10:12.650576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-6ef0d05e-8a0e-427b-9b5b-591b1afd01dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:10:12.650576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:12.650576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:12.650576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:12.650576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:12.650576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:12.650576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:12.650576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:12.650576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:12.650576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:12.650576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:12.650576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:12.650576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:10:12.650576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:10:12.650576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:10:12.650576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:10:12.651504 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:10:12.651504 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:10:12.651504 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:10:12.651504 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:10:12.651504 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:12.651504 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:12.651504 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:12.651504 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:12.651504 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:12.651504 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:12.651504 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:12.651504 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:12.651504 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:12.651504 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:12.651504 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:12.651504 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:12.657325 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:12.657325 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:12.657325 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:12.657325 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:12.657325 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:10:12.657325 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:10:12.657325 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:10:12.657325 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:10:12.657325 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:10:12.657325 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:10:12.657325 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:10:12.657325 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:12.657325 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 333/664] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jun 4 08:10:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:12.657325 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0d05e-8a0e-427b-9b5b-591b1afd01dc None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:12.722936 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f053b-ced4-495f-9ed6-c8760ec3697d None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:12.759702 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789dcc71-8fca-4436-b5dc-f38f344ed7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:12.760501 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dcc71-8fca-4436-b5dc-f38f344ed7ef None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:12.760787 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dcc71-8fca-4436-b5dc-f38f344ed7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:12.761064 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dcc71-8fca-4436-b5dc-f38f344ed7ef None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:12.764242 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0d05e-8a0e-427b-9b5b-591b1afd01dc None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:12.768183 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789dcc71-8fca-4436-b5dc-f38f344ed7ef None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:12.769625 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789dcc71-8fca-4436-b5dc-f38f344ed7ef None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:12.784285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-789dcc71-8fca-4436-b5dc-f38f344ed7ef None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 04 08:10:12.784285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:12.784285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:12.784285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:12.784285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:12.784285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:12.784285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:12.784285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:12.784285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:12.784285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:12.784285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:12.784285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:12.784285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:10:12.784285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:10:12.784285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:10:12.784285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:10:12.785234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:12.785234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:12.785234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:10:12.785234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:12.785234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:10:12.785234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:12.785234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:12.785234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:12.785234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:12.785234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:12.785234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:12.785234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:12.785234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:12.785234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:12.785234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:12.785234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:12.785234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:12.785234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:12.786891 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:12.786891 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:12.786891 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:10:12.786891 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:10:12.786891 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:10:12.786891 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:10:12.786891 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:10:12.786891 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:10:12.786891 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 04 08:10:12.786891 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:12.786891 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 332/665] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jun 4 08:10:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:12.786891 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789dcc71-8fca-4436-b5dc-f38f344ed7ef None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:12.801796 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776ec8e-8dc1-4295-a867-c8e08c6c7446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:12.802547 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776ec8e-8dc1-4295-a867-c8e08c6c7446 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:12.802830 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776ec8e-8dc1-4295-a867-c8e08c6c7446 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:12.803133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776ec8e-8dc1-4295-a867-c8e08c6c7446 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:12.804168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f776ec8e-8dc1-4295-a867-c8e08c6c7446 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:12.804475 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f776ec8e-8dc1-4295-a867-c8e08c6c7446 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:12.805934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f776ec8e-8dc1-4295-a867-c8e08c6c7446 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:12.825318 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 334/666] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:10:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:12.825318 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776ec8e-8dc1-4295-a867-c8e08c6c7446 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:12.867992 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:12.880680 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:12.905330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789dcc71-8fca-4436-b5dc-f38f344ed7ef None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:12.943651 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85a7f7-16ec-4631-8737-e7d2cfad511b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:12.944442 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85a7f7-16ec-4631-8737-e7d2cfad511b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:12.944724 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85a7f7-16ec-4631-8737-e7d2cfad511b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:12.945001 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85a7f7-16ec-4631-8737-e7d2cfad511b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:12.945105 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776ec8e-8dc1-4295-a867-c8e08c6c7446 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:12.955890 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85a7f7-16ec-4631-8737-e7d2cfad511b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:12.962306 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85a7f7-16ec-4631-8737-e7d2cfad511b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:12.985585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-cb85a7f7-16ec-4631-8737-e7d2cfad511b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:12.985585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:12.985585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:12.985585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:12.985585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:12.985585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:12.985585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:12.985585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:12.985585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:12.985585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:12.985585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:12.985585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:12.985585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:12.985585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:12.985585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:12.988704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:12.988704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:12.988704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:12.988704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:12.988704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:12.988704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:12.988704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:12.988704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:12.988704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:12.988704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:12.988704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:12.988704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:12.988704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:12.988704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:12.988704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:12.988704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:12.988704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:12.990881 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:12.990881 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:12.990881 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:12.990881 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:12.991398 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55736825-f908-4f1f-b2d4-458e3d4ba567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:12.991922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 333/667] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:12.991922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85a7f7-16ec-4631-8737-e7d2cfad511b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:12.992220 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55736825-f908-4f1f-b2d4-458e3d4ba567 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:12.992370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55736825-f908-4f1f-b2d4-458e3d4ba567 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:12.992539 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55736825-f908-4f1f-b2d4-458e3d4ba567 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:12.993311 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55736825-f908-4f1f-b2d4-458e3d4ba567 None admin] RBAC: Adding query filter params (name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:12.993616 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55736825-f908-4f1f-b2d4-458e3d4ba567 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:12.995032 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55736825-f908-4f1f-b2d4-458e3d4ba567 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:13.009333 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 335/668] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jun 4 08:10:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:13.009333 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55736825-f908-4f1f-b2d4-458e3d4ba567 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:13.099762 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85a7f7-16ec-4631-8737-e7d2cfad511b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:13.107422 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:13.111070 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55736825-f908-4f1f-b2d4-458e3d4ba567 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:13.128497 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:13.136801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bde70b-216a-4a98-8184-2997bca2ca21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:13.137586 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bde70b-216a-4a98-8184-2997bca2ca21 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:13.138004 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bde70b-216a-4a98-8184-2997bca2ca21 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:13.138346 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bde70b-216a-4a98-8184-2997bca2ca21 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:13.139252 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bde70b-216a-4a98-8184-2997bca2ca21 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:13.139639 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bde70b-216a-4a98-8184-2997bca2ca21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:13.141161 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bde70b-216a-4a98-8184-2997bca2ca21 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:13.148156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff9185-22b7-4f1e-a6ae-963a6d77e1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:13.148815 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff9185-22b7-4f1e-a6ae-963a6d77e1be None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:13.149171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff9185-22b7-4f1e-a6ae-963a6d77e1be None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:13.149519 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff9185-22b7-4f1e-a6ae-963a6d77e1be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:13.150490 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff9185-22b7-4f1e-a6ae-963a6d77e1be None admin] RBAC: Adding query filter params (role.id=c9ec7276464a4d87ab2b6fc52a3bfeae, scope.project.id=634c9a1745ef44c0ad66e02493d79af0, user.id=3ab0603fbcd54121b543fbf2a44fecf0) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:13.150883 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff9185-22b7-4f1e-a6ae-963a6d77e1be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:13.152395 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff9185-22b7-4f1e-a6ae-963a6d77e1be None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:13.158898 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 336/669] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:10:13 2022] GET /identity/v3/role_assignments?user.id=3ab0603fbcd54121b543fbf2a44fecf0&scope.project.id=634c9a1745ef44c0ad66e02493d79af0&role.id=c9ec7276464a4d87ab2b6fc52a3bfeae => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:13.159614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff9185-22b7-4f1e-a6ae-963a6d77e1be None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:13.178168 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 334/670] 10.222.0.57 () {56 vars in 1139 bytes} [Sat Jun 4 08:10:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:13.179332 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bde70b-216a-4a98-8184-2997bca2ca21 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:13.291226 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff9185-22b7-4f1e-a6ae-963a6d77e1be None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:13.327583 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bde70b-216a-4a98-8184-2997bca2ca21 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:13.335987 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd93e03-53b6-413c-8ce6-cbd3b973cb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:13.336675 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd93e03-53b6-413c-8ce6-cbd3b973cb72 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:13.337018 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd93e03-53b6-413c-8ce6-cbd3b973cb72 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:13.337300 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd93e03-53b6-413c-8ce6-cbd3b973cb72 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:13.338117 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd93e03-53b6-413c-8ce6-cbd3b973cb72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:13.338437 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd93e03-53b6-413c-8ce6-cbd3b973cb72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:13.339988 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd93e03-53b6-413c-8ce6-cbd3b973cb72 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:13.359144 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 337/671] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:13.360273 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd93e03-53b6-413c-8ce6-cbd3b973cb72 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:13.371856 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee14fd-6ea7-49ea-9872-179b716654ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:13.373470 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee14fd-6ea7-49ea-9872-179b716654ae None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:13.374046 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee14fd-6ea7-49ea-9872-179b716654ae None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:13.374865 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee14fd-6ea7-49ea-9872-179b716654ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:13.389178 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee14fd-6ea7-49ea-9872-179b716654ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:13.391145 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee14fd-6ea7-49ea-9872-179b716654ae None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:13.392291 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:13.420833 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-b7ee14fd-6ea7-49ea-9872-179b716654ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:13.420833 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:13.420833 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:13.420833 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:13.420833 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:13.420833 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:13.420833 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:13.420833 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:13.420833 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:13.420833 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:13.420833 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:13.420833 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:13.420833 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:13.420833 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:13.420833 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:13.421783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:13.421783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:13.421783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:13.421783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:13.421783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:13.421783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:13.421783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:13.421783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:13.421783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:13.421783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:13.421783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:13.421783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:13.421783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:13.421783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:13.421783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:13.421783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:13.421783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:13.422736 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:13.422736 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:13.422736 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:13.422736 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:13.422736 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 335/672] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:13.422736 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee14fd-6ea7-49ea-9872-179b716654ae None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:13.480896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd93e03-53b6-413c-8ce6-cbd3b973cb72 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:13.486293 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:13.520273 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27e7c5-7ef9-4e31-8932-a787da9d6a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:13.521978 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27e7c5-7ef9-4e31-8932-a787da9d6a7f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:13.522739 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27e7c5-7ef9-4e31-8932-a787da9d6a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:13.523485 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27e7c5-7ef9-4e31-8932-a787da9d6a7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:13.544222 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee14fd-6ea7-49ea-9872-179b716654ae None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:13.579510 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1820c-0b22-4778-be4d-f5c26c1ca1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:13.580783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1820c-0b22-4778-be4d-f5c26c1ca1b4 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:13.581114 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1820c-0b22-4778-be4d-f5c26c1ca1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:13.581394 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1820c-0b22-4778-be4d-f5c26c1ca1b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:13.588382 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1820c-0b22-4778-be4d-f5c26c1ca1b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:13.589856 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1820c-0b22-4778-be4d-f5c26c1ca1b4 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:13.604564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-16b1820c-0b22-4778-be4d-f5c26c1ca1b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:13.604564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:13.604564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:13.604564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:13.604564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:13.604564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:13.604564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:13.604564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:13.604564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:13.604564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:13.604564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:13.604564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:13.604564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:10:13.604564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:10:13.604564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:10:13.605502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:10:13.605502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:13.605502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:13.605502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:13.605502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:13.605502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:13.605502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:13.605502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:13.605502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:13.605502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:13.605502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:13.605502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:13.605502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:13.605502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:13.605502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:13.605502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:13.605502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:13.606455 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:10:13.606455 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:10:13.606455 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:10:13.606455 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:10:13.606455 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:10:13.606455 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:10:13.606455 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:13.606455 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:13.610393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 336/673] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:10:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:13.611135 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27e7c5-7ef9-4e31-8932-a787da9d6a7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:13.611260 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1820c-0b22-4778-be4d-f5c26c1ca1b4 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:13.612960 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27e7c5-7ef9-4e31-8932-a787da9d6a7f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:13.658267 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:13.720259 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:13.724331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1820c-0b22-4778-be4d-f5c26c1ca1b4 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:13.742666 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 338/674] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:10:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 08:10:13.744199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27e7c5-7ef9-4e31-8932-a787da9d6a7f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:13.764102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862de3c-2633-4e8a-91e8-56e17050a5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:13.764884 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862de3c-2633-4e8a-91e8-56e17050a5d7 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:13.765089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862de3c-2633-4e8a-91e8-56e17050a5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:13.765357 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862de3c-2633-4e8a-91e8-56e17050a5d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:13.766127 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862de3c-2633-4e8a-91e8-56e17050a5d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:13.766434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862de3c-2633-4e8a-91e8-56e17050a5d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:13.768379 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862de3c-2633-4e8a-91e8-56e17050a5d7 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:13.782440 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 337/675] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:13.783629 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862de3c-2633-4e8a-91e8-56e17050a5d7 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:13.883486 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27e7c5-7ef9-4e31-8932-a787da9d6a7f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:13.904795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862de3c-2633-4e8a-91e8-56e17050a5d7 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:13.910600 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:13.932548 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad92d7e-ed8f-4109-b0f4-40b4e4caf75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:13.933779 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad92d7e-ed8f-4109-b0f4-40b4e4caf75f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:13.933779 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad92d7e-ed8f-4109-b0f4-40b4e4caf75f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:13.934171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad92d7e-ed8f-4109-b0f4-40b4e4caf75f None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:13.935067 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad92d7e-ed8f-4109-b0f4-40b4e4caf75f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:13.935481 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad92d7e-ed8f-4109-b0f4-40b4e4caf75f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:13.937124 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad92d7e-ed8f-4109-b0f4-40b4e4caf75f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:13.950583 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 339/676] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:10:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:13.951540 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad92d7e-ed8f-4109-b0f4-40b4e4caf75f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:13.952638 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e4724-6767-4a85-a67f-c4e82443eaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:13.953628 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e4724-6767-4a85-a67f-c4e82443eaa0 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:13.954111 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e4724-6767-4a85-a67f-c4e82443eaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:13.954981 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e4724-6767-4a85-a67f-c4e82443eaa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:13.968123 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e4724-6767-4a85-a67f-c4e82443eaa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:13.969769 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e4724-6767-4a85-a67f-c4e82443eaa0 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:13.989305 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-172e4724-6767-4a85-a67f-c4e82443eaa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:13.989305 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:13.989305 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:13.989305 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:13.989305 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:13.989305 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:13.989305 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:13.989305 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:13.989305 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:13.989305 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:13.989305 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:13.989305 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:13.989305 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:13.989305 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:13.989305 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:13.990351 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:13.990351 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:13.990351 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:13.990351 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:13.990351 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:13.990351 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:13.990351 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:13.990351 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:13.990351 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:13.990351 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:13.990351 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:13.990351 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:13.990351 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:13.990351 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:13.990351 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:13.990351 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:13.990351 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:13.991264 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:13.991264 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:13.991264 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:13.991264 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:13.995391 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 338/677] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:13.996231 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e4724-6767-4a85-a67f-c4e82443eaa0 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:14.009766 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:14.070517 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad92d7e-ed8f-4109-b0f4-40b4e4caf75f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:14.107126 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e4724-6767-4a85-a67f-c4e82443eaa0 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:14.108129 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c422b-c88c-4d9b-a0d2-63b250cf83e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:14.109246 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c422b-c88c-4d9b-a0d2-63b250cf83e6 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:14.109774 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c422b-c88c-4d9b-a0d2-63b250cf83e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:14.110306 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c422b-c88c-4d9b-a0d2-63b250cf83e6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:14.121659 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c422b-c88c-4d9b-a0d2-63b250cf83e6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:14.124348 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c422b-c88c-4d9b-a0d2-63b250cf83e6 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:14.140945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-ab4c422b-c88c-4d9b-a0d2-63b250cf83e6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 04 08:10:14.140945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:14.140945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:14.140945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:14.140945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:14.140945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:14.140945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:14.140945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:14.140945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:14.140945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:14.140945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:14.140945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:14.140945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:10:14.140945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:10:14.140945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:10:14.140945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:10:14.142024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:14.142024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:14.142024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:10:14.142024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:14.142024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:10:14.142024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:14.142024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:14.142024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:14.142024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:14.142024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:14.142024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:14.142024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:14.142024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:14.142024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:14.142024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:14.142024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:14.142024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:14.142024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:14.143071 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:14.143071 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:14.143071 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:10:14.143071 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:10:14.143071 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:10:14.143071 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:10:14.143071 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:10:14.143071 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:10:14.143071 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 04 08:10:14.143071 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:14.146072 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 340/678] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:10:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:14.147847 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c422b-c88c-4d9b-a0d2-63b250cf83e6 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:14.152297 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b8d8a-b7e2-49a6-a9e5-efe40d760ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:14.153020 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b8d8a-b7e2-49a6-a9e5-efe40d760ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:14.153309 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b8d8a-b7e2-49a6-a9e5-efe40d760ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:14.153583 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b8d8a-b7e2-49a6-a9e5-efe40d760ee4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:14.154805 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b8d8a-b7e2-49a6-a9e5-efe40d760ee4 None admin] RBAC: Adding query filter params (role.id=c9ec7276464a4d87ab2b6fc52a3bfeae, scope.project.id=634c9a1745ef44c0ad66e02493d79af0, user.id=5cd24a726e4e4ce687d150a3bdc5948f) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:14.154805 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b8d8a-b7e2-49a6-a9e5-efe40d760ee4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:14.156307 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b8d8a-b7e2-49a6-a9e5-efe40d760ee4 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:14.163100 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 339/679] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:10:13 2022] GET /identity/v3/role_assignments?user.id=5cd24a726e4e4ce687d150a3bdc5948f&scope.project.id=634c9a1745ef44c0ad66e02493d79af0&role.id=c9ec7276464a4d87ab2b6fc52a3bfeae => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:14.163900 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b8d8a-b7e2-49a6-a9e5-efe40d760ee4 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:14.202898 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:14.254200 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:14.265396 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c422b-c88c-4d9b-a0d2-63b250cf83e6 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:14.284260 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b8d8a-b7e2-49a6-a9e5-efe40d760ee4 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:14.302861 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce74b11-02c7-4805-bdf3-22a4d50effda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:14.304138 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce74b11-02c7-4805-bdf3-22a4d50effda None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:14.304646 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce74b11-02c7-4805-bdf3-22a4d50effda None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:14.305125 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce74b11-02c7-4805-bdf3-22a4d50effda None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:14.306083 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce74b11-02c7-4805-bdf3-22a4d50effda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:14.306621 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce74b11-02c7-4805-bdf3-22a4d50effda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:14.308259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce74b11-02c7-4805-bdf3-22a4d50effda None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:14.323039 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 341/680] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:14.328197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce74b11-02c7-4805-bdf3-22a4d50effda None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:14.329188 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e905f-cf55-4fc1-949b-7af3316ae6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:14.329890 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e905f-cf55-4fc1-949b-7af3316ae6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:14.330218 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e905f-cf55-4fc1-949b-7af3316ae6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:14.330496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e905f-cf55-4fc1-949b-7af3316ae6e1 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:14.331349 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e905f-cf55-4fc1-949b-7af3316ae6e1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:14.331659 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e905f-cf55-4fc1-949b-7af3316ae6e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:14.333178 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e905f-cf55-4fc1-949b-7af3316ae6e1 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:14.360225 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 340/681] 10.222.0.57 () {56 vars in 1135 bytes} [Sat Jun 4 08:10:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:14.371218 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e905f-cf55-4fc1-949b-7af3316ae6e1 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:14.487045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce74b11-02c7-4805-bdf3-22a4d50effda None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:14.490080 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:14.530188 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e905f-cf55-4fc1-949b-7af3316ae6e1 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:14.530381 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb56ec3-22df-4233-b993-31c9bd260ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:14.531001 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb56ec3-22df-4233-b993-31c9bd260ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:14.531285 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb56ec3-22df-4233-b993-31c9bd260ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:14.531571 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb56ec3-22df-4233-b993-31c9bd260ac9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:14.540886 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb56ec3-22df-4233-b993-31c9bd260ac9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:14.542533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb56ec3-22df-4233-b993-31c9bd260ac9 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:14.558597 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-1eb56ec3-22df-4233-b993-31c9bd260ac9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:14.558597 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:14.558597 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:14.558597 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:14.558597 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:14.558597 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:14.558597 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:14.558597 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:14.558597 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:14.558597 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:14.558597 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:14.558597 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:14.558597 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:10:14.558597 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:10:14.558597 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:10:14.559600 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:10:14.559600 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:14.559600 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:14.559600 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:14.559600 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:14.559600 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:14.559600 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:14.559600 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:14.559600 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:14.559600 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:14.559600 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:14.559600 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:14.559600 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:14.559600 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:14.559600 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:14.559600 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:14.559600 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:14.560534 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:10:14.560534 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:10:14.560534 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:10:14.560534 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:10:14.560534 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:10:14.560534 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:10:14.560534 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:14.560534 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:14.563155 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 342/682] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:10:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:14.564578 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa463084-3169-44a5-b106-290230629e13 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:14.564875 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa463084-3169-44a5-b106-290230629e13 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:14.565153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa463084-3169-44a5-b106-290230629e13 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:14.570957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 343/683] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:14.572741 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:14.576047 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa463084-3169-44a5-b106-290230629e13 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:14.576869 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9536aff-8a2b-4d41-bcc6-1844200b0ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:14.577648 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9536aff-8a2b-4d41-bcc6-1844200b0ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:14.577973 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9536aff-8a2b-4d41-bcc6-1844200b0ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:14.578342 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9536aff-8a2b-4d41-bcc6-1844200b0ba7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:14.667137 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9536aff-8a2b-4d41-bcc6-1844200b0ba7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:14.668834 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9536aff-8a2b-4d41-bcc6-1844200b0ba7 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:14.722076 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa463084-3169-44a5-b106-290230629e13 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:14.759231 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8b4f0-a7dd-4d43-ac57-0ad60dffae56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:14.759931 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8b4f0-a7dd-4d43-ac57-0ad60dffae56 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:14.760219 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8b4f0-a7dd-4d43-ac57-0ad60dffae56 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:14.760494 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8b4f0-a7dd-4d43-ac57-0ad60dffae56 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:14.761282 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f8b4f0-a7dd-4d43-ac57-0ad60dffae56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:14.761591 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f8b4f0-a7dd-4d43-ac57-0ad60dffae56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:14.763072 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f8b4f0-a7dd-4d43-ac57-0ad60dffae56 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:14.780766 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 344/684] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:10:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:14.782110 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ebcf5-6c8e-4205-a985-859518b6e54a None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:14.782402 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ebcf5-6c8e-4205-a985-859518b6e54a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:14.782678 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ebcf5-6c8e-4205-a985-859518b6e54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:14.787221 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 341/685] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:10:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 08:10:14.788163 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9536aff-8a2b-4d41-bcc6-1844200b0ba7 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:14.804366 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e72ebcf5-6c8e-4205-a985-859518b6e54a None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:14.805625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e72ebcf5-6c8e-4205-a985-859518b6e54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:14.821246 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:14.824268 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:14.888271 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 345/686] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:10:14.889325 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ebcf5-6c8e-4205-a985-859518b6e54a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:14.898820 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9536aff-8a2b-4d41-bcc6-1844200b0ba7 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:14.940113 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160102e7-d67a-4e35-bc33-6c715cc3acaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:14.940771 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160102e7-d67a-4e35-bc33-6c715cc3acaf None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:14.941048 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160102e7-d67a-4e35-bc33-6c715cc3acaf None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:14.941325 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160102e7-d67a-4e35-bc33-6c715cc3acaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:14.942172 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160102e7-d67a-4e35-bc33-6c715cc3acaf None admin] RBAC: Adding query filter params (role.id=c9ec7276464a4d87ab2b6fc52a3bfeae, scope.project.id=634c9a1745ef44c0ad66e02493d79af0, user.id=5fd5768a512c4177abae05f4ccd5c59f) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:14.942478 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160102e7-d67a-4e35-bc33-6c715cc3acaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:14.943905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160102e7-d67a-4e35-bc33-6c715cc3acaf None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:14.950390 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 342/687] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:10:14 2022] GET /identity/v3/role_assignments?user.id=5fd5768a512c4177abae05f4ccd5c59f&scope.project.id=634c9a1745ef44c0ad66e02493d79af0&role.id=c9ec7276464a4d87ab2b6fc52a3bfeae => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:14.951184 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160102e7-d67a-4e35-bc33-6c715cc3acaf None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:15.092878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160102e7-d67a-4e35-bc33-6c715cc3acaf None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:15.101434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:15.133419 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051881a2-37e8-42d4-827e-043b4eead007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:15.134257 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051881a2-37e8-42d4-827e-043b4eead007 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:15.134534 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051881a2-37e8-42d4-827e-043b4eead007 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:15.135014 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051881a2-37e8-42d4-827e-043b4eead007 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:15.148608 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051881a2-37e8-42d4-827e-043b4eead007 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:10:15.156772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-051881a2-37e8-42d4-827e-043b4eead007 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:10:15.156772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:15.156772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:15.156772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:15.156772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:15.156772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:15.156772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:15.156772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:15.156772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:15.156772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:15.156772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:15.156772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:15.156772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:10:15.156772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:10:15.156772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:10:15.156772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:10:15.159071 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:10:15.159071 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:10:15.159071 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:10:15.159071 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:10:15.159071 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:15.159071 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:15.159071 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:15.159071 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:15.159071 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:15.159071 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:15.159071 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:15.159071 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:15.159071 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:15.159071 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:15.159071 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:15.159071 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:15.160641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:15.160641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:15.160641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:15.160641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:15.160641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:10:15.160641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:10:15.160641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:10:15.160641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:10:15.160641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:10:15.160641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:10:15.160641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:10:15.160641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:15.160641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 343/688] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:10:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:15.166176 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051881a2-37e8-42d4-827e-043b4eead007 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:15.187497 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ebcf5-6c8e-4205-a985-859518b6e54a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:15.227808 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed51c4-8918-4540-b785-37527ae9eab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:15.228622 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed51c4-8918-4540-b785-37527ae9eab1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:15.228905 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed51c4-8918-4540-b785-37527ae9eab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:15.229183 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed51c4-8918-4540-b785-37527ae9eab1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:15.241057 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed51c4-8918-4540-b785-37527ae9eab1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:15.242794 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed51c4-8918-4540-b785-37527ae9eab1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:15.266176 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-95ed51c4-8918-4540-b785-37527ae9eab1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:15.266176 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:15.266176 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:15.266176 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:15.266176 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:15.266176 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:15.266176 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:15.266176 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:15.266176 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:15.266176 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:15.266176 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:15.266176 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:15.266176 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:15.266176 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:15.266176 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:15.268840 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:15.268840 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:15.268840 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:15.268840 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:15.268840 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:15.268840 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:15.268840 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:15.268840 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:15.268840 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:15.268840 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:15.268840 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:15.268840 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:15.268840 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:15.268840 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:15.268840 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:15.268840 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:15.268840 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:15.270955 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:15.270955 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:15.270955 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:15.270955 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:15.270955 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 346/689] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:15.277023 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed51c4-8918-4540-b785-37527ae9eab1 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:15.282795 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:15.292092 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051881a2-37e8-42d4-827e-043b4eead007 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:15.336044 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88359f14-dae4-44eb-a6fc-daedd9b30538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:15.336708 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88359f14-dae4-44eb-a6fc-daedd9b30538 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:15.336988 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88359f14-dae4-44eb-a6fc-daedd9b30538 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:15.337260 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88359f14-dae4-44eb-a6fc-daedd9b30538 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:15.338026 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88359f14-dae4-44eb-a6fc-daedd9b30538 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:15.338331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88359f14-dae4-44eb-a6fc-daedd9b30538 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:15.340340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88359f14-dae4-44eb-a6fc-daedd9b30538 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:15.351336 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 344/690] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:10:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:15.357566 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88359f14-dae4-44eb-a6fc-daedd9b30538 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:15.381284 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:15.400493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed51c4-8918-4540-b785-37527ae9eab1 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:15.441504 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972670a-06c5-4861-882b-b273a9c49b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:15.442639 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972670a-06c5-4861-882b-b273a9c49b82 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:15.443160 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972670a-06c5-4861-882b-b273a9c49b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:15.443659 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972670a-06c5-4861-882b-b273a9c49b82 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:15.444692 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972670a-06c5-4861-882b-b273a9c49b82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:15.445204 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972670a-06c5-4861-882b-b273a9c49b82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:15.446840 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972670a-06c5-4861-882b-b273a9c49b82 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:15.461108 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 347/691] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:15.466661 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972670a-06c5-4861-882b-b273a9c49b82 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:15.471400 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88359f14-dae4-44eb-a6fc-daedd9b30538 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:15.507293 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d071dcb-76c9-4800-b88b-4e1f7853c3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:15.508715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d071dcb-76c9-4800-b88b-4e1f7853c3eb None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:15.508715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d071dcb-76c9-4800-b88b-4e1f7853c3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:15.508715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d071dcb-76c9-4800-b88b-4e1f7853c3eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:15.519516 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d071dcb-76c9-4800-b88b-4e1f7853c3eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:15.520955 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d071dcb-76c9-4800-b88b-4e1f7853c3eb None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:15.538102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-5d071dcb-76c9-4800-b88b-4e1f7853c3eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:15.538102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:15.538102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:15.538102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:15.538102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:15.538102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:15.538102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:15.538102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:15.538102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:15.538102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:15.538102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:15.538102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:15.538102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:15.538102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:15.538102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:15.539069 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:15.539069 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:15.539069 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:15.539069 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:15.539069 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:15.539069 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:15.539069 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:15.539069 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:15.539069 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:15.539069 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:15.539069 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:15.539069 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:15.539069 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:15.539069 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:15.539069 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:15.539069 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:15.539069 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:15.540094 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:15.540094 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:15.540094 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:15.540094 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:15.540094 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 345/692] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:15.544880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:15.545335 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d071dcb-76c9-4800-b88b-4e1f7853c3eb None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:15.589913 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972670a-06c5-4861-882b-b273a9c49b82 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:15.618592 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:15.630290 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594df324-cd46-44c4-bfaf-9577a6459f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:15.631421 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594df324-cd46-44c4-bfaf-9577a6459f8d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:15.632778 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594df324-cd46-44c4-bfaf-9577a6459f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:15.633530 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594df324-cd46-44c4-bfaf-9577a6459f8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:15.641976 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594df324-cd46-44c4-bfaf-9577a6459f8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:15.643813 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594df324-cd46-44c4-bfaf-9577a6459f8d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:15.651075 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d071dcb-76c9-4800-b88b-4e1f7853c3eb None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:15.660575 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-594df324-cd46-44c4-bfaf-9577a6459f8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:15.660575 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:15.660575 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:15.660575 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:15.660575 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:15.660575 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:15.660575 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:15.660575 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:15.660575 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:15.660575 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:15.660575 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:15.660575 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:15.660575 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:10:15.660575 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:10:15.660575 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:10:15.661531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:10:15.661531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:15.661531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:15.661531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:15.661531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:15.661531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:15.661531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:15.661531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:15.661531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:15.661531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:15.661531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:15.661531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:15.661531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:15.661531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:15.661531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:15.661531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:15.661531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:15.662477 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:10:15.662477 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:10:15.662477 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:10:15.662477 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:10:15.662477 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:10:15.662477 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:10:15.662477 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:15.662477 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:15.665310 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 348/693] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:10:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:10:15.671128 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594df324-cd46-44c4-bfaf-9577a6459f8d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:15.686455 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab3728-718e-4028-8043-246fa4fe4131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:15.687128 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab3728-718e-4028-8043-246fa4fe4131 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:15.687406 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab3728-718e-4028-8043-246fa4fe4131 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:15.687681 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab3728-718e-4028-8043-246fa4fe4131 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:15.688416 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab3728-718e-4028-8043-246fa4fe4131 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:15.688703 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab3728-718e-4028-8043-246fa4fe4131 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:15.690733 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab3728-718e-4028-8043-246fa4fe4131 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:15.703516 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 346/694] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:15.708970 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab3728-718e-4028-8043-246fa4fe4131 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:15.789070 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594df324-cd46-44c4-bfaf-9577a6459f8d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:15.810725 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab3728-718e-4028-8043-246fa4fe4131 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:15.821121 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:15.828435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bedb5a9-cc7e-4f64-b842-d2ab2ca0b2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:15.829090 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedb5a9-cc7e-4f64-b842-d2ab2ca0b2f3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:15.829383 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedb5a9-cc7e-4f64-b842-d2ab2ca0b2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:15.829659 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedb5a9-cc7e-4f64-b842-d2ab2ca0b2f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:15.830689 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bedb5a9-cc7e-4f64-b842-d2ab2ca0b2f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:15.831003 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bedb5a9-cc7e-4f64-b842-d2ab2ca0b2f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:15.832458 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bedb5a9-cc7e-4f64-b842-d2ab2ca0b2f3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:15.842566 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:15.847226 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 349/695] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:10:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:15.847722 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac453bc-a529-4f88-83d0-c159df2d0647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:15.848525 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac453bc-a529-4f88-83d0-c159df2d0647 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:15.848814 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac453bc-a529-4f88-83d0-c159df2d0647 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:15.849086 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac453bc-a529-4f88-83d0-c159df2d0647 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:15.851193 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d854e6d-d66b-42cd-8b81-1e582b1dad4f None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:15.851585 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d854e6d-d66b-42cd-8b81-1e582b1dad4f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:15.851915 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d854e6d-d66b-42cd-8b81-1e582b1dad4f None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:15.853263 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 350/696] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:15.853814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d854e6d-d66b-42cd-8b81-1e582b1dad4f None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:15.861105 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac453bc-a529-4f88-83d0-c159df2d0647 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:15.863164 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac453bc-a529-4f88-83d0-c159df2d0647 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:15.878452 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-cac453bc-a529-4f88-83d0-c159df2d0647 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 08:10:15.878452 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:15.878452 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:15.878452 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:15.878452 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:15.878452 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:15.878452 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:15.878452 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:15.878452 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:15.878452 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:15.878452 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:15.878452 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:15.878452 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:10:15.878452 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:10:15.878452 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:10:15.878452 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:10:15.880550 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:15.880550 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:15.880550 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:10:15.880550 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:15.880550 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:10:15.880550 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:15.880550 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:15.880550 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:15.880550 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:15.880550 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:15.880550 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:15.880550 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:15.880550 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:15.880550 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:15.880550 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:15.880550 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:15.880550 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:15.880550 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:15.883102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:15.883102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:15.883102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:10:15.883102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:10:15.883102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:10:15.883102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:10:15.883102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:10:15.883102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:10:15.883102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 08:10:15.883102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:15.883102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 347/697] 10.222.0.57 () {56 vars in 1093 bytes} [Sat Jun 4 08:10:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:15.883102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c9cae-dc03-4b31-abe3-ab144209050e None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:15.883102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c9cae-dc03-4b31-abe3-ab144209050e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:15.884903 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c9cae-dc03-4b31-abe3-ab144209050e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:15.902088 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-594c9cae-dc03-4b31-abe3-ab144209050e None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:15.903258 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-594c9cae-dc03-4b31-abe3-ab144209050e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:15.973864 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 348/698] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:10:15.974721 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c9cae-dc03-4b31-abe3-ab144209050e None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:15.989374 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d854e6d-d66b-42cd-8b81-1e582b1dad4f None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:16.037087 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f3311-5190-4ce9-ae18-2dc6b0ec1334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:16.037750 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f3311-5190-4ce9-ae18-2dc6b0ec1334 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:16.038079 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f3311-5190-4ce9-ae18-2dc6b0ec1334 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:16.038359 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f3311-5190-4ce9-ae18-2dc6b0ec1334 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:16.039299 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f3311-5190-4ce9-ae18-2dc6b0ec1334 None admin] RBAC: Adding query filter params (role.id=c9ec7276464a4d87ab2b6fc52a3bfeae, scope.project.id=634c9a1745ef44c0ad66e02493d79af0, user.id=05ea412cab4244c58a2670c66f5a311c) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:16.039762 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f3311-5190-4ce9-ae18-2dc6b0ec1334 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:16.041202 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f3311-5190-4ce9-ae18-2dc6b0ec1334 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:16.054345 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 351/699] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:10:15 2022] GET /identity/v3/role_assignments?user.id=05ea412cab4244c58a2670c66f5a311c&scope.project.id=634c9a1745ef44c0ad66e02493d79af0&role.id=c9ec7276464a4d87ab2b6fc52a3bfeae => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:16.055412 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f3311-5190-4ce9-ae18-2dc6b0ec1334 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:16.090325 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c9cae-dc03-4b31-abe3-ab144209050e None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:16.116677 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:16.135868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbe797-60c6-4935-bd40-816ebaad18ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:16.136459 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbe797-60c6-4935-bd40-816ebaad18ec None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:16.136736 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbe797-60c6-4935-bd40-816ebaad18ec None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:16.137007 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbe797-60c6-4935-bd40-816ebaad18ec None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:16.137959 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fbe797-60c6-4935-bd40-816ebaad18ec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:16.138269 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fbe797-60c6-4935-bd40-816ebaad18ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:16.140320 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fbe797-60c6-4935-bd40-816ebaad18ec None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:16.162864 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 349/700] 10.222.0.57 () {56 vars in 1133 bytes} [Sat Jun 4 08:10:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:16.167599 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:16.169296 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbe797-60c6-4935-bd40-816ebaad18ec None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:16.295822 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbe797-60c6-4935-bd40-816ebaad18ec None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:16.335378 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f3311-5190-4ce9-ae18-2dc6b0ec1334 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:16.338298 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abe892-d0e4-4986-bb28-cc57b63c57e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:16.338952 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abe892-d0e4-4986-bb28-cc57b63c57e1 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:16.339234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abe892-d0e4-4986-bb28-cc57b63c57e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:16.339504 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abe892-d0e4-4986-bb28-cc57b63c57e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:16.382052 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1452ba5-abab-47e5-84ad-02235a4290de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:16.382876 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1452ba5-abab-47e5-84ad-02235a4290de None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:16.383163 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1452ba5-abab-47e5-84ad-02235a4290de None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:16.383443 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1452ba5-abab-47e5-84ad-02235a4290de None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:16.384101 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1452ba5-abab-47e5-84ad-02235a4290de None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:16.385481 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1452ba5-abab-47e5-84ad-02235a4290de None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:16.395750 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:16.400658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-f1452ba5-abab-47e5-84ad-02235a4290de None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 08:10:16.400658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:16.400658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 08:10:16.400658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 08:10:16.400658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 08:10:16.400658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 08:10:16.400658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 08:10:16.400658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:16.400658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 08:10:16.400658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:16.400658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 08:10:16.400658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:16.400658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:16.400658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:16.400658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:16.400658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:16.401648 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:16.401648 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:16.401648 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:16.401648 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:16.401648 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:16.401648 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:16.401648 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:16.401648 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 08:10:16.401648 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 08:10:16.401648 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 08:10:16.401648 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 08:10:16.401648 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:16.401648 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:16.401648 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:16.401648 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:16.401648 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:16.402782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:16.402782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:16.402782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:16.402782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:16.402782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:16.402782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:16.402782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:16.402782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:16.402782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:16.402782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:16.402782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:16.402782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 08:10:16.402782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:16.402782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 08:10:16.402782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:16.402782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 352/701] 10.222.0.57 () {56 vars in 1129 bytes} [Sat Jun 4 08:10:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:16.407895 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1452ba5-abab-47e5-84ad-02235a4290de None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:16.423573 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abe892-d0e4-4986-bb28-cc57b63c57e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:16.425596 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abe892-d0e4-4986-bb28-cc57b63c57e1 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:16.523156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1452ba5-abab-47e5-84ad-02235a4290de None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:16.529211 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 350/702] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:10:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 08:10:16.538965 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abe892-d0e4-4986-bb28-cc57b63c57e1 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:16.540865 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:16.571145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da0425-3225-4627-b044-395c770d5fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:16.571936 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da0425-3225-4627-b044-395c770d5fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:16.572102 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da0425-3225-4627-b044-395c770d5fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:16.577843 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da0425-3225-4627-b044-395c770d5fd9 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:16.577843 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da0425-3225-4627-b044-395c770d5fd9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:16.577843 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da0425-3225-4627-b044-395c770d5fd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:16.577843 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da0425-3225-4627-b044-395c770d5fd9 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:16.581996 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 353/703] 10.222.0.57 () {56 vars in 1124 bytes} [Sat Jun 4 08:10:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:16.586310 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da0425-3225-4627-b044-395c770d5fd9 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:16.658835 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:16.691647 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abe892-d0e4-4986-bb28-cc57b63c57e1 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:16.715403 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da0425-3225-4627-b044-395c770d5fd9 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:16.739923 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abc773-2b3e-43e2-8109-72854b2f1ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:16.740979 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abc773-2b3e-43e2-8109-72854b2f1ebd None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:16.741701 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abc773-2b3e-43e2-8109-72854b2f1ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:16.742024 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abc773-2b3e-43e2-8109-72854b2f1ebd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:16.753743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede9fcb-75d1-4a22-8582-70c38d9b09ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:16.754627 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede9fcb-75d1-4a22-8582-70c38d9b09ed None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:16.754969 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede9fcb-75d1-4a22-8582-70c38d9b09ed None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:16.755320 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede9fcb-75d1-4a22-8582-70c38d9b09ed None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:16.756223 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8abc773-2b3e-43e2-8109-72854b2f1ebd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:16.757459 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede9fcb-75d1-4a22-8582-70c38d9b09ed None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:16.757704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8abc773-2b3e-43e2-8109-72854b2f1ebd None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:16.757808 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede9fcb-75d1-4a22-8582-70c38d9b09ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:16.759411 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede9fcb-75d1-4a22-8582-70c38d9b09ed None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:16.766974 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 354/704] 10.222.0.57 () {56 vars in 1124 bytes} [Sat Jun 4 08:10:16 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:16.778280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-e8abc773-2b3e-43e2-8109-72854b2f1ebd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:16.778280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:16.778280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:16.778280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:16.778280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:16.778280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:16.778280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:16.778280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:16.778280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:16.778280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:16.778280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:16.778280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:16.778280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:16.778280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:16.778280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:16.779268 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:16.779268 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:16.779268 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:16.779268 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:16.779268 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:16.779268 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:16.779268 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:16.779268 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:16.779268 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:16.779268 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:16.779268 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:16.779268 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:16.779268 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:16.779268 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:16.779268 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:16.779268 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:16.779268 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:16.780183 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:16.780183 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:16.780183 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:16.780183 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:16.780183 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 351/705] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:16.785154 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede9fcb-75d1-4a22-8582-70c38d9b09ed None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:16.865961 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:16.920218 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945c2ac-9fd9-4b4f-b8b3-b9570b8fadf7 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:16.920831 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945c2ac-9fd9-4b4f-b8b3-b9570b8fadf7 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:16.921334 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945c2ac-9fd9-4b4f-b8b3-b9570b8fadf7 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:16.923420 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 352/706] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:16 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 08:10:16.930031 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5ef6f-38b8-4497-80ab-52fcc5023eb2 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:16.930605 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5ef6f-38b8-4497-80ab-52fcc5023eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:16.931059 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5ef6f-38b8-4497-80ab-52fcc5023eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:16.934243 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede9fcb-75d1-4a22-8582-70c38d9b09ed None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:16.950555 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-d7b5ef6f-38b8-4497-80ab-52fcc5023eb2 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:16.951735 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d7b5ef6f-38b8-4497-80ab-52fcc5023eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:16.997499 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c952b-0922-46f3-991f-6faf51764bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:16.998558 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c952b-0922-46f3-991f-6faf51764bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:16.999066 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c952b-0922-46f3-991f-6faf51764bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:16.999540 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c952b-0922-46f3-991f-6faf51764bf3 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:17.000481 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c952b-0922-46f3-991f-6faf51764bf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:17.000985 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c952b-0922-46f3-991f-6faf51764bf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:17.002818 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c952b-0922-46f3-991f-6faf51764bf3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:17.025256 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 355/707] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:17.031764 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 353/708] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 08:10:17.039044 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c952b-0922-46f3-991f-6faf51764bf3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:17.088496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5ef6f-38b8-4497-80ab-52fcc5023eb2 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:17.169811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:17.179579 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c952b-0922-46f3-991f-6faf51764bf3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:17.181232 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:17.237381 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea77ce5-59b9-432b-a404-ebe963d0d5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:17.240296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea77ce5-59b9-432b-a404-ebe963d0d5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:17.240585 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea77ce5-59b9-432b-a404-ebe963d0d5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:17.242137 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea77ce5-59b9-432b-a404-ebe963d0d5e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:17.256096 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5ef6f-38b8-4497-80ab-52fcc5023eb2 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:17.258508 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea77ce5-59b9-432b-a404-ebe963d0d5e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:17.260056 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea77ce5-59b9-432b-a404-ebe963d0d5e8 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:17.292378 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-0ea77ce5-59b9-432b-a404-ebe963d0d5e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:17.292378 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:17.292378 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:17.292378 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:17.292378 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:17.292378 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:17.292378 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:17.292378 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:17.292378 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:17.292378 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:17.292378 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:17.292378 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:17.292378 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:10:17.292378 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:10:17.292378 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:10:17.293355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:10:17.293355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:17.293355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:17.293355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:17.293355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:17.293355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:17.293355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:17.293355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:17.293355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:17.293355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:17.293355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:17.293355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:17.293355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:17.293355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:17.293355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:17.293355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:17.293355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:17.294304 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:10:17.294304 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:10:17.294304 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:10:17.294304 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:10:17.294304 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:10:17.294304 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:10:17.294304 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:17.294304 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:17.297243 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 356/709] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:10:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:17.301662 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea77ce5-59b9-432b-a404-ebe963d0d5e8 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:17.335386 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09e5c7-6e26-4cac-a4ef-be4cf7f022ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:17.336185 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09e5c7-6e26-4cac-a4ef-be4cf7f022ba None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:17.336467 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09e5c7-6e26-4cac-a4ef-be4cf7f022ba None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:17.336742 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09e5c7-6e26-4cac-a4ef-be4cf7f022ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:17.354608 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09e5c7-6e26-4cac-a4ef-be4cf7f022ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:17.361994 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09e5c7-6e26-4cac-a4ef-be4cf7f022ba None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:17.377931 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-4a09e5c7-6e26-4cac-a4ef-be4cf7f022ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:17.377931 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:17.377931 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:17.377931 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:17.377931 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:17.377931 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:17.377931 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:17.377931 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:17.377931 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:17.377931 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:17.377931 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:17.377931 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:17.377931 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:17.377931 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:17.377931 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:17.378904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:17.378904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:17.378904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:17.378904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:17.378904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:17.378904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:17.378904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:17.378904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:17.378904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:17.378904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:17.378904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:17.378904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:17.378904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:17.378904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:17.378904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:17.378904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:17.378904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:17.379851 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:17.379851 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:17.379851 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:17.379851 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:17.379851 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 354/710] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:17.382495 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09e5c7-6e26-4cac-a4ef-be4cf7f022ba None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:17.496821 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea77ce5-59b9-432b-a404-ebe963d0d5e8 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:17.537282 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e3893-3bb4-40f1-ab1e-9b8a4d9a09da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:17.538087 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e3893-3bb4-40f1-ab1e-9b8a4d9a09da None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:17.538369 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e3893-3bb4-40f1-ab1e-9b8a4d9a09da None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:17.538645 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e3893-3bb4-40f1-ab1e-9b8a4d9a09da None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:17.539441 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e3893-3bb4-40f1-ab1e-9b8a4d9a09da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:17.539747 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e3893-3bb4-40f1-ab1e-9b8a4d9a09da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:17.541284 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e3893-3bb4-40f1-ab1e-9b8a4d9a09da None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:17.556311 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 357/711] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:10:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:17.562782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e3893-3bb4-40f1-ab1e-9b8a4d9a09da None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:17.569228 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09e5c7-6e26-4cac-a4ef-be4cf7f022ba None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:17.593902 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:17.612334 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:17.623823 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd42db6-494a-4731-bc48-2fb7851fcbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:17.624911 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd42db6-494a-4731-bc48-2fb7851fcbad None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:17.625417 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd42db6-494a-4731-bc48-2fb7851fcbad None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:17.625947 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd42db6-494a-4731-bc48-2fb7851fcbad None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:17.627008 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd42db6-494a-4731-bc48-2fb7851fcbad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:17.627729 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd42db6-494a-4731-bc48-2fb7851fcbad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:17.629305 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd42db6-494a-4731-bc48-2fb7851fcbad None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:17.642663 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 355/712] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:17.653917 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd42db6-494a-4731-bc48-2fb7851fcbad None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:17.751271 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e3893-3bb4-40f1-ab1e-9b8a4d9a09da None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:17.808666 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b8090-43ae-47d4-919a-adeb3839f5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:17.809335 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b8090-43ae-47d4-919a-adeb3839f5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:17.809621 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b8090-43ae-47d4-919a-adeb3839f5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:17.809922 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b8090-43ae-47d4-919a-adeb3839f5e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:17.811994 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b8090-43ae-47d4-919a-adeb3839f5e5 None admin] RBAC: Adding query filter params (role.id=431cef539cfb476aad50d2470e763b5f, scope.project.id=634c9a1745ef44c0ad66e02493d79af0, user.id=7e64d002241242928936dd0d991ecdc1) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:17.812311 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b8090-43ae-47d4-919a-adeb3839f5e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:17.813759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b8090-43ae-47d4-919a-adeb3839f5e5 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:17.825642 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 358/713] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:10:17 2022] GET /identity/v3/role_assignments?user.id=7e64d002241242928936dd0d991ecdc1&scope.project.id=634c9a1745ef44c0ad66e02493d79af0&role.id=431cef539cfb476aad50d2470e763b5f => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:17.848498 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd42db6-494a-4731-bc48-2fb7851fcbad None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:17.898617 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699d565-6540-4dea-bac3-6e993eb80517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:17.899569 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699d565-6540-4dea-bac3-6e993eb80517 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:17.899856 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699d565-6540-4dea-bac3-6e993eb80517 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:17.900135 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699d565-6540-4dea-bac3-6e993eb80517 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:17.900868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699d565-6540-4dea-bac3-6e993eb80517 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:17.902426 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699d565-6540-4dea-bac3-6e993eb80517 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:17.936898 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed1eff-c242-486e-89df-161af317477b None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:17.937532 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed1eff-c242-486e-89df-161af317477b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:17.938080 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed1eff-c242-486e-89df-161af317477b None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:17.939961 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 359/714] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 08:10:17.945389 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 356/715] 10.222.0.57 () {60 vars in 1132 bytes} [Sat Jun 4 08:10:17 2022] POST /identity/v3/users => generated 254 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:10:17.946355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36fde5-2638-4743-8a0b-f4d2cbf170e2 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:17.946856 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36fde5-2638-4743-8a0b-f4d2cbf170e2 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:17.947409 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36fde5-2638-4743-8a0b-f4d2cbf170e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:17.982692 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-fc36fde5-2638-4743-8a0b-f4d2cbf170e2 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:17.984429 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-fc36fde5-2638-4743-8a0b-f4d2cbf170e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:18.094420 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 360/716] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 08:10:18.120217 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699d565-6540-4dea-bac3-6e993eb80517 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:18.157539 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:18.245318 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699d565-6540-4dea-bac3-6e993eb80517 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:18.289571 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b1e4c-5d18-44cb-aa34-b152e61be4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:18.290415 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b1e4c-5d18-44cb-aa34-b152e61be4ec None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:18.290706 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b1e4c-5d18-44cb-aa34-b152e61be4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:18.290984 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b1e4c-5d18-44cb-aa34-b152e61be4ec None admin] PATH_INFO: `/v3/services/network` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:18.291658 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b1e4c-5d18-44cb-aa34-b152e61be4ec None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:18.293103 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b1e4c-5d18-44cb-aa34-b152e61be4ec None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:18.310435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-4d0b1e4c-5d18-44cb-aa34-b152e61be4ec None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 08:10:18.310435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:18.310435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 08:10:18.310435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 08:10:18.310435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 08:10:18.310435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 08:10:18.310435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 08:10:18.310435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:18.310435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 08:10:18.310435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:18.310435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 08:10:18.310435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:18.310435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:18.310435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:18.310435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:18.310435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:18.310435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:18.311519 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:18.311519 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:18.311519 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:18.311519 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:18.311519 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:18.311519 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:18.311519 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 08:10:18.311519 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 08:10:18.311519 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 08:10:18.311519 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 08:10:18.311519 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:18.311519 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:18.311519 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:18.311519 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:18.311519 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:18.311519 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:18.312362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:18.312362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:18.312362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:18.312362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:18.312362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:18.312362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:18.312362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:18.312362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:18.312362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:18.312362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:18.312362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 08:10:18.312362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:18.312362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 08:10:18.312362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:18.312362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 357/717] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:10:18 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:18.318205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36fde5-2638-4743-8a0b-f4d2cbf170e2 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:18.339568 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:18.433341 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36fde5-2638-4743-8a0b-f4d2cbf170e2 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:18.474106 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b2e36-7aee-4632-ab1c-05752df8c45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:18.475172 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b2e36-7aee-4632-ab1c-05752df8c45a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:18.475655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b2e36-7aee-4632-ab1c-05752df8c45a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:18.476125 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b2e36-7aee-4632-ab1c-05752df8c45a None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:18.477016 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b2e36-7aee-4632-ab1c-05752df8c45a None admin] RBAC: Adding query filter params (name=network) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:18.477534 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b2e36-7aee-4632-ab1c-05752df8c45a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:18.479310 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b2e36-7aee-4632-ab1c-05752df8c45a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:18.484471 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 361/718] 10.222.0.57 () {56 vars in 1112 bytes} [Sat Jun 4 08:10:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:18.490644 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b1e4c-5d18-44cb-aa34-b152e61be4ec None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:18.608060 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:18.619001 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b1e4c-5d18-44cb-aa34-b152e61be4ec None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:18.665708 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e946b8e-01c2-48f0-b574-ff20906d58cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:18.666823 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e946b8e-01c2-48f0-b574-ff20906d58cf None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:18.667301 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e946b8e-01c2-48f0-b574-ff20906d58cf None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:18.667765 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e946b8e-01c2-48f0-b574-ff20906d58cf None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:18.668677 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e946b8e-01c2-48f0-b574-ff20906d58cf None admin] RBAC: Adding query filter params (type=network) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:18.669173 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e946b8e-01c2-48f0-b574-ff20906d58cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:18.670781 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e946b8e-01c2-48f0-b574-ff20906d58cf None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:18.682921 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 358/719] 10.222.0.57 () {56 vars in 1112 bytes} [Sat Jun 4 08:10:18 2022] GET /identity/v3/services?type=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:19.315243 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63390dfa-c29f-4b93-a865-73a795c3c561 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:19.315796 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63390dfa-c29f-4b93-a865-73a795c3c561 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:19.315796 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63390dfa-c29f-4b93-a865-73a795c3c561 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:19.317402 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 362/720] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:19.323249 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638921a-df2f-407d-a169-361794ca0c8e None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:19.323918 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638921a-df2f-407d-a169-361794ca0c8e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:19.323918 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638921a-df2f-407d-a169-361794ca0c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:19.347086 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-8638921a-df2f-407d-a169-361794ca0c8e None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:19.348275 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8638921a-df2f-407d-a169-361794ca0c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:19.452595 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 359/721] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:10:19.492522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63390dfa-c29f-4b93-a865-73a795c3c561 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:19.587637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cf07b-68a2-4dd0-9fc5-a9a1cab4fe91 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:19.587827 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cf07b-68a2-4dd0-9fc5-a9a1cab4fe91 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:19.588108 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cf07b-68a2-4dd0-9fc5-a9a1cab4fe91 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:19.589742 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 360/722] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:19.599541 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee2184-eb3b-4dde-b4f1-3f8c0d44746e None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:19.599830 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee2184-eb3b-4dde-b4f1-3f8c0d44746e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:19.600113 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee2184-eb3b-4dde-b4f1-3f8c0d44746e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:19.600554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:19.633000 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63390dfa-c29f-4b93-a865-73a795c3c561 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:19.634562 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-76ee2184-eb3b-4dde-b4f1-3f8c0d44746e None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:19.635765 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-76ee2184-eb3b-4dde-b4f1-3f8c0d44746e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:19.695736 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7cd43a-fa94-40f1-81eb-95ded779ac61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:19.696535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cd43a-fa94-40f1-81eb-95ded779ac61 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:19.696812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cd43a-fa94-40f1-81eb-95ded779ac61 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:19.697086 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cd43a-fa94-40f1-81eb-95ded779ac61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:19.719990 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7cd43a-fa94-40f1-81eb-95ded779ac61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:10:19.734223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-ec7cd43a-fa94-40f1-81eb-95ded779ac61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:10:19.734223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:19.734223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:19.734223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:19.734223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:19.734223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:19.734223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:19.734223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:19.734223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:19.734223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:19.734223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:19.734223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:19.734223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:10:19.734223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:10:19.734223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:10:19.734223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:10:19.735281 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:10:19.735281 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:10:19.735281 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:10:19.735281 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:10:19.735281 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:19.735281 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:19.735281 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:19.735281 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:19.735281 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:19.735281 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:19.735281 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:19.735281 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:19.735281 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:19.735281 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:19.735281 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:19.735281 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:19.736206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:19.736206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:19.736206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:19.736206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:19.736206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:10:19.736206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:10:19.736206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:10:19.736206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:10:19.736206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:10:19.736206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:10:19.736206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:10:19.736206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:19.736206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 363/723] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:10:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:19.745114 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7cd43a-fa94-40f1-81eb-95ded779ac61 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:19.760963 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 361/724] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 08:10:19.803223 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee2184-eb3b-4dde-b4f1-3f8c0d44746e None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:19.829813 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:19.928263 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7cd43a-fa94-40f1-81eb-95ded779ac61 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:19.993179 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee2184-eb3b-4dde-b4f1-3f8c0d44746e None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:19.999226 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd49b5d-e807-43c9-bdaa-76d9cdb1878c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:20.005232 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd49b5d-e807-43c9-bdaa-76d9cdb1878c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:20.005679 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd49b5d-e807-43c9-bdaa-76d9cdb1878c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:20.006116 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd49b5d-e807-43c9-bdaa-76d9cdb1878c None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:20.007057 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd49b5d-e807-43c9-bdaa-76d9cdb1878c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:20.007525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd49b5d-e807-43c9-bdaa-76d9cdb1878c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:20.009043 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd49b5d-e807-43c9-bdaa-76d9cdb1878c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:20.023804 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 364/725] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:10:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:20.030522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd49b5d-e807-43c9-bdaa-76d9cdb1878c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:20.045887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:20.067999 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4aa115-a81c-49bd-b2ef-ff07366b4c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:20.068959 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aa115-a81c-49bd-b2ef-ff07366b4c71 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:20.069383 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aa115-a81c-49bd-b2ef-ff07366b4c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:20.069845 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aa115-a81c-49bd-b2ef-ff07366b4c71 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:20.072608 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4aa115-a81c-49bd-b2ef-ff07366b4c71 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:20.074155 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4aa115-a81c-49bd-b2ef-ff07366b4c71 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:20.110212 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 362/726] 10.222.0.57 () {60 vars in 1141 bytes} [Sat Jun 4 08:10:19 2022] POST /identity/v3/services => generated 251 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:10:20.174515 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd49b5d-e807-43c9-bdaa-76d9cdb1878c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:20.219562 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632c58a-09a3-4050-993d-c8c67cbc54c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:20.220668 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632c58a-09a3-4050-993d-c8c67cbc54c6 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:20.221192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632c58a-09a3-4050-993d-c8c67cbc54c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:20.221603 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632c58a-09a3-4050-993d-c8c67cbc54c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:20.234054 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632c58a-09a3-4050-993d-c8c67cbc54c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:20.235780 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632c58a-09a3-4050-993d-c8c67cbc54c6 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:20.255178 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-a632c58a-09a3-4050-993d-c8c67cbc54c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:20.255178 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:20.255178 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:20.255178 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:20.255178 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:20.255178 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:20.255178 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:20.255178 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:20.255178 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:20.255178 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:20.255178 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:20.255178 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:20.255178 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:20.255178 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:20.255178 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:20.256353 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:20.256353 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:20.256353 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:20.256353 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:20.256353 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:20.256353 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:20.256353 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:20.256353 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:20.256353 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:20.256353 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:20.256353 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:20.256353 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:20.256353 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:20.256353 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:20.256353 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:20.256353 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:20.256353 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:20.257483 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:20.257483 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:20.257483 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:20.257483 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:20.259540 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 365/727] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:20.266945 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4aa115-a81c-49bd-b2ef-ff07366b4c71 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:20.379756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:20.418879 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4aa115-a81c-49bd-b2ef-ff07366b4c71 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:20.464215 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43877bf-2977-4425-8dac-33cff7c9a0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:20.465153 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43877bf-2977-4425-8dac-33cff7c9a0e2 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:20.465575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43877bf-2977-4425-8dac-33cff7c9a0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:20.466068 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43877bf-2977-4425-8dac-33cff7c9a0e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:20.466928 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43877bf-2977-4425-8dac-33cff7c9a0e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:20.467391 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43877bf-2977-4425-8dac-33cff7c9a0e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:20.468901 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43877bf-2977-4425-8dac-33cff7c9a0e2 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:20.482322 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 363/728] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:20.489477 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632c58a-09a3-4050-993d-c8c67cbc54c6 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:20.528261 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad94b8-d3ab-4cc1-907a-6706789e34f5 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:20.528855 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad94b8-d3ab-4cc1-907a-6706789e34f5 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:20.529273 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad94b8-d3ab-4cc1-907a-6706789e34f5 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:20.530792 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 364/729] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 08:10:20.536886 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57540c23-6bd5-4c8c-b84f-534f60331b2b None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:20.537299 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57540c23-6bd5-4c8c-b84f-534f60331b2b None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:20.537710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57540c23-6bd5-4c8c-b84f-534f60331b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:20.555094 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:20.563667 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-57540c23-6bd5-4c8c-b84f-534f60331b2b None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:20.565134 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-57540c23-6bd5-4c8c-b84f-534f60331b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:20.613331 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632c58a-09a3-4050-993d-c8c67cbc54c6 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:20.646015 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 365/730] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:20 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:10:20.648568 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf822b0c-0ff7-4200-a273-dfee0b1c8b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:20.649530 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf822b0c-0ff7-4200-a273-dfee0b1c8b9a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:20.649994 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf822b0c-0ff7-4200-a273-dfee0b1c8b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:20.650408 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf822b0c-0ff7-4200-a273-dfee0b1c8b9a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:20.665020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf822b0c-0ff7-4200-a273-dfee0b1c8b9a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:20.666804 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf822b0c-0ff7-4200-a273-dfee0b1c8b9a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:20.682370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-cf822b0c-0ff7-4200-a273-dfee0b1c8b9a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 04 08:10:20.682370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:20.682370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:20.682370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:20.682370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:20.682370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:20.682370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:20.682370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:20.682370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:20.682370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:20.682370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:20.682370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:20.682370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:10:20.682370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:10:20.682370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:10:20.682370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:10:20.683533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:20.683533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:20.683533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:10:20.683533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:20.683533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:10:20.683533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:20.683533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:20.683533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:20.683533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:20.683533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:20.683533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:20.683533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:20.683533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:20.683533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:20.683533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:20.683533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:20.683533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:20.683533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:20.684714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:20.684714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:20.684714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:10:20.684714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:10:20.684714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:10:20.684714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:10:20.684714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:10:20.684714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:10:20.684714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 04 08:10:20.684714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:20.686845 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 366/731] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:10:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:20.687394 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57540c23-6bd5-4c8c-b84f-534f60331b2b None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:20.692332 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf822b0c-0ff7-4200-a273-dfee0b1c8b9a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:20.812000 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:20.871093 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57540c23-6bd5-4c8c-b84f-534f60331b2b None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:20.878008 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf822b0c-0ff7-4200-a273-dfee0b1c8b9a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:20.898712 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:20.929469 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf5f25-6ea5-44ff-93bf-a3c95b6e0cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:20.930512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf5f25-6ea5-44ff-93bf-a3c95b6e0cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:20.930795 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf5f25-6ea5-44ff-93bf-a3c95b6e0cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:20.931067 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf5f25-6ea5-44ff-93bf-a3c95b6e0cd0 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:20.931903 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf5f25-6ea5-44ff-93bf-a3c95b6e0cd0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:20.932207 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf5f25-6ea5-44ff-93bf-a3c95b6e0cd0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:20.933637 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf5f25-6ea5-44ff-93bf-a3c95b6e0cd0 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:20.951694 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 367/732] 10.222.0.57 () {56 vars in 1135 bytes} [Sat Jun 4 08:10:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:20.957340 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf5f25-6ea5-44ff-93bf-a3c95b6e0cd0 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:20.961156 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee82f12-0bd0-4064-9b70-9d57f35b0684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:20.961976 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee82f12-0bd0-4064-9b70-9d57f35b0684 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:20.962255 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee82f12-0bd0-4064-9b70-9d57f35b0684 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:20.962525 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee82f12-0bd0-4064-9b70-9d57f35b0684 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:20.988860 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee82f12-0bd0-4064-9b70-9d57f35b0684 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:10:20.997382 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-5ee82f12-0bd0-4064-9b70-9d57f35b0684 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:10:20.997382 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:20.997382 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:20.997382 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:20.997382 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:20.997382 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:20.997382 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:20.997382 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:20.997382 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:20.997382 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:20.997382 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:20.997382 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:20.997382 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:10:20.997382 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:10:20.997382 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:10:20.997382 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:10:20.998388 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:10:20.998388 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:10:20.998388 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:10:20.998388 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:10:20.998388 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:20.998388 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:20.998388 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:20.998388 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:20.998388 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:20.998388 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:20.998388 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:20.998388 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:20.998388 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:20.998388 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:20.998388 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:20.998388 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:20.999272 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:20.999272 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:20.999272 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:20.999272 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:20.999272 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:10:20.999272 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:10:20.999272 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:10:20.999272 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:10:20.999272 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:10:20.999272 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:10:20.999272 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:10:20.999272 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:20.999916 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 366/733] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:10:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:21.006631 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee82f12-0bd0-4064-9b70-9d57f35b0684 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:21.103107 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf5f25-6ea5-44ff-93bf-a3c95b6e0cd0 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:21.166589 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbb683-d5ec-4ce9-b0dc-6f37ee41d71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:21.167245 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbb683-d5ec-4ce9-b0dc-6f37ee41d71e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:21.167525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbb683-d5ec-4ce9-b0dc-6f37ee41d71e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:21.167797 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbb683-d5ec-4ce9-b0dc-6f37ee41d71e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:21.215548 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee82f12-0bd0-4064-9b70-9d57f35b0684 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:21.242376 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:21.257783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:21.269651 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b9f62-d651-40d0-9182-852a833f54be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:21.270373 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b9f62-d651-40d0-9182-852a833f54be None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:21.270759 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b9f62-d651-40d0-9182-852a833f54be None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:21.271038 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b9f62-d651-40d0-9182-852a833f54be None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:21.271907 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b9f62-d651-40d0-9182-852a833f54be None admin] RBAC: Adding query filter params (name=admin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:21.272215 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b9f62-d651-40d0-9182-852a833f54be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:21.273625 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b9f62-d651-40d0-9182-852a833f54be None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:21.283913 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 367/734] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:10:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:21.285503 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c0ee5-2a82-4607-a98e-bafe84bbd183 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:21.285792 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c0ee5-2a82-4607-a98e-bafe84bbd183 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:21.286089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c0ee5-2a82-4607-a98e-bafe84bbd183 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:21.287023 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fbb683-d5ec-4ce9-b0dc-6f37ee41d71e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:21.289736 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fbb683-d5ec-4ce9-b0dc-6f37ee41d71e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:21.292214 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 368/735] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:21.293234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c0ee5-2a82-4607-a98e-bafe84bbd183 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:21.407793 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c0ee5-2a82-4607-a98e-bafe84bbd183 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:21.425970 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 368/736] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:10:20 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 08:10:21.427315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9995813-9c0e-45e5-840d-f0137e2b9d59 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:21.428047 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9995813-9c0e-45e5-840d-f0137e2b9d59 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:21.428575 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9995813-9c0e-45e5-840d-f0137e2b9d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:21.446095 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e9995813-9c0e-45e5-840d-f0137e2b9d59 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:21.446975 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e9995813-9c0e-45e5-840d-f0137e2b9d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:21.457657 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d25d1-d0e1-44d7-8531-bd83fd603af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:21.458820 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d25d1-d0e1-44d7-8531-bd83fd603af2 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:21.459364 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d25d1-d0e1-44d7-8531-bd83fd603af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:21.459863 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d25d1-d0e1-44d7-8531-bd83fd603af2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:21.471535 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d25d1-d0e1-44d7-8531-bd83fd603af2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:21.473295 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d25d1-d0e1-44d7-8531-bd83fd603af2 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:21.491922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-eb1d25d1-d0e1-44d7-8531-bd83fd603af2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:21.491922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:21.491922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:21.491922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:21.491922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:21.491922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:21.491922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:21.491922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:21.491922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:21.491922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:21.491922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:21.491922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:21.491922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:21.491922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:21.491922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:21.492994 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:21.492994 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:21.492994 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:21.492994 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:21.492994 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:21.492994 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:21.492994 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:21.492994 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:21.492994 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:21.492994 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:21.492994 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:21.492994 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:21.492994 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:21.492994 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:21.492994 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:21.492994 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:21.492994 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:21.493920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:21.493920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:21.493920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:21.493920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:21.496159 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 369/737] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:21.497209 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d25d1-d0e1-44d7-8531-bd83fd603af2 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:21.513635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:21.526847 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 369/738] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:21 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:10:21.527801 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9995813-9c0e-45e5-840d-f0137e2b9d59 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:21.542694 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:21.614369 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d25d1-d0e1-44d7-8531-bd83fd603af2 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:21.650309 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9995813-9c0e-45e5-840d-f0137e2b9d59 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:21.655392 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d13ba-fbe1-493d-9440-6e694233bfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:21.656192 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d13ba-fbe1-493d-9440-6e694233bfd7 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:21.656476 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d13ba-fbe1-493d-9440-6e694233bfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:21.656752 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d13ba-fbe1-493d-9440-6e694233bfd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:21.667914 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d13ba-fbe1-493d-9440-6e694233bfd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:21.669312 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d13ba-fbe1-493d-9440-6e694233bfd7 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:21.686281 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016ba52-4ec4-48bd-8941-c5232991882e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:21.686948 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016ba52-4ec4-48bd-8941-c5232991882e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:21.687229 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016ba52-4ec4-48bd-8941-c5232991882e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:21.687504 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016ba52-4ec4-48bd-8941-c5232991882e None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:21.688185 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-e21d13ba-fbe1-493d-9440-6e694233bfd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:21.688185 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:21.688185 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:21.688185 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:21.688185 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:21.688185 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:21.688185 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:21.688185 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:21.688185 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:21.688185 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:21.688185 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:21.688185 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:21.688185 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:21.688185 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:21.688185 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:21.689050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:21.689050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:21.689050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:21.689050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:21.689050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:21.689050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:21.689050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:21.689050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:21.689050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:21.689050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:21.689050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:21.689050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:21.689050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:21.689050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:21.689050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:21.689050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:21.689050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:21.690557 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:21.690557 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:21.690557 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:21.690557 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:21.690796 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016ba52-4ec4-48bd-8941-c5232991882e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:21.690796 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016ba52-4ec4-48bd-8941-c5232991882e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:21.690796 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016ba52-4ec4-48bd-8941-c5232991882e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:21.694869 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 370/739] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:21.695851 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d13ba-fbe1-493d-9440-6e694233bfd7 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:21.703591 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 370/740] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:21.709232 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552bf28-dc62-401a-b56f-073a858351c0 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:21.709523 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552bf28-dc62-401a-b56f-073a858351c0 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:21.709800 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552bf28-dc62-401a-b56f-073a858351c0 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:21.711129 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 371/741] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:21.715777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552bf28-dc62-401a-b56f-073a858351c0 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:21.778838 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:21.794320 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:21.804304 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d13ba-fbe1-493d-9440-6e694233bfd7 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:21.827016 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552bf28-dc62-401a-b56f-073a858351c0 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:21.839297 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d5ccc-ba14-4886-b116-7716deaa2bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:21.840093 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d5ccc-ba14-4886-b116-7716deaa2bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:21.840376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d5ccc-ba14-4886-b116-7716deaa2bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:21.840650 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d5ccc-ba14-4886-b116-7716deaa2bc7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:21.851774 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d5ccc-ba14-4886-b116-7716deaa2bc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:10:21.859464 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-c38d5ccc-ba14-4886-b116-7716deaa2bc7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:10:21.859464 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:21.859464 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:21.859464 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:21.859464 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:21.859464 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:21.859464 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:21.859464 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:21.859464 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:21.859464 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:21.859464 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:21.859464 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:21.859464 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:10:21.859464 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:10:21.859464 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:10:21.859464 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:10:21.860631 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:10:21.860631 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:10:21.860631 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:10:21.860631 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:10:21.860631 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:21.860631 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:21.860631 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:21.860631 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:21.860631 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:21.860631 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:21.860631 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:21.860631 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:21.860631 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:21.860631 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:21.860631 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:21.860631 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:21.862084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:21.862084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:21.862084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:21.862084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:21.862084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:10:21.862084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:10:21.862084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:10:21.862084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:10:21.862084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:10:21.862084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:10:21.862084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:10:21.862084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:21.862084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 371/742] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jun 4 08:10:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:21.862084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d5ccc-ba14-4886-b116-7716deaa2bc7 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:21.866107 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30311779-5eec-4feb-81f9-94cff903513e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:21.866764 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30311779-5eec-4feb-81f9-94cff903513e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:21.867042 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30311779-5eec-4feb-81f9-94cff903513e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:21.867462 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30311779-5eec-4feb-81f9-94cff903513e None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:21.868031 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30311779-5eec-4feb-81f9-94cff903513e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:21.869106 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30311779-5eec-4feb-81f9-94cff903513e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:21.869705 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30311779-5eec-4feb-81f9-94cff903513e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:21.885655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 372/743] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:21.885655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4a1a2-7f6f-4c76-a51c-11f4d1c1dfd4 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:21.885655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4a1a2-7f6f-4c76-a51c-11f4d1c1dfd4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:21.885655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4a1a2-7f6f-4c76-a51c-11f4d1c1dfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:21.899609 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-04a4a1a2-7f6f-4c76-a51c-11f4d1c1dfd4 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:21.900772 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-04a4a1a2-7f6f-4c76-a51c-11f4d1c1dfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:21.977050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d5ccc-ba14-4886-b116-7716deaa2bc7 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:21.986856 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 373/744] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:21 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 08:10:21.987445 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4a1a2-7f6f-4c76-a51c-11f4d1c1dfd4 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:22.015391 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac823d-2de1-49f9-a67c-a7851492ce71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:22.016219 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac823d-2de1-49f9-a67c-a7851492ce71 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:22.016505 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac823d-2de1-49f9-a67c-a7851492ce71 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:22.016777 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac823d-2de1-49f9-a67c-a7851492ce71 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:22.025098 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac823d-2de1-49f9-a67c-a7851492ce71 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:22.026575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac823d-2de1-49f9-a67c-a7851492ce71 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:22.039305 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:22.042602 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-85ac823d-2de1-49f9-a67c-a7851492ce71 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 08:10:22.042602 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:22.042602 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:22.042602 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:22.042602 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:22.042602 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:22.042602 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:22.042602 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:22.042602 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:22.042602 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:22.042602 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:22.042602 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:22.042602 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:10:22.042602 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:10:22.042602 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:10:22.042602 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:10:22.043712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:22.043712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:22.043712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:10:22.043712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:22.043712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:10:22.043712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:22.043712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:22.043712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:22.043712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:22.043712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:22.043712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:22.043712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:22.043712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:22.043712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:22.043712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:22.043712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:22.043712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:22.043712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:22.044695 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:22.044695 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:22.044695 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:10:22.044695 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:10:22.044695 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:10:22.044695 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:10:22.044695 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:10:22.044695 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:10:22.044695 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 08:10:22.044695 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:22.044695 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 372/745] 10.222.0.57 () {56 vars in 1093 bytes} [Sat Jun 4 08:10:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:22.045308 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac823d-2de1-49f9-a67c-a7851492ce71 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:22.061004 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:22.100351 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4a1a2-7f6f-4c76-a51c-11f4d1c1dfd4 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:22.137494 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2174b-2987-4b3c-90eb-67fa93e14baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:22.138319 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2174b-2987-4b3c-90eb-67fa93e14baf None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:22.138755 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2174b-2987-4b3c-90eb-67fa93e14baf None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:22.139035 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2174b-2987-4b3c-90eb-67fa93e14baf None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:22.139775 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2174b-2987-4b3c-90eb-67fa93e14baf None admin] RBAC: Adding query filter params (name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:22.140079 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2174b-2987-4b3c-90eb-67fa93e14baf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:22.141587 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2174b-2987-4b3c-90eb-67fa93e14baf None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:22.148769 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac823d-2de1-49f9-a67c-a7851492ce71 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:22.150753 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 374/746] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jun 4 08:10:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:22.151582 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2174b-2987-4b3c-90eb-67fa93e14baf None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:22.188172 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb094d47-23e4-451f-bd91-e8cb47c30103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:22.188968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb094d47-23e4-451f-bd91-e8cb47c30103 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:22.189251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb094d47-23e4-451f-bd91-e8cb47c30103 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:22.190096 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb094d47-23e4-451f-bd91-e8cb47c30103 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:22.196883 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb094d47-23e4-451f-bd91-e8cb47c30103 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:22.198375 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb094d47-23e4-451f-bd91-e8cb47c30103 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:22.213699 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-eb094d47-23e4-451f-bd91-e8cb47c30103 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:22.213699 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:22.213699 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:22.213699 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:22.213699 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:22.213699 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:22.213699 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:22.213699 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:22.213699 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:22.213699 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:22.213699 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:22.213699 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:22.213699 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:10:22.213699 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:10:22.213699 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:10:22.214985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:10:22.214985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:22.214985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:22.214985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:22.214985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:22.214985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:22.214985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:22.214985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:22.214985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:22.214985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:22.214985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:22.214985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:22.214985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:22.214985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:22.214985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:22.214985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:22.214985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:22.216120 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:10:22.216120 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:10:22.216120 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:10:22.216120 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:10:22.216120 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:10:22.216120 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:10:22.216120 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:22.216120 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:22.219557 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 373/747] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:10:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:22.220298 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb094d47-23e4-451f-bd91-e8cb47c30103 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:22.266338 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2174b-2987-4b3c-90eb-67fa93e14baf None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:22.277569 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:22.294320 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:22.306873 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36681e4f-a13c-44c1-b4a8-3ed33440f660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:22.307542 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36681e4f-a13c-44c1-b4a8-3ed33440f660 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:22.307822 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36681e4f-a13c-44c1-b4a8-3ed33440f660 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:22.308150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36681e4f-a13c-44c1-b4a8-3ed33440f660 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:22.308886 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36681e4f-a13c-44c1-b4a8-3ed33440f660 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:22.310369 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36681e4f-a13c-44c1-b4a8-3ed33440f660 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:22.327867 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb094d47-23e4-451f-bd91-e8cb47c30103 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:22.338191 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 375/748] 10.222.0.57 () {60 vars in 1141 bytes} [Sat Jun 4 08:10:22 2022] POST /identity/v3/services => generated 240 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:10:22.339000 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36681e4f-a13c-44c1-b4a8-3ed33440f660 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:22.382576 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2fa25-321d-418b-b4af-d603a1636904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:22.383578 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2fa25-321d-418b-b4af-d603a1636904 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:22.384232 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2fa25-321d-418b-b4af-d603a1636904 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:22.384486 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2fa25-321d-418b-b4af-d603a1636904 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:22.385665 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2fa25-321d-418b-b4af-d603a1636904 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:22.386134 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2fa25-321d-418b-b4af-d603a1636904 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:22.388061 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2fa25-321d-418b-b4af-d603a1636904 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:22.411142 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 374/749] 10.222.0.57 () {56 vars in 1133 bytes} [Sat Jun 4 08:10:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:22.412248 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2fa25-321d-418b-b4af-d603a1636904 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:22.484174 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36681e4f-a13c-44c1-b4a8-3ed33440f660 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:22.527642 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced0b47-cd4a-4993-b3e3-cf744e76a717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:22.528687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced0b47-cd4a-4993-b3e3-cf744e76a717 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:22.529098 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced0b47-cd4a-4993-b3e3-cf744e76a717 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:22.529465 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced0b47-cd4a-4993-b3e3-cf744e76a717 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:22.542602 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced0b47-cd4a-4993-b3e3-cf744e76a717 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:22.544086 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced0b47-cd4a-4993-b3e3-cf744e76a717 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:22.561895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2fa25-321d-418b-b4af-d603a1636904 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:22.566048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-3ced0b47-cd4a-4993-b3e3-cf744e76a717 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:22.566048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:22.566048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:22.566048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:22.566048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:22.566048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:22.566048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:22.566048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:22.566048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:22.566048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:22.566048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:22.566048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:22.566048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:22.566048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:22.566048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:22.566930 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:22.566930 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:22.566930 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:22.566930 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:22.566930 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:22.566930 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:22.566930 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:22.566930 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:22.566930 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:22.566930 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:22.566930 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:22.566930 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:22.566930 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:22.566930 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:22.566930 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:22.566930 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:22.566930 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:22.567852 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:22.567852 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:22.567852 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:22.567852 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:22.567852 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 376/750] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:22.568550 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced0b47-cd4a-4993-b3e3-cf744e76a717 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:22.601925 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:22.602579 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:22.620065 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45491b22-49d8-489d-bfa8-49b0e9eb1ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:22.621420 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45491b22-49d8-489d-bfa8-49b0e9eb1ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:22.621922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45491b22-49d8-489d-bfa8-49b0e9eb1ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:22.622312 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45491b22-49d8-489d-bfa8-49b0e9eb1ad1 None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:22.623659 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45491b22-49d8-489d-bfa8-49b0e9eb1ad1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:22.624066 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45491b22-49d8-489d-bfa8-49b0e9eb1ad1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:22.626366 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45491b22-49d8-489d-bfa8-49b0e9eb1ad1 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:22.642608 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 375/751] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:10:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:22.644243 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45491b22-49d8-489d-bfa8-49b0e9eb1ad1 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:22.695390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced0b47-cd4a-4993-b3e3-cf744e76a717 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:22.737374 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405232c3-98aa-4a43-8568-39ea6484ddfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:22.738214 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405232c3-98aa-4a43-8568-39ea6484ddfb None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:22.738498 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405232c3-98aa-4a43-8568-39ea6484ddfb None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:22.738773 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405232c3-98aa-4a43-8568-39ea6484ddfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:22.749764 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405232c3-98aa-4a43-8568-39ea6484ddfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:22.751248 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405232c3-98aa-4a43-8568-39ea6484ddfb None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:22.770205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-405232c3-98aa-4a43-8568-39ea6484ddfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:22.770205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:22.770205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:22.770205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:22.770205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:22.770205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:22.770205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:22.770205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:22.770205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:22.770205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:22.770205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:22.770205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:22.770205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:22.770205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:22.770205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:22.771171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:22.771171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:22.771171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:22.771171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:22.771171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:22.771171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:22.771171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:22.771171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:22.771171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:22.771171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:22.771171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:22.771171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:22.771171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:22.771171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:22.771171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:22.771171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:22.771171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:22.772084 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:22.772084 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:22.772084 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:22.772084 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:22.772979 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 377/752] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:22.773849 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405232c3-98aa-4a43-8568-39ea6484ddfb None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:22.777438 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45491b22-49d8-489d-bfa8-49b0e9eb1ad1 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:22.820810 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b8e1e-ed60-4d4e-b916-2d1805170006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:22.821749 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b8e1e-ed60-4d4e-b916-2d1805170006 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:22.822245 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b8e1e-ed60-4d4e-b916-2d1805170006 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:22.822729 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b8e1e-ed60-4d4e-b916-2d1805170006 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:22.823527 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b8e1e-ed60-4d4e-b916-2d1805170006 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:22.823835 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b8e1e-ed60-4d4e-b916-2d1805170006 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:22.825213 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b8e1e-ed60-4d4e-b916-2d1805170006 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:22.838045 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 376/753] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:22.839322 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcadcfe-6ac8-42f4-b14d-dcec3b15c41c None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:22.839607 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcadcfe-6ac8-42f4-b14d-dcec3b15c41c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:22.839884 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcadcfe-6ac8-42f4-b14d-dcec3b15c41c None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:22.845373 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 377/754] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:22.845373 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcadcfe-6ac8-42f4-b14d-dcec3b15c41c None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:22.865374 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:22.891686 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405232c3-98aa-4a43-8568-39ea6484ddfb None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:22.894992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:22.930044 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c994c-812f-42e9-848b-2b9eda68a9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:22.930816 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c994c-812f-42e9-848b-2b9eda68a9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:22.931162 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c994c-812f-42e9-848b-2b9eda68a9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:22.931504 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c994c-812f-42e9-848b-2b9eda68a9b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:22.932398 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c994c-812f-42e9-848b-2b9eda68a9b7 None admin] RBAC: Adding query filter params (role.id=431cef539cfb476aad50d2470e763b5f, scope.project.id=634c9a1745ef44c0ad66e02493d79af0, user.id=05ea412cab4244c58a2670c66f5a311c) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:22.932771 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c994c-812f-42e9-848b-2b9eda68a9b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:22.934399 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c994c-812f-42e9-848b-2b9eda68a9b7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:22.940017 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 378/755] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:10:22 2022] GET /identity/v3/role_assignments?user.id=05ea412cab4244c58a2670c66f5a311c&scope.project.id=634c9a1745ef44c0ad66e02493d79af0&role.id=431cef539cfb476aad50d2470e763b5f => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:22.940528 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c994c-812f-42e9-848b-2b9eda68a9b7 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:22.979924 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcadcfe-6ac8-42f4-b14d-dcec3b15c41c None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:23.031633 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b7610-e691-4c72-a14b-49ae39dd3585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:23.032314 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b7610-e691-4c72-a14b-49ae39dd3585 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:23.032594 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b7610-e691-4c72-a14b-49ae39dd3585 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:23.034008 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b7610-e691-4c72-a14b-49ae39dd3585 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:23.034774 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b7610-e691-4c72-a14b-49ae39dd3585 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:23.035080 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b7610-e691-4c72-a14b-49ae39dd3585 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:23.037275 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b7610-e691-4c72-a14b-49ae39dd3585 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:23.055130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 378/756] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:23.056579 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bfbeb-4ec6-4a7a-a9bc-d9145aecb8b2 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:23.056869 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bfbeb-4ec6-4a7a-a9bc-d9145aecb8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:23.057146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bfbeb-4ec6-4a7a-a9bc-d9145aecb8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:23.066291 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c994c-812f-42e9-848b-2b9eda68a9b7 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:23.079567 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-ab6bfbeb-4ec6-4a7a-a9bc-d9145aecb8b2 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:23.081282 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ab6bfbeb-4ec6-4a7a-a9bc-d9145aecb8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:23.113159 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2da25b-bfe2-4f6e-870f-84a59771737d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:23.114384 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2da25b-bfe2-4f6e-870f-84a59771737d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:23.115170 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2da25b-bfe2-4f6e-870f-84a59771737d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:23.115451 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2da25b-bfe2-4f6e-870f-84a59771737d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:23.126852 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2da25b-bfe2-4f6e-870f-84a59771737d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:23.129401 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2da25b-bfe2-4f6e-870f-84a59771737d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:23.131466 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:23.150236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-2b2da25b-bfe2-4f6e-870f-84a59771737d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 08:10:23.150236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:23.150236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:23.150236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:23.150236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:23.150236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:23.150236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:23.150236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:23.150236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:23.150236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:23.150236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:23.150236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:23.150236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:10:23.150236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:10:23.150236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:10:23.150236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:10:23.151425 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:23.151425 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:23.151425 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:10:23.151425 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:23.151425 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:10:23.151425 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:23.151425 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:23.151425 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:23.151425 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:23.151425 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:23.151425 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:23.151425 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:23.151425 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:23.151425 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:23.151425 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:23.151425 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:23.151425 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:23.151425 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:23.152762 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:23.152762 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:23.152762 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:10:23.152762 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:10:23.152762 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:10:23.152762 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:10:23.152762 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:10:23.152762 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:10:23.152762 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 08:10:23.152762 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:23.152762 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 379/757] 10.222.0.57 () {56 vars in 1117 bytes} [Sat Jun 4 08:10:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:23.156903 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2da25b-bfe2-4f6e-870f-84a59771737d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:23.168728 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 379/758] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:10:23.169741 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bfbeb-4ec6-4a7a-a9bc-d9145aecb8b2 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:23.205998 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:23.265542 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2da25b-bfe2-4f6e-870f-84a59771737d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:23.275821 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bfbeb-4ec6-4a7a-a9bc-d9145aecb8b2 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:23.306303 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044300d-482a-4192-94a0-406231249f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:23.307346 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044300d-482a-4192-94a0-406231249f84 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:23.307634 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044300d-482a-4192-94a0-406231249f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:23.308302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044300d-482a-4192-94a0-406231249f84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:23.316401 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3044300d-482a-4192-94a0-406231249f84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:23.317224 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bea78b-d207-48bf-b89a-d2730cd9c3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:23.317943 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3044300d-482a-4192-94a0-406231249f84 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:23.318072 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bea78b-d207-48bf-b89a-d2730cd9c3fc None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:23.318226 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bea78b-d207-48bf-b89a-d2730cd9c3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:23.318675 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bea78b-d207-48bf-b89a-d2730cd9c3fc None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:23.319513 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bea78b-d207-48bf-b89a-d2730cd9c3fc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:23.319872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bea78b-d207-48bf-b89a-d2730cd9c3fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:23.321319 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bea78b-d207-48bf-b89a-d2730cd9c3fc None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:23.333126 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-3044300d-482a-4192-94a0-406231249f84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:23.333126 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:23.333126 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:23.333126 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:23.333126 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:23.333126 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:23.333126 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:23.333126 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:23.333126 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:23.333126 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:23.333126 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:23.333126 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:23.333126 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:10:23.333126 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:10:23.333126 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:10:23.334223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:10:23.334223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:23.334223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:23.334223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:23.334223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:23.334223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:23.334223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:23.334223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:23.334223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:23.334223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:23.334223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:23.334223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:23.334223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:23.334223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:23.334223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:23.334223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:23.334223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:23.335362 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:10:23.335362 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:10:23.335362 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:10:23.335362 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:10:23.335362 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:10:23.335362 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:10:23.335362 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:23.335362 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:23.335362 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 380/759] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:10:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:23.335919 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044300d-482a-4192-94a0-406231249f84 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:23.343792 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 380/760] 10.222.0.57 () {56 vars in 1149 bytes} [Sat Jun 4 08:10:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:23.344678 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bea78b-d207-48bf-b89a-d2730cd9c3fc None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:23.397645 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:23.444690 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:23.445253 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044300d-482a-4192-94a0-406231249f84 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:23.454300 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bea78b-d207-48bf-b89a-d2730cd9c3fc None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:23.488871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc11154-ee56-4820-859f-d996baee5b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:23.489685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc11154-ee56-4820-859f-d996baee5b7c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:23.490000 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc11154-ee56-4820-859f-d996baee5b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:23.490276 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc11154-ee56-4820-859f-d996baee5b7c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:23.490934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc11154-ee56-4820-859f-d996baee5b7c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:23.492326 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc11154-ee56-4820-859f-d996baee5b7c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:23.492593 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc37a9e-1eaa-465c-8512-6d1f812ce76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:23.493551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc37a9e-1eaa-465c-8512-6d1f812ce76a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:23.493997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc37a9e-1eaa-465c-8512-6d1f812ce76a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:23.494406 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc37a9e-1eaa-465c-8512-6d1f812ce76a None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:23.495332 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc37a9e-1eaa-465c-8512-6d1f812ce76a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:23.495790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc37a9e-1eaa-465c-8512-6d1f812ce76a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:23.497346 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc37a9e-1eaa-465c-8512-6d1f812ce76a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:23.505205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-6bc11154-ee56-4820-859f-d996baee5b7c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 08:10:23.505205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:23.505205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 08:10:23.505205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 08:10:23.505205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 08:10:23.505205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 08:10:23.505205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 08:10:23.505205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:23.505205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 08:10:23.505205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:23.505205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 08:10:23.505205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:23.505205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:23.505205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:23.505205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:23.505205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:23.506312 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:23.506312 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:23.506312 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:23.506312 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:23.506312 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:23.506312 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:23.506312 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:23.506312 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 08:10:23.506312 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 08:10:23.506312 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 08:10:23.506312 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 08:10:23.506312 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:23.506312 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:23.506312 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:23.506312 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:23.506312 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:23.507337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:23.507337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:23.507337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:23.507337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:23.507337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:23.507337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:23.507337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:23.507337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:23.507337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:23.507337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:23.507337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:23.507337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 08:10:23.507337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:23.507337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 08:10:23.507337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:23.507337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 381/761] 10.222.0.57 () {56 vars in 1129 bytes} [Sat Jun 4 08:10:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:23.508440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc11154-ee56-4820-859f-d996baee5b7c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:23.514418 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 381/762] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:10:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:23.521877 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc37a9e-1eaa-465c-8512-6d1f812ce76a None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:23.623555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc11154-ee56-4820-859f-d996baee5b7c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:23.651295 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:23.662502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc37a9e-1eaa-465c-8512-6d1f812ce76a None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:23.667422 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa5d6f-8eda-42dc-afec-8dedfe597183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:23.668256 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa5d6f-8eda-42dc-afec-8dedfe597183 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:23.668685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa5d6f-8eda-42dc-afec-8dedfe597183 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:23.669114 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa5d6f-8eda-42dc-afec-8dedfe597183 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:23.707575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4909cc-a0d0-4af7-b6c5-b644d07bf685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:23.708668 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4909cc-a0d0-4af7-b6c5-b644d07bf685 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:23.709056 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4909cc-a0d0-4af7-b6c5-b644d07bf685 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:23.709498 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4909cc-a0d0-4af7-b6c5-b644d07bf685 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:23.710900 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4909cc-a0d0-4af7-b6c5-b644d07bf685 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:23.711288 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4909cc-a0d0-4af7-b6c5-b644d07bf685 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:23.713027 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4909cc-a0d0-4af7-b6c5-b644d07bf685 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:23.721980 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 382/763] 10.222.0.57 () {56 vars in 1124 bytes} [Sat Jun 4 08:10:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:23.723054 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4909cc-a0d0-4af7-b6c5-b644d07bf685 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:23.753253 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:23.764148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa5d6f-8eda-42dc-afec-8dedfe597183 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:23.766580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa5d6f-8eda-42dc-afec-8dedfe597183 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:23.853555 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4909cc-a0d0-4af7-b6c5-b644d07bf685 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:23.888830 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6d375-235e-4d9f-bce6-e9231ea0e546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:23.889520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 382/764] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:10:23 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 08:10:23.890373 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6d375-235e-4d9f-bce6-e9231ea0e546 None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:23.890498 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa5d6f-8eda-42dc-afec-8dedfe597183 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:23.890942 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6d375-235e-4d9f-bce6-e9231ea0e546 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:23.891393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6d375-235e-4d9f-bce6-e9231ea0e546 None admin] PATH_INFO: `/v3/projects/634c9a1745ef44c0ad66e02493d79af0/users/7e64d002241242928936dd0d991ecdc1/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:23.893731 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6d375-235e-4d9f-bce6-e9231ea0e546 None admin] RBAC: Authorizing `identity:create_grant(project_id=634c9a1745ef44c0ad66e02493d79af0, user_id=7e64d002241242928936dd0d991ecdc1, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:23.895417 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6d375-235e-4d9f-bce6-e9231ea0e546 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:23.919968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 383/765] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jun 4 08:10:23 2022] PUT /identity/v3/projects/634c9a1745ef44c0ad66e02493d79af0/users/7e64d002241242928936dd0d991ecdc1/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:10:23.920617 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6d375-235e-4d9f-bce6-e9231ea0e546 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:23.929474 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:24.029062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa5d6f-8eda-42dc-afec-8dedfe597183 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:24.073934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b195b-f284-4759-9787-d3a4afb0c7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:24.075144 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b195b-f284-4759-9787-d3a4afb0c7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:24.075894 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b195b-f284-4759-9787-d3a4afb0c7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:24.076373 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b195b-f284-4759-9787-d3a4afb0c7a6 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:24.077290 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b195b-f284-4759-9787-d3a4afb0c7a6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:24.077941 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b195b-f284-4759-9787-d3a4afb0c7a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:24.080353 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b195b-f284-4759-9787-d3a4afb0c7a6 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:24.086520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 383/766] 10.222.0.57 () {56 vars in 1124 bytes} [Sat Jun 4 08:10:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:24.096290 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b195b-f284-4759-9787-d3a4afb0c7a6 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:24.134292 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:24.169036 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6d375-235e-4d9f-bce6-e9231ea0e546 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:24.212165 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47ab7c-e89f-4c54-910f-cafa92d24f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:24.213247 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47ab7c-e89f-4c54-910f-cafa92d24f2f None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:24.213539 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47ab7c-e89f-4c54-910f-cafa92d24f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:24.213892 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47ab7c-e89f-4c54-910f-cafa92d24f2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:24.230910 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47ab7c-e89f-4c54-910f-cafa92d24f2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:24.232876 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47ab7c-e89f-4c54-910f-cafa92d24f2f None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:24.255252 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:24.260784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-4e47ab7c-e89f-4c54-910f-cafa92d24f2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:24.260784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:24.260784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:24.260784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:24.260784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:24.260784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:24.260784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:24.260784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:24.260784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:24.260784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:24.260784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:24.260784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:24.260784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:24.260784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:24.260784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:24.262376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:24.262376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:24.262376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:24.262376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:24.262376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:24.262376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:24.262376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:24.262376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:24.262376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:24.262376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:24.262376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:24.262376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:24.262376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:24.262376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:24.262376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:24.262376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:24.262376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:24.263367 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:24.263367 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:24.263367 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:24.263367 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:24.263367 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 384/767] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:24.274877 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47ab7c-e89f-4c54-910f-cafa92d24f2f None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:24.285136 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b195b-f284-4759-9787-d3a4afb0c7a6 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:24.350105 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57930743-cc59-4662-83e3-42ba7d76482b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:24.350827 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57930743-cc59-4662-83e3-42ba7d76482b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:24.351104 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57930743-cc59-4662-83e3-42ba7d76482b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:24.351377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57930743-cc59-4662-83e3-42ba7d76482b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:24.352199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57930743-cc59-4662-83e3-42ba7d76482b None admin] RBAC: Adding query filter params (interface=public, service_id=95fb06895e3247e18245eb21237a69ad, region_id=RegionOne) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:24.352510 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57930743-cc59-4662-83e3-42ba7d76482b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:24.355128 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57930743-cc59-4662-83e3-42ba7d76482b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:24.366150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 384/768] 10.222.0.57 () {56 vars in 1251 bytes} [Sat Jun 4 08:10:24 2022] GET /identity/v3/endpoints?service_id=95fb06895e3247e18245eb21237a69ad&interface=public®ion_id=RegionOne => generated 194 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:24.372659 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57930743-cc59-4662-83e3-42ba7d76482b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:24.436285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47ab7c-e89f-4c54-910f-cafa92d24f2f None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:24.490202 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:24.500050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd6ba4-f43d-4dd9-a6f6-57b498fb5e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:24.500738 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd6ba4-f43d-4dd9-a6f6-57b498fb5e07 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:24.501016 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd6ba4-f43d-4dd9-a6f6-57b498fb5e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:24.501290 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd6ba4-f43d-4dd9-a6f6-57b498fb5e07 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:24.502093 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd6ba4-f43d-4dd9-a6f6-57b498fb5e07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:24.502389 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd6ba4-f43d-4dd9-a6f6-57b498fb5e07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:24.503801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd6ba4-f43d-4dd9-a6f6-57b498fb5e07 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:24.533888 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 385/769] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:24.554744 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd6ba4-f43d-4dd9-a6f6-57b498fb5e07 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:24.580765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57930743-cc59-4662-83e3-42ba7d76482b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:24.636525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be70b7-fc93-4368-9533-04a453ae268a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:24.637199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be70b7-fc93-4368-9533-04a453ae268a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:24.637464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be70b7-fc93-4368-9533-04a453ae268a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:24.637721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be70b7-fc93-4368-9533-04a453ae268a None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:24.638424 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be70b7-fc93-4368-9533-04a453ae268a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:24.639806 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be70b7-fc93-4368-9533-04a453ae268a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:24.650362 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 385/770] 10.222.0.57 () {56 vars in 1087 bytes} [Sat Jun 4 08:10:24 2022] GET /identity/v3/services => generated 772 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:24.717567 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd6ba4-f43d-4dd9-a6f6-57b498fb5e07 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:24.761356 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c34943-d763-4d52-a8eb-4c80aabe48b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:24.762192 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c34943-d763-4d52-a8eb-4c80aabe48b2 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:24.762477 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c34943-d763-4d52-a8eb-4c80aabe48b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:24.762751 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c34943-d763-4d52-a8eb-4c80aabe48b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:24.773131 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c34943-d763-4d52-a8eb-4c80aabe48b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:24.774641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c34943-d763-4d52-a8eb-4c80aabe48b2 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:24.792621 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-d9c34943-d763-4d52-a8eb-4c80aabe48b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:24.792621 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:24.792621 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:24.792621 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:24.792621 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:24.792621 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:24.792621 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:24.792621 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:24.792621 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:24.792621 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:24.792621 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:24.792621 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:24.792621 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:10:24.792621 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:10:24.792621 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:10:24.793624 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:10:24.793624 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:24.793624 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:24.793624 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:24.793624 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:24.793624 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:24.793624 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:24.793624 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:24.793624 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:24.793624 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:24.793624 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:24.793624 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:24.793624 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:24.793624 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:24.793624 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:24.793624 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:24.793624 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:24.794587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:10:24.794587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:10:24.794587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:10:24.794587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:10:24.794587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:10:24.794587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:10:24.794587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:24.794587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:24.794587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 386/771] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:10:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:10:24.802970 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be70b7-fc93-4368-9533-04a453ae268a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:24.829993 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:24.853095 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd8c83-2193-447a-b554-6db8e76adbbd None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:24.853418 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd8c83-2193-447a-b554-6db8e76adbbd None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:24.853658 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd8c83-2193-447a-b554-6db8e76adbbd None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:24.855606 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 387/772] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:24.861915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b369563-764b-4907-b807-d869f247ebc4 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:24.862210 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b369563-764b-4907-b807-d869f247ebc4 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:24.862491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b369563-764b-4907-b807-d869f247ebc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:24.902746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-8b369563-764b-4907-b807-d869f247ebc4 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:24.904016 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8b369563-764b-4907-b807-d869f247ebc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:24.956554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be70b7-fc93-4368-9533-04a453ae268a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:25.003472 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:25.014535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e5fe7-55db-4514-ac66-f2880a7fa98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:25.015876 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e5fe7-55db-4514-ac66-f2880a7fa98e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:25.016676 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e5fe7-55db-4514-ac66-f2880a7fa98e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:25.017196 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e5fe7-55db-4514-ac66-f2880a7fa98e None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:25.019130 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e5fe7-55db-4514-ac66-f2880a7fa98e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:25.019709 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e5fe7-55db-4514-ac66-f2880a7fa98e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:25.022554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e5fe7-55db-4514-ac66-f2880a7fa98e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:25.033859 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 388/773] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:10:25.045513 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 386/774] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:10:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:25.052319 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b369563-764b-4907-b807-d869f247ebc4 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:25.062331 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e5fe7-55db-4514-ac66-f2880a7fa98e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:25.160833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:25.183337 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b369563-764b-4907-b807-d869f247ebc4 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:25.187191 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e5fe7-55db-4514-ac66-f2880a7fa98e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:25.222878 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83feb4-4812-481e-bb16-732869ab12dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:25.223680 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83feb4-4812-481e-bb16-732869ab12dd None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:25.223957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83feb4-4812-481e-bb16-732869ab12dd None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:25.224228 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83feb4-4812-481e-bb16-732869ab12dd None admin] PATH_INFO: `/v3/services/network` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:25.230007 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83feb4-4812-481e-bb16-732869ab12dd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:25.230007 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83feb4-4812-481e-bb16-732869ab12dd None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:25.242824 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc05312-f065-4a2c-924e-94ea2be445cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:25.243717 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc05312-f065-4a2c-924e-94ea2be445cd None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:25.244139 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc05312-f065-4a2c-924e-94ea2be445cd None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:25.244585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc05312-f065-4a2c-924e-94ea2be445cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:25.245559 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc05312-f065-4a2c-924e-94ea2be445cd None admin] RBAC: Adding query filter params (role.id=c9ec7276464a4d87ab2b6fc52a3bfeae, scope.project.id=634c9a1745ef44c0ad66e02493d79af0, user.id=aff5d82384e84b669eeb00089ab8e09a) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:25.246030 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc05312-f065-4a2c-924e-94ea2be445cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:25.247650 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc05312-f065-4a2c-924e-94ea2be445cd None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:25.251113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-8c83feb4-4812-481e-bb16-732869ab12dd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 08:10:25.251113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:25.251113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 08:10:25.251113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 08:10:25.251113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 08:10:25.251113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 08:10:25.251113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 08:10:25.251113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:25.251113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 08:10:25.251113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:25.251113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 08:10:25.251113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:25.251113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:25.251113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:25.251113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:25.251113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:25.251113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:25.252321 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:25.252321 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:25.252321 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:25.252321 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:25.252321 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:25.252321 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:25.252321 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 08:10:25.252321 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 08:10:25.252321 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 08:10:25.252321 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 08:10:25.252321 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:25.252321 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:25.252321 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:25.252321 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:25.252321 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:25.252321 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:25.253315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:25.253315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:25.253315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:25.253315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:25.253315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:25.253315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:25.253315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:25.253315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:25.253315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:25.253315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:25.253315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 08:10:25.253315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:25.253315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 08:10:25.253315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:25.258659 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 389/775] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:10:25 2022] GET /identity/v3/role_assignments?user.id=aff5d82384e84b669eeb00089ab8e09a&scope.project.id=634c9a1745ef44c0ad66e02493d79af0&role.id=c9ec7276464a4d87ab2b6fc52a3bfeae => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:25.264297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 387/776] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:10:25 2022] GET /identity/v3/services/network => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:25.265578 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc05312-f065-4a2c-924e-94ea2be445cd None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:25.333437 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:25.369815 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4d567-955d-4f25-86bc-6c12b1073bd9 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:25.370129 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4d567-955d-4f25-86bc-6c12b1073bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:25.370413 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4d567-955d-4f25-86bc-6c12b1073bd9 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:25.371971 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 388/777] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:25.377407 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e38508-3152-45ba-b012-e55a5aba1d15 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:25.377712 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e38508-3152-45ba-b012-e55a5aba1d15 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:25.378000 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e38508-3152-45ba-b012-e55a5aba1d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:25.404540 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc05312-f065-4a2c-924e-94ea2be445cd None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:25.418957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-18e38508-3152-45ba-b012-e55a5aba1d15 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:25.420227 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-18e38508-3152-45ba-b012-e55a5aba1d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:25.448109 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e83981-0758-4c67-aabd-d8ce181db636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:25.449297 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e83981-0758-4c67-aabd-d8ce181db636 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:25.449766 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e83981-0758-4c67-aabd-d8ce181db636 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:25.450248 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e83981-0758-4c67-aabd-d8ce181db636 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:25.451226 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e83981-0758-4c67-aabd-d8ce181db636 None admin] RBAC: Adding query filter params (name=network) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:25.451766 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e83981-0758-4c67-aabd-d8ce181db636 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:25.453445 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e83981-0758-4c67-aabd-d8ce181db636 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:25.460434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 390/778] 10.222.0.57 () {56 vars in 1112 bytes} [Sat Jun 4 08:10:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:25.471506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e83981-0758-4c67-aabd-d8ce181db636 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:25.559642 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 389/779] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 08:10:25.585272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e38508-3152-45ba-b012-e55a5aba1d15 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:25.600160 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e83981-0758-4c67-aabd-d8ce181db636 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:25.635489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:25.639402 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac219ac0-13f4-44bc-b713-501cf2ce9021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:25.640084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac219ac0-13f4-44bc-b713-501cf2ce9021 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:25.640369 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac219ac0-13f4-44bc-b713-501cf2ce9021 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:25.640649 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac219ac0-13f4-44bc-b713-501cf2ce9021 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:25.641372 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac219ac0-13f4-44bc-b713-501cf2ce9021 None admin] RBAC: Adding query filter params (type=network) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:25.641689 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac219ac0-13f4-44bc-b713-501cf2ce9021 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:25.643858 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac219ac0-13f4-44bc-b713-501cf2ce9021 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:25.653970 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 391/780] 10.222.0.57 () {56 vars in 1112 bytes} [Sat Jun 4 08:10:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:25.655922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac219ac0-13f4-44bc-b713-501cf2ce9021 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:25.670698 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:25.708587 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e38508-3152-45ba-b012-e55a5aba1d15 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:25.743536 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c34fd6-fb80-4ff0-9ac5-192eef9733a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:25.744345 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c34fd6-fb80-4ff0-9ac5-192eef9733a0 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:25.744613 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c34fd6-fb80-4ff0-9ac5-192eef9733a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:25.744918 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c34fd6-fb80-4ff0-9ac5-192eef9733a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:25.756144 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c34fd6-fb80-4ff0-9ac5-192eef9733a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:10:25.763992 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-69c34fd6-fb80-4ff0-9ac5-192eef9733a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:10:25.763992 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:25.763992 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:25.763992 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:25.763992 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:25.763992 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:25.763992 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:25.763992 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:25.763992 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:25.763992 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:25.763992 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:25.763992 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:25.763992 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:10:25.763992 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:10:25.763992 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:10:25.763992 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:10:25.765097 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:10:25.765097 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:10:25.765097 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:10:25.765097 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:10:25.765097 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:25.765097 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:25.765097 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:25.765097 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:25.765097 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:25.765097 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:25.765097 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:25.765097 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:25.765097 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:25.765097 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:25.765097 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:25.765097 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:25.766135 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:25.766135 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:25.766135 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:25.766135 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:25.766135 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:10:25.766135 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:10:25.766135 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:10:25.766135 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:10:25.766135 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:10:25.766135 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:10:25.766135 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:10:25.766135 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:25.766135 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 390/781] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:10:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:25.770457 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac219ac0-13f4-44bc-b713-501cf2ce9021 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:25.771681 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c34fd6-fb80-4ff0-9ac5-192eef9733a0 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:25.808100 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e5e92-7d4b-435b-af2f-47d684b39067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:25.809043 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e5e92-7d4b-435b-af2f-47d684b39067 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:25.809473 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e5e92-7d4b-435b-af2f-47d684b39067 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:25.809971 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e5e92-7d4b-435b-af2f-47d684b39067 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:25.810904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e5e92-7d4b-435b-af2f-47d684b39067 None admin] RBAC: Adding query filter params (interface=public, service_id=8d43dc870e8f42f9b2106ced6c22daba, region_id=RegionOne) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:25.811362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e5e92-7d4b-435b-af2f-47d684b39067 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:25.812994 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e5e92-7d4b-435b-af2f-47d684b39067 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:25.826223 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 392/782] 10.222.0.57 () {56 vars in 1251 bytes} [Sat Jun 4 08:10:25 2022] GET /identity/v3/endpoints?service_id=8d43dc870e8f42f9b2106ced6c22daba&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:25.827741 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e5e92-7d4b-435b-af2f-47d684b39067 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:25.874203 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:25.881191 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c34fd6-fb80-4ff0-9ac5-192eef9733a0 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:25.910046 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:25.931041 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbdc1ef-b2bf-444f-94fe-c3e7e050fcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:25.931989 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdc1ef-b2bf-444f-94fe-c3e7e050fcbd None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:25.932428 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdc1ef-b2bf-444f-94fe-c3e7e050fcbd None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:25.933043 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdc1ef-b2bf-444f-94fe-c3e7e050fcbd None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:25.934030 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbdc1ef-b2bf-444f-94fe-c3e7e050fcbd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:25.934629 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbdc1ef-b2bf-444f-94fe-c3e7e050fcbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:25.936166 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbdc1ef-b2bf-444f-94fe-c3e7e050fcbd None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:25.945713 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 391/783] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:10:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:25.951818 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbdc1ef-b2bf-444f-94fe-c3e7e050fcbd None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:25.960160 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e5e92-7d4b-435b-af2f-47d684b39067 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:26.038730 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08db24-f338-48d9-9b93-baf822e44255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:26.039423 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08db24-f338-48d9-9b93-baf822e44255 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:26.039712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08db24-f338-48d9-9b93-baf822e44255 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:26.039993 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08db24-f338-48d9-9b93-baf822e44255 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:26.040691 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08db24-f338-48d9-9b93-baf822e44255 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:26.042112 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08db24-f338-48d9-9b93-baf822e44255 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:26.060637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 393/784] 10.222.0.57 () {56 vars in 1087 bytes} [Sat Jun 4 08:10:25 2022] GET /identity/v3/services => generated 772 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:26.110635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbdc1ef-b2bf-444f-94fe-c3e7e050fcbd None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:26.160361 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a13555-ed2a-44ff-94a0-3b94f9144d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:26.161479 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a13555-ed2a-44ff-94a0-3b94f9144d49 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:26.161938 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a13555-ed2a-44ff-94a0-3b94f9144d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:26.162360 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a13555-ed2a-44ff-94a0-3b94f9144d49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:26.184122 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a13555-ed2a-44ff-94a0-3b94f9144d49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:26.185945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a13555-ed2a-44ff-94a0-3b94f9144d49 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:26.207104 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-f4a13555-ed2a-44ff-94a0-3b94f9144d49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:26.207104 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:26.207104 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:26.207104 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:26.207104 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:26.207104 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:26.207104 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:26.207104 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:26.207104 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:26.207104 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:26.207104 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:26.207104 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:26.207104 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:26.207104 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:26.207104 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:26.208257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:26.208257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:26.208257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:26.208257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:26.208257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:26.208257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:26.208257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:26.208257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:26.208257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:26.208257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:26.208257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:26.208257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:26.208257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:26.208257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:26.208257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:26.208257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:26.208257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:26.209400 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:26.209400 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:26.209400 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:26.209400 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:26.211054 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 392/785] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:10:26.216894 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08db24-f338-48d9-9b93-baf822e44255 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:26.353240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:26.358016 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08db24-f338-48d9-9b93-baf822e44255 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:26.401050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd5bcd-189d-4b43-9209-413e633a949f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:26.401790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd5bcd-189d-4b43-9209-413e633a949f None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:26.402107 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd5bcd-189d-4b43-9209-413e633a949f None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:26.402384 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd5bcd-189d-4b43-9209-413e633a949f None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:26.403174 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd5bcd-189d-4b43-9209-413e633a949f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:26.403486 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd5bcd-189d-4b43-9209-413e633a949f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:26.404926 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd5bcd-189d-4b43-9209-413e633a949f None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:26.423345 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 394/786] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:26.429853 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a13555-ed2a-44ff-94a0-3b94f9144d49 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:26.509387 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:26.585510 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a13555-ed2a-44ff-94a0-3b94f9144d49 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:26.630498 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639a28b-79c7-458e-92f7-decdad3b256b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:26.631766 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639a28b-79c7-458e-92f7-decdad3b256b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:26.632257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639a28b-79c7-458e-92f7-decdad3b256b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:26.632754 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639a28b-79c7-458e-92f7-decdad3b256b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:26.640892 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9639a28b-79c7-458e-92f7-decdad3b256b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:26.643517 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9639a28b-79c7-458e-92f7-decdad3b256b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:26.658522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-9639a28b-79c7-458e-92f7-decdad3b256b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 04 08:10:26.658522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:26.658522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:26.658522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:26.658522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:26.658522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:26.658522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:26.658522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:26.658522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:26.658522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:26.658522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:26.658522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:26.658522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:10:26.658522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:10:26.658522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:10:26.658522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:10:26.659535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:26.659535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:26.659535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:10:26.659535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:26.659535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:10:26.659535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:26.659535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:26.659535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:26.659535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:26.659535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:26.659535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:26.659535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:26.659535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:26.659535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:26.659535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:26.659535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:26.659535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:26.659535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:26.660524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:26.660524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:26.660524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:10:26.660524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:10:26.660524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:10:26.660524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:10:26.660524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:10:26.660524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:10:26.660524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 04 08:10:26.660524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:26.663320 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 393/787] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:10:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:26.668618 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd5bcd-189d-4b43-9209-413e633a949f None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:26.747439 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decd00c-f7e0-43bd-9ced-d0c2501fd36f None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:26.747986 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decd00c-f7e0-43bd-9ced-d0c2501fd36f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:26.748197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decd00c-f7e0-43bd-9ced-d0c2501fd36f None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:26.750764 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 394/788] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:26.758426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5691e-ecd4-4256-ab78-9f9cd2cf787d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:26.758993 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5691e-ecd4-4256-ab78-9f9cd2cf787d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:26.759469 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5691e-ecd4-4256-ab78-9f9cd2cf787d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:26.779881 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-ddc5691e-ecd4-4256-ab78-9f9cd2cf787d None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:26.781368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ddc5691e-ecd4-4256-ab78-9f9cd2cf787d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:26.842216 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd5bcd-189d-4b43-9209-413e633a949f None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:26.870063 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 395/789] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 08:10:26.889488 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5691e-ecd4-4256-ab78-9f9cd2cf787d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:26.926375 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:26.943517 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5eb5d3-e756-42e1-aa03-a2a78f89c065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:26.944161 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5eb5d3-e756-42e1-aa03-a2a78f89c065 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:26.944450 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5eb5d3-e756-42e1-aa03-a2a78f89c065 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:26.944726 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5eb5d3-e756-42e1-aa03-a2a78f89c065 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:26.945587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5eb5d3-e756-42e1-aa03-a2a78f89c065 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:26.945919 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5eb5d3-e756-42e1-aa03-a2a78f89c065 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:26.947368 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5eb5d3-e756-42e1-aa03-a2a78f89c065 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:27.000364 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 395/790] 10.222.0.57 () {56 vars in 1135 bytes} [Sat Jun 4 08:10:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:27.004909 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5691e-ecd4-4256-ab78-9f9cd2cf787d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:27.010826 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5eb5d3-e756-42e1-aa03-a2a78f89c065 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:27.047183 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a69ffc-51ff-453a-b210-afbbd98f9f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:27.048390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a69ffc-51ff-453a-b210-afbbd98f9f9c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:27.048999 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a69ffc-51ff-453a-b210-afbbd98f9f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:27.049525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a69ffc-51ff-453a-b210-afbbd98f9f9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:27.063201 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a69ffc-51ff-453a-b210-afbbd98f9f9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:10:27.071871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-22a69ffc-51ff-453a-b210-afbbd98f9f9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:10:27.071871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:27.071871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:27.071871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:27.071871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:27.071871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:27.071871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:27.071871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:27.071871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:27.071871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:27.071871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:27.071871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:27.071871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:10:27.071871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:10:27.071871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:10:27.071871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:10:27.072821 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:10:27.072821 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:10:27.072821 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:10:27.072821 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:10:27.072821 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:27.072821 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:27.072821 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:27.072821 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:27.072821 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:27.072821 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:27.072821 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:27.072821 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:27.072821 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:27.072821 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:27.072821 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:27.072821 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:27.073701 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:27.073701 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:27.073701 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:27.073701 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:27.073701 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:10:27.073701 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:10:27.073701 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:10:27.073701 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:10:27.073701 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:10:27.073701 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:10:27.073701 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:10:27.073701 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:27.075554 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:27.082469 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 396/791] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:10:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:10:27.085161 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a69ffc-51ff-453a-b210-afbbd98f9f9c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:27.190312 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:27.200322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a69ffc-51ff-453a-b210-afbbd98f9f9c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:27.240793 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c701ff-b7fe-4793-a420-af169f8580e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:27.241887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c701ff-b7fe-4793-a420-af169f8580e7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:27.242397 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c701ff-b7fe-4793-a420-af169f8580e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:27.242896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c701ff-b7fe-4793-a420-af169f8580e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:27.243881 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c701ff-b7fe-4793-a420-af169f8580e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:27.244398 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c701ff-b7fe-4793-a420-af169f8580e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:27.246279 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c701ff-b7fe-4793-a420-af169f8580e7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:27.262123 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 397/792] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:10:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:27.264600 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c701ff-b7fe-4793-a420-af169f8580e7 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:27.374778 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c701ff-b7fe-4793-a420-af169f8580e7 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:27.384881 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5eb5d3-e756-42e1-aa03-a2a78f89c065 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:27.425874 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793f345-e2eb-4e78-8ba9-9ea9fe0c560e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:27.427241 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793f345-e2eb-4e78-8ba9-9ea9fe0c560e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:27.430552 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793f345-e2eb-4e78-8ba9-9ea9fe0c560e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:27.431039 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793f345-e2eb-4e78-8ba9-9ea9fe0c560e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:27.450953 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793f345-e2eb-4e78-8ba9-9ea9fe0c560e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:27.453505 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793f345-e2eb-4e78-8ba9-9ea9fe0c560e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:27.468803 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e35df-e61c-4390-8204-4edfb415ea3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:27.470013 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e35df-e61c-4390-8204-4edfb415ea3d None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:27.470551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e35df-e61c-4390-8204-4edfb415ea3d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:27.471024 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e35df-e61c-4390-8204-4edfb415ea3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:27.492896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-c793f345-e2eb-4e78-8ba9-9ea9fe0c560e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:27.492896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:27.492896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:27.492896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:27.492896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:27.492896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:27.492896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:27.492896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:27.492896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:27.492896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:27.492896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:27.492896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:27.492896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:27.492896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:27.492896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:27.493884 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:27.493884 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:27.493884 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:27.493884 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:27.493884 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:27.493884 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:27.493884 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:27.493884 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:27.493884 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:27.493884 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:27.493884 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:27.493884 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:27.493884 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:27.493884 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:27.493884 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:27.493884 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:27.493884 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:27.494780 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:27.494780 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:27.494780 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:27.494780 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:27.495533 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e35df-e61c-4390-8204-4edfb415ea3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:27.497231 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e35df-e61c-4390-8204-4edfb415ea3d None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:27.499123 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 398/793] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:10:27.515870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793f345-e2eb-4e78-8ba9-9ea9fe0c560e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:27.530185 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:27.540203 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-c49e35df-e61c-4390-8204-4edfb415ea3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:27.540203 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:27.540203 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:27.540203 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:27.540203 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:27.540203 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:27.540203 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:27.540203 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:27.540203 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:27.540203 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:27.540203 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:27.540203 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:27.540203 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:27.540203 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:27.540203 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:27.541239 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:27.541239 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:27.541239 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:27.541239 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:27.541239 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:27.541239 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:27.541239 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:27.541239 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:27.541239 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:27.541239 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:27.541239 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:27.541239 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:27.541239 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:27.541239 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:27.541239 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:27.541239 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:27.541239 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:27.542199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:27.542199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:27.542199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:27.542199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:27.543471 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 396/794] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 533 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:27.549213 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e35df-e61c-4390-8204-4edfb415ea3d None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:27.636546 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:27.661277 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793f345-e2eb-4e78-8ba9-9ea9fe0c560e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:27.681561 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e35df-e61c-4390-8204-4edfb415ea3d None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:27.701190 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86303e3-558f-4563-b833-b6a4778ba6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:27.702212 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86303e3-558f-4563-b833-b6a4778ba6db None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:27.702722 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86303e3-558f-4563-b833-b6a4778ba6db None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:27.703289 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86303e3-558f-4563-b833-b6a4778ba6db None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:27.704319 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86303e3-558f-4563-b833-b6a4778ba6db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:27.704887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86303e3-558f-4563-b833-b6a4778ba6db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:27.706622 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86303e3-558f-4563-b833-b6a4778ba6db None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:27.719852 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 399/795] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:27.721687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0f31d-579c-4ec8-b2bb-b3a712ae4687 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:27.722203 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0f31d-579c-4ec8-b2bb-b3a712ae4687 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:27.722681 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0f31d-579c-4ec8-b2bb-b3a712ae4687 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:27.723625 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e775b68-ade0-447f-b0c4-bd12a70fb493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:27.724291 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e775b68-ade0-447f-b0c4-bd12a70fb493 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:27.728661 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e775b68-ade0-447f-b0c4-bd12a70fb493 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:27.728661 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e775b68-ade0-447f-b0c4-bd12a70fb493 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:27.728661 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e775b68-ade0-447f-b0c4-bd12a70fb493 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:27.728661 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e775b68-ade0-447f-b0c4-bd12a70fb493 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:27.728661 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e775b68-ade0-447f-b0c4-bd12a70fb493 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:27.729233 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 400/796] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:27.730486 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0f31d-579c-4ec8-b2bb-b3a712ae4687 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:27.742574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 397/797] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:27.744059 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4135914-28e5-421a-b2cf-bfd214adc095 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:27.744346 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4135914-28e5-421a-b2cf-bfd214adc095 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:27.744631 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4135914-28e5-421a-b2cf-bfd214adc095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:27.772006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-f4135914-28e5-421a-b2cf-bfd214adc095 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:27.773209 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f4135914-28e5-421a-b2cf-bfd214adc095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:27.809297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:27.850958 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0f31d-579c-4ec8-b2bb-b3a712ae4687 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:27.857844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 398/798] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:10:27.857844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4135914-28e5-421a-b2cf-bfd214adc095 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:27.917108 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063d57b-2585-4080-87e6-f4e3c22fc7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:27.918342 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063d57b-2585-4080-87e6-f4e3c22fc7fb None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:27.918993 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:27.919831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063d57b-2585-4080-87e6-f4e3c22fc7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:27.920375 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063d57b-2585-4080-87e6-f4e3c22fc7fb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:27.931308 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063d57b-2585-4080-87e6-f4e3c22fc7fb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:27.933346 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063d57b-2585-4080-87e6-f4e3c22fc7fb None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:27.949237 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-e063d57b-2585-4080-87e6-f4e3c22fc7fb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 08:10:27.949237 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:27.949237 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:27.949237 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:27.949237 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:27.949237 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:27.949237 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:27.949237 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:27.949237 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:27.949237 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:27.949237 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:27.949237 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:27.949237 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:10:27.949237 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:10:27.949237 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:10:27.949237 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:10:27.950287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:27.950287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:27.950287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:10:27.950287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:27.950287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:10:27.950287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:27.950287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:27.950287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:27.950287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:27.950287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:27.950287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:27.950287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:27.950287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:27.950287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:27.950287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:27.950287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:27.950287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:27.950287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:27.951287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:27.951287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:27.951287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:10:27.951287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:10:27.951287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:10:27.951287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:10:27.951287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:10:27.951287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:10:27.951287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 08:10:27.951287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:27.954177 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 401/799] 10.222.0.57 () {56 vars in 1093 bytes} [Sat Jun 4 08:10:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:27.955340 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063d57b-2585-4080-87e6-f4e3c22fc7fb None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:27.964007 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4135914-28e5-421a-b2cf-bfd214adc095 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:28.003899 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e51b85-6f9b-4d94-9f64-8157f126cc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:28.004668 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e51b85-6f9b-4d94-9f64-8157f126cc00 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:28.004949 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e51b85-6f9b-4d94-9f64-8157f126cc00 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:28.005220 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e51b85-6f9b-4d94-9f64-8157f126cc00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:28.012839 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e51b85-6f9b-4d94-9f64-8157f126cc00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:28.014333 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e51b85-6f9b-4d94-9f64-8157f126cc00 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:28.029633 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-03e51b85-6f9b-4d94-9f64-8157f126cc00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:28.029633 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:28.029633 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:28.029633 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:28.029633 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:28.029633 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:28.029633 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:28.029633 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:28.029633 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:28.029633 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:28.029633 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:28.029633 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:28.029633 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:10:28.029633 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:10:28.029633 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:10:28.030653 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:10:28.030653 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:28.030653 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:28.030653 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:28.030653 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:28.030653 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:28.030653 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:28.030653 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:28.030653 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:28.030653 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:28.030653 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:28.030653 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:28.030653 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:28.030653 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:28.030653 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:28.030653 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:28.030653 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:28.031557 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:10:28.031557 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:10:28.031557 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:10:28.031557 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:10:28.031557 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:10:28.031557 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:10:28.031557 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:28.031557 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:28.031557 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 399/800] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:10:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:28.032504 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e51b85-6f9b-4d94-9f64-8157f126cc00 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:28.079364 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063d57b-2585-4080-87e6-f4e3c22fc7fb None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:28.107809 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:28.119702 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842aa6d5-eacf-4b3e-adfe-eea4f518af9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:28.120869 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842aa6d5-eacf-4b3e-adfe-eea4f518af9a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:28.121360 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842aa6d5-eacf-4b3e-adfe-eea4f518af9a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:28.121895 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842aa6d5-eacf-4b3e-adfe-eea4f518af9a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:28.122859 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842aa6d5-eacf-4b3e-adfe-eea4f518af9a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:28.124645 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842aa6d5-eacf-4b3e-adfe-eea4f518af9a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:28.138960 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-842aa6d5-eacf-4b3e-adfe-eea4f518af9a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 08:10:28.138960 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:28.138960 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 08:10:28.138960 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 08:10:28.138960 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 08:10:28.138960 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 08:10:28.138960 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 08:10:28.138960 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:28.138960 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 08:10:28.138960 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:28.138960 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 08:10:28.138960 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:28.138960 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:28.138960 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:28.138960 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:28.138960 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:28.139962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:28.139962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:28.139962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:28.139962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:28.139962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:28.139962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:28.139962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:28.139962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 08:10:28.139962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 08:10:28.139962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 08:10:28.139962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 08:10:28.139962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:28.139962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:28.139962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:28.139962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:28.139962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:28.140817 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:28.140817 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:28.140817 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:28.140817 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:28.140817 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:28.140817 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:28.140817 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:28.140817 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:28.140817 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:28.140817 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:28.140817 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:28.140817 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 08:10:28.140817 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:28.140817 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 08:10:28.140817 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:28.149163 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 402/801] 10.222.0.57 () {56 vars in 1129 bytes} [Sat Jun 4 08:10:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:28.150296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842aa6d5-eacf-4b3e-adfe-eea4f518af9a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:28.150892 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e51b85-6f9b-4d94-9f64-8157f126cc00 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:28.172689 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:28.188223 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bb03e-9562-4fd8-91a6-a7c2197a4a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:28.188880 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bb03e-9562-4fd8-91a6-a7c2197a4a2f None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:28.189700 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bb03e-9562-4fd8-91a6-a7c2197a4a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:28.190011 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bb03e-9562-4fd8-91a6-a7c2197a4a2f None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:28.190856 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40bb03e-9562-4fd8-91a6-a7c2197a4a2f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:28.191163 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40bb03e-9562-4fd8-91a6-a7c2197a4a2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:28.192718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40bb03e-9562-4fd8-91a6-a7c2197a4a2f None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:28.213299 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 400/802] 10.222.0.57 () {56 vars in 1133 bytes} [Sat Jun 4 08:10:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:28.214187 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bb03e-9562-4fd8-91a6-a7c2197a4a2f None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:28.265553 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842aa6d5-eacf-4b3e-adfe-eea4f518af9a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:28.304162 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6afab0-ca44-4480-b60a-2cd585f87b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:28.305221 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6afab0-ca44-4480-b60a-2cd585f87b57 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:28.305738 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6afab0-ca44-4480-b60a-2cd585f87b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:28.306258 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6afab0-ca44-4480-b60a-2cd585f87b57 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:28.307511 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6afab0-ca44-4480-b60a-2cd585f87b57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:28.308081 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6afab0-ca44-4480-b60a-2cd585f87b57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:28.309782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6afab0-ca44-4480-b60a-2cd585f87b57 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:28.325254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bb03e-9562-4fd8-91a6-a7c2197a4a2f None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:28.326863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 403/803] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:10:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:28.328228 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6afab0-ca44-4480-b60a-2cd585f87b57 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:28.364134 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acf9f5-7d4f-46bb-853b-c6cc936589da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:28.364801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acf9f5-7d4f-46bb-853b-c6cc936589da None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:28.365082 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acf9f5-7d4f-46bb-853b-c6cc936589da None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:28.365357 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acf9f5-7d4f-46bb-853b-c6cc936589da None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:28.366084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80acf9f5-7d4f-46bb-853b-c6cc936589da None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:28.366393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80acf9f5-7d4f-46bb-853b-c6cc936589da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:28.367881 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80acf9f5-7d4f-46bb-853b-c6cc936589da None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:28.377857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 401/804] 10.222.0.57 () {56 vars in 1124 bytes} [Sat Jun 4 08:10:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:28.377857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acf9f5-7d4f-46bb-853b-c6cc936589da None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:28.389890 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:28.421450 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:28.445762 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6afab0-ca44-4480-b60a-2cd585f87b57 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:28.479009 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a998d2d-1e82-4de4-8fca-6543baa7135b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:28.479578 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a998d2d-1e82-4de4-8fca-6543baa7135b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:28.479855 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a998d2d-1e82-4de4-8fca-6543baa7135b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:28.480129 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a998d2d-1e82-4de4-8fca-6543baa7135b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:28.485027 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acf9f5-7d4f-46bb-853b-c6cc936589da None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:28.522340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a9102-e0cd-40fc-a8c4-f02383b09bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:28.523535 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a9102-e0cd-40fc-a8c4-f02383b09bee None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:28.523963 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a9102-e0cd-40fc-a8c4-f02383b09bee None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:28.524382 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a9102-e0cd-40fc-a8c4-f02383b09bee None admin] PATH_INFO: `/v3/projects/634c9a1745ef44c0ad66e02493d79af0/users/05ea412cab4244c58a2670c66f5a311c/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:28.526768 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a9102-e0cd-40fc-a8c4-f02383b09bee None admin] RBAC: Authorizing `identity:create_grant(project_id=634c9a1745ef44c0ad66e02493d79af0, user_id=05ea412cab4244c58a2670c66f5a311c, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:28.528455 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a9102-e0cd-40fc-a8c4-f02383b09bee None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:28.542321 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 402/805] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jun 4 08:10:28 2022] PUT /identity/v3/projects/634c9a1745ef44c0ad66e02493d79af0/users/05ea412cab4244c58a2670c66f5a311c/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:10:28.543305 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a9102-e0cd-40fc-a8c4-f02383b09bee None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:28.558582 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a998d2d-1e82-4de4-8fca-6543baa7135b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:28.560072 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a998d2d-1e82-4de4-8fca-6543baa7135b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:28.616496 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:28.679349 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 404/806] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:10:28 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 08:10:28.680958 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe981f6-36b1-42d0-ac59-f40cc6a3b66b None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:28.681316 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe981f6-36b1-42d0-ac59-f40cc6a3b66b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:28.681659 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe981f6-36b1-42d0-ac59-f40cc6a3b66b None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:28.683247 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 405/807] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:28.684544 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5326b-550e-4b64-819e-bcdffa05196b None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:28.684837 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5326b-550e-4b64-819e-bcdffa05196b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:28.685113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5326b-550e-4b64-819e-bcdffa05196b None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:28.689869 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 406/808] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:28.689869 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5326b-550e-4b64-819e-bcdffa05196b None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:28.706317 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a9102-e0cd-40fc-a8c4-f02383b09bee None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:28.708152 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:28.749073 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f825cb9-cba2-4920-8263-96a92ad17b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:28.749991 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f825cb9-cba2-4920-8263-96a92ad17b14 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:28.750276 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f825cb9-cba2-4920-8263-96a92ad17b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:28.750553 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f825cb9-cba2-4920-8263-96a92ad17b14 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:28.751267 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f825cb9-cba2-4920-8263-96a92ad17b14 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:28.751572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f825cb9-cba2-4920-8263-96a92ad17b14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:28.753744 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f825cb9-cba2-4920-8263-96a92ad17b14 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:28.764163 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 403/809] 10.222.0.57 () {56 vars in 1124 bytes} [Sat Jun 4 08:10:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:28.764163 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d8774-4610-44d9-8759-cfb4b41262e3 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:28.764163 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d8774-4610-44d9-8759-cfb4b41262e3 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:28.764163 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d8774-4610-44d9-8759-cfb4b41262e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:28.781641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-9a8d8774-4610-44d9-8759-cfb4b41262e3 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:28.783003 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-9a8d8774-4610-44d9-8759-cfb4b41262e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:28.813424 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5326b-550e-4b64-819e-bcdffa05196b None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:28.849482 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff714e-9b33-4271-bc77-5dd375e82936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:28.850303 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff714e-9b33-4271-bc77-5dd375e82936 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:28.850587 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff714e-9b33-4271-bc77-5dd375e82936 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:28.850863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff714e-9b33-4271-bc77-5dd375e82936 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:28.852834 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 404/810] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:10:28.853968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd249c09-b306-4c46-b934-82a9efaf87ae None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:28.854254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd249c09-b306-4c46-b934-82a9efaf87ae None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:28.854528 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd249c09-b306-4c46-b934-82a9efaf87ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:28.870962 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-fd249c09-b306-4c46-b934-82a9efaf87ae None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:28.872185 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-fd249c09-b306-4c46-b934-82a9efaf87ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:28.872528 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff714e-9b33-4271-bc77-5dd375e82936 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:28.874519 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff714e-9b33-4271-bc77-5dd375e82936 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:28.896287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-84ff714e-9b33-4271-bc77-5dd375e82936 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:28.896287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:28.896287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:28.896287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:28.896287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:28.896287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:28.896287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:28.896287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:28.896287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:28.896287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:28.896287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:28.896287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:28.896287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:28.896287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:28.896287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:28.897367 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:28.897367 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:28.897367 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:28.897367 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:28.897367 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:28.897367 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:28.897367 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:28.897367 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:28.897367 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:28.897367 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:28.897367 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:28.897367 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:28.897367 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:28.897367 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:28.897367 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:28.897367 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:28.897367 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:28.898865 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:28.898865 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:28.898865 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:28.898865 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:28.898865 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 407/811] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:28.898865 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff714e-9b33-4271-bc77-5dd375e82936 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:28.901124 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:28.956846 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 405/812] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:10:28.958149 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd249c09-b306-4c46-b934-82a9efaf87ae None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:28.985115 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:29.022921 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff714e-9b33-4271-bc77-5dd375e82936 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:29.060377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbac73b-c4ad-47a5-9b85-79b11e388892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:29.061037 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbac73b-c4ad-47a5-9b85-79b11e388892 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:29.061332 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbac73b-c4ad-47a5-9b85-79b11e388892 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:29.061588 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbac73b-c4ad-47a5-9b85-79b11e388892 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:29.062385 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbac73b-c4ad-47a5-9b85-79b11e388892 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:29.063742 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbac73b-c4ad-47a5-9b85-79b11e388892 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:29.068562 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd249c09-b306-4c46-b934-82a9efaf87ae None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:29.087065 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 408/813] 10.222.0.57 () {60 vars in 1144 bytes} [Sat Jun 4 08:10:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:10:29.088029 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbac73b-c4ad-47a5-9b85-79b11e388892 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:29.127671 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e6131-dbd5-4d6a-a2d9-08bbb4a0a268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:29.128899 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e6131-dbd5-4d6a-a2d9-08bbb4a0a268 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:29.129363 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e6131-dbd5-4d6a-a2d9-08bbb4a0a268 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:29.129885 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e6131-dbd5-4d6a-a2d9-08bbb4a0a268 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:29.143493 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e6131-dbd5-4d6a-a2d9-08bbb4a0a268 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:10:29.152391 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-558e6131-dbd5-4d6a-a2d9-08bbb4a0a268 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:10:29.152391 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:29.152391 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:29.152391 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:29.152391 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:29.152391 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:29.152391 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:29.152391 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:29.152391 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:29.152391 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:29.152391 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:29.152391 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:29.152391 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:10:29.152391 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:10:29.152391 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:10:29.152391 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:10:29.153599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:10:29.153599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:10:29.153599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:10:29.153599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:10:29.153599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:29.153599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:29.153599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:29.153599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:29.153599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:29.153599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:29.153599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:29.153599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:29.153599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:29.153599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:29.153599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:29.153599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:29.154677 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:29.154677 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:29.154677 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:29.154677 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:29.154677 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:10:29.154677 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:10:29.154677 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:10:29.154677 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:10:29.154677 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:10:29.154677 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:10:29.154677 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:10:29.154677 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:29.156227 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 406/814] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jun 4 08:10:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:29.157204 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e6131-dbd5-4d6a-a2d9-08bbb4a0a268 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:29.172614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:29.239793 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbac73b-c4ad-47a5-9b85-79b11e388892 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:29.258216 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:29.272488 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e6131-dbd5-4d6a-a2d9-08bbb4a0a268 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:29.288977 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d44c4-3320-49d3-a5a0-6114c5306143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:29.289668 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d44c4-3320-49d3-a5a0-6114c5306143 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:29.290602 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d44c4-3320-49d3-a5a0-6114c5306143 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:29.290962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d44c4-3320-49d3-a5a0-6114c5306143 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:29.291940 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d44c4-3320-49d3-a5a0-6114c5306143 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:29.292425 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d44c4-3320-49d3-a5a0-6114c5306143 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:29.294302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d44c4-3320-49d3-a5a0-6114c5306143 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:29.316644 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 409/815] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:29.317490 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d44c4-3320-49d3-a5a0-6114c5306143 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:29.320181 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386321d-47cf-4a20-8669-91852b62b58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:29.320978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386321d-47cf-4a20-8669-91852b62b58d None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:29.321261 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386321d-47cf-4a20-8669-91852b62b58d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:29.321534 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386321d-47cf-4a20-8669-91852b62b58d None admin] PATH_INFO: `/v3/services/network` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:29.322470 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6386321d-47cf-4a20-8669-91852b62b58d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:29.323850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6386321d-47cf-4a20-8669-91852b62b58d None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:29.337089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-6386321d-47cf-4a20-8669-91852b62b58d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 08:10:29.337089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:29.337089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 08:10:29.337089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 08:10:29.337089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 08:10:29.337089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 08:10:29.337089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 08:10:29.337089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:29.337089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 08:10:29.337089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:29.337089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 08:10:29.337089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:29.337089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:29.337089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:29.337089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:29.337089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:29.337089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:29.338282 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:29.338282 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:29.338282 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:29.338282 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:29.338282 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:29.338282 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:29.338282 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 08:10:29.338282 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 08:10:29.338282 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 08:10:29.338282 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 08:10:29.338282 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:29.338282 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:29.338282 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:29.338282 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:29.338282 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:29.338282 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:29.339416 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:29.339416 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:29.339416 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:29.339416 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:29.339416 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:29.339416 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:29.339416 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:29.339416 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:29.339416 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:29.339416 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:29.339416 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 08:10:29.339416 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:29.339416 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 08:10:29.339416 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:29.339416 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 407/816] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:10:29 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:29.340411 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386321d-47cf-4a20-8669-91852b62b58d None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:29.439693 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d44c4-3320-49d3-a5a0-6114c5306143 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:29.457910 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:29.474294 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386321d-47cf-4a20-8669-91852b62b58d None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:29.477738 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f3fc8-6ad1-43bd-a143-304a6b9d6a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:29.478598 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f3fc8-6ad1-43bd-a143-304a6b9d6a35 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:29.479027 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f3fc8-6ad1-43bd-a143-304a6b9d6a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:29.479472 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f3fc8-6ad1-43bd-a143-304a6b9d6a35 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:29.480355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f3fc8-6ad1-43bd-a143-304a6b9d6a35 None admin] RBAC: Adding query filter params (name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:29.480882 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f3fc8-6ad1-43bd-a143-304a6b9d6a35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:29.482547 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f3fc8-6ad1-43bd-a143-304a6b9d6a35 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:29.496875 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 410/817] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jun 4 08:10:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:29.498010 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f3fc8-6ad1-43bd-a143-304a6b9d6a35 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:29.510477 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f20e88-620a-4742-8f10-76c6b325f5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:29.511434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f20e88-620a-4742-8f10-76c6b325f5ea None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:29.511779 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f20e88-620a-4742-8f10-76c6b325f5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:29.512357 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f20e88-620a-4742-8f10-76c6b325f5ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:29.520754 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f20e88-620a-4742-8f10-76c6b325f5ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:29.522346 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f20e88-620a-4742-8f10-76c6b325f5ea None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:29.539121 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-35f20e88-620a-4742-8f10-76c6b325f5ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:29.539121 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:29.539121 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:29.539121 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:29.539121 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:29.539121 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:29.539121 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:29.539121 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:29.539121 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:29.539121 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:29.539121 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:29.539121 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:29.539121 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:10:29.539121 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:10:29.539121 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:10:29.540207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:10:29.540207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:29.540207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:29.540207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:29.540207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:29.540207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:29.540207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:29.540207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:29.540207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:29.540207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:29.540207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:29.540207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:29.540207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:29.540207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:29.540207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:29.540207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:29.540207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:29.541312 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:10:29.541312 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:10:29.541312 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:10:29.541312 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:10:29.541312 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:10:29.541312 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:10:29.541312 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:29.541312 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:29.542339 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 408/818] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:10:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:29.543192 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f20e88-620a-4742-8f10-76c6b325f5ea None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:29.553365 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:29.615361 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f3fc8-6ad1-43bd-a143-304a6b9d6a35 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:29.658943 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f044bd8-6e7f-4442-8954-72e22e1f815c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:29.660469 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f044bd8-6e7f-4442-8954-72e22e1f815c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:29.660905 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f044bd8-6e7f-4442-8954-72e22e1f815c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:29.661400 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f044bd8-6e7f-4442-8954-72e22e1f815c None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:29.662553 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f044bd8-6e7f-4442-8954-72e22e1f815c None admin] RBAC: Adding query filter params (name=network) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:29.663379 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f044bd8-6e7f-4442-8954-72e22e1f815c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:29.665320 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f044bd8-6e7f-4442-8954-72e22e1f815c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:29.665917 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f20e88-620a-4742-8f10-76c6b325f5ea None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:29.671821 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 411/819] 10.222.0.57 () {56 vars in 1112 bytes} [Sat Jun 4 08:10:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:29.672880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f044bd8-6e7f-4442-8954-72e22e1f815c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:29.717213 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65067a-6d72-437b-876b-65f5f43f0542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:29.718646 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65067a-6d72-437b-876b-65f5f43f0542 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:29.719037 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65067a-6d72-437b-876b-65f5f43f0542 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:29.719569 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65067a-6d72-437b-876b-65f5f43f0542 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:29.734000 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65067a-6d72-437b-876b-65f5f43f0542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:29.736876 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65067a-6d72-437b-876b-65f5f43f0542 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:29.760968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-8b65067a-6d72-437b-876b-65f5f43f0542 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:29.760968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:29.760968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:29.760968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:29.760968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:29.760968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:29.760968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:29.760968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:29.760968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:29.760968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:29.760968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:29.760968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:29.760968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:29.760968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:29.760968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:29.762112 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:29.762112 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:29.762112 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:29.762112 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:29.762112 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:29.762112 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:29.762112 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:29.762112 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:29.762112 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:29.762112 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:29.762112 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:29.762112 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:29.762112 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:29.762112 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:29.762112 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:29.762112 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:29.762112 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:29.763332 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:29.763332 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:29.763332 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:29.763332 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:29.769505 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 409/820] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:29.769505 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65067a-6d72-437b-876b-65f5f43f0542 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:29.770259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:29.800150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f044bd8-6e7f-4442-8954-72e22e1f815c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:29.837778 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:29.853115 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60a89b-1a24-473a-a046-2f84f805acbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:29.853956 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60a89b-1a24-473a-a046-2f84f805acbb None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:29.854342 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60a89b-1a24-473a-a046-2f84f805acbb None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:29.854717 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60a89b-1a24-473a-a046-2f84f805acbb None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:29.855603 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a60a89b-1a24-473a-a046-2f84f805acbb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:29.856031 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a60a89b-1a24-473a-a046-2f84f805acbb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:29.857564 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a60a89b-1a24-473a-a046-2f84f805acbb None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:29.878116 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 412/821] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:10:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:29.879245 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60a89b-1a24-473a-a046-2f84f805acbb None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:29.889371 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65067a-6d72-437b-876b-65f5f43f0542 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:29.933687 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676023f4-f485-4c7f-91a1-bcef18e0c2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:29.934634 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676023f4-f485-4c7f-91a1-bcef18e0c2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:29.935105 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676023f4-f485-4c7f-91a1-bcef18e0c2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:29.935558 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676023f4-f485-4c7f-91a1-bcef18e0c2f2 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:29.936499 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676023f4-f485-4c7f-91a1-bcef18e0c2f2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:29.937023 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676023f4-f485-4c7f-91a1-bcef18e0c2f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:29.938651 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676023f4-f485-4c7f-91a1-bcef18e0c2f2 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:29.945550 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 410/822] 10.222.0.57 () {56 vars in 1112 bytes} [Sat Jun 4 08:10:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:29.947331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676023f4-f485-4c7f-91a1-bcef18e0c2f2 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:30.003778 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60a89b-1a24-473a-a046-2f84f805acbb None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:30.006510 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:30.041794 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc2762-e167-4eb1-bb57-23b7c2c0a73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:30.042860 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc2762-e167-4eb1-bb57-23b7c2c0a73f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:30.043345 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc2762-e167-4eb1-bb57-23b7c2c0a73f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:30.043821 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc2762-e167-4eb1-bb57-23b7c2c0a73f None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:30.044737 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc2762-e167-4eb1-bb57-23b7c2c0a73f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:30.045266 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc2762-e167-4eb1-bb57-23b7c2c0a73f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:30.046853 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc2762-e167-4eb1-bb57-23b7c2c0a73f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:30.063761 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676023f4-f485-4c7f-91a1-bcef18e0c2f2 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:30.064141 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 413/823] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:30.065171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc2762-e167-4eb1-bb57-23b7c2c0a73f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:30.087998 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:30.102375 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8bcf4-0e84-4f8d-bfa5-a38348dfed5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:30.103020 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8bcf4-0e84-4f8d-bfa5-a38348dfed5a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:30.103305 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8bcf4-0e84-4f8d-bfa5-a38348dfed5a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:30.103584 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8bcf4-0e84-4f8d-bfa5-a38348dfed5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:30.104859 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8bcf4-0e84-4f8d-bfa5-a38348dfed5a None admin] RBAC: Adding query filter params (role.id=431cef539cfb476aad50d2470e763b5f, scope.project.id=634c9a1745ef44c0ad66e02493d79af0, user.id=7e64d002241242928936dd0d991ecdc1) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:30.104859 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8bcf4-0e84-4f8d-bfa5-a38348dfed5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:30.106279 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8bcf4-0e84-4f8d-bfa5-a38348dfed5a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:30.112926 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 411/824] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:10:29 2022] GET /identity/v3/role_assignments?user.id=7e64d002241242928936dd0d991ecdc1&scope.project.id=634c9a1745ef44c0ad66e02493d79af0&role.id=431cef539cfb476aad50d2470e763b5f => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:30.121941 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8bcf4-0e84-4f8d-bfa5-a38348dfed5a None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:30.178677 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc2762-e167-4eb1-bb57-23b7c2c0a73f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:30.217131 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d9207-6af6-4081-bf63-c33b9046056b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:30.218273 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d9207-6af6-4081-bf63-c33b9046056b None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:30.218757 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d9207-6af6-4081-bf63-c33b9046056b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:30.219231 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d9207-6af6-4081-bf63-c33b9046056b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:30.220196 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d9207-6af6-4081-bf63-c33b9046056b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:30.221815 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d9207-6af6-4081-bf63-c33b9046056b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:30.250025 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 414/825] 10.222.0.57 () {60 vars in 1144 bytes} [Sat Jun 4 08:10:30 2022] POST /identity/v3/endpoints => generated 327 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:10:30.279992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8bcf4-0e84-4f8d-bfa5-a38348dfed5a None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:30.328972 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d63ec4-989c-4a08-b445-28a2dcac0743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:30.329785 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d63ec4-989c-4a08-b445-28a2dcac0743 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:30.330618 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d63ec4-989c-4a08-b445-28a2dcac0743 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:30.330892 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d63ec4-989c-4a08-b445-28a2dcac0743 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:30.340370 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d63ec4-989c-4a08-b445-28a2dcac0743 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:30.341880 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d63ec4-989c-4a08-b445-28a2dcac0743 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:30.358449 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-15d63ec4-989c-4a08-b445-28a2dcac0743 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 08:10:30.358449 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:30.358449 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:30.358449 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:30.358449 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:30.358449 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:30.358449 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:30.358449 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:30.358449 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:30.358449 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:30.358449 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:30.358449 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:30.358449 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:10:30.358449 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:10:30.358449 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:10:30.358449 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:10:30.359489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:30.359489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:30.359489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:10:30.359489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:30.359489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:10:30.359489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:30.359489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:30.359489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:30.359489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:30.359489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:30.359489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:30.359489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:30.359489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:30.359489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:30.359489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:30.359489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:30.359489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:30.359489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:30.360712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:30.360712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:30.360712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:10:30.360712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:10:30.360712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:10:30.360712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:10:30.360712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:10:30.360712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:10:30.360712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 08:10:30.360712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:30.360712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 412/826] 10.222.0.57 () {56 vars in 1117 bytes} [Sat Jun 4 08:10:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:30.367604 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d9207-6af6-4081-bf63-c33b9046056b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:30.401535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:30.511337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d9207-6af6-4081-bf63-c33b9046056b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:30.552562 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697da8e-38ba-4d79-b53a-f6a1ac9d6e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:30.553262 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697da8e-38ba-4d79-b53a-f6a1ac9d6e42 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:30.553813 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697da8e-38ba-4d79-b53a-f6a1ac9d6e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:30.554116 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697da8e-38ba-4d79-b53a-f6a1ac9d6e42 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:30.554969 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697da8e-38ba-4d79-b53a-f6a1ac9d6e42 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:30.555284 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697da8e-38ba-4d79-b53a-f6a1ac9d6e42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:30.556746 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697da8e-38ba-4d79-b53a-f6a1ac9d6e42 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:30.576502 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 415/827] 10.222.0.57 () {56 vars in 1149 bytes} [Sat Jun 4 08:10:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:30.582177 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d63ec4-989c-4a08-b445-28a2dcac0743 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:30.632558 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:30.700418 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d63ec4-989c-4a08-b445-28a2dcac0743 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:30.737961 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074bb42-42b0-4427-8df6-304f406bf11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:30.738917 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074bb42-42b0-4427-8df6-304f406bf11a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:30.739306 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074bb42-42b0-4427-8df6-304f406bf11a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:30.739682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074bb42-42b0-4427-8df6-304f406bf11a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:30.750811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074bb42-42b0-4427-8df6-304f406bf11a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:30.753148 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074bb42-42b0-4427-8df6-304f406bf11a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:30.770779 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-a074bb42-42b0-4427-8df6-304f406bf11a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:30.770779 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:30.770779 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:30.770779 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:30.770779 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:30.770779 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:30.770779 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:30.770779 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:30.770779 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:30.770779 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:30.770779 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:30.770779 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:30.770779 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:30.770779 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:30.770779 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:30.771895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:30.771895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:30.771895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:30.771895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:30.771895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:30.771895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:30.771895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:30.771895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:30.771895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:30.771895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:30.771895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:30.771895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:30.771895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:30.771895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:30.771895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:30.771895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:30.771895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:30.772997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:30.772997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:30.772997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:30.772997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:30.774558 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 413/828] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:10:30.779966 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697da8e-38ba-4d79-b53a-f6a1ac9d6e42 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:30.863745 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:30.873130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab77046-c839-44e1-8dd4-a8ffb5cf0930 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:30.873515 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab77046-c839-44e1-8dd4-a8ffb5cf0930 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:30.873718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab77046-c839-44e1-8dd4-a8ffb5cf0930 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:30.875297 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 414/829] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:30.881041 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384af7aa-c8d1-43f3-9c64-8e843d69ed98 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:30.881328 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384af7aa-c8d1-43f3-9c64-8e843d69ed98 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:30.881606 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384af7aa-c8d1-43f3-9c64-8e843d69ed98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:30.889730 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697da8e-38ba-4d79-b53a-f6a1ac9d6e42 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:30.902627 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-384af7aa-c8d1-43f3-9c64-8e843d69ed98 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:30.903843 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-384af7aa-c8d1-43f3-9c64-8e843d69ed98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:30.930517 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48998ef0-5131-4778-a86c-cef4397d0441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:30.931505 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48998ef0-5131-4778-a86c-cef4397d0441 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:30.931994 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48998ef0-5131-4778-a86c-cef4397d0441 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:30.932485 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48998ef0-5131-4778-a86c-cef4397d0441 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:30.933458 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48998ef0-5131-4778-a86c-cef4397d0441 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:30.934003 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48998ef0-5131-4778-a86c-cef4397d0441 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:30.935649 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48998ef0-5131-4778-a86c-cef4397d0441 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:30.952657 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 416/830] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:30.954307 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48998ef0-5131-4778-a86c-cef4397d0441 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:31.002145 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 415/831] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 08:10:31.020902 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384af7aa-c8d1-43f3-9c64-8e843d69ed98 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:31.057976 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:31.066389 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48998ef0-5131-4778-a86c-cef4397d0441 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:31.103136 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b236d07-524c-4efb-9fd8-5e7595fb80ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:31.104280 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b236d07-524c-4efb-9fd8-5e7595fb80ce None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:31.104867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b236d07-524c-4efb-9fd8-5e7595fb80ce None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:31.105369 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b236d07-524c-4efb-9fd8-5e7595fb80ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:31.115605 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b236d07-524c-4efb-9fd8-5e7595fb80ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:31.117369 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b236d07-524c-4efb-9fd8-5e7595fb80ce None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:31.137133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-7b236d07-524c-4efb-9fd8-5e7595fb80ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:31.137133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:31.137133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:31.137133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:31.137133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:31.137133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:31.137133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:31.137133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:31.137133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:31.137133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:31.137133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:31.137133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:31.137133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:10:31.137133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:10:31.137133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:10:31.138192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:10:31.138192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:31.138192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:31.138192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:31.138192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:31.138192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:31.138192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:31.138192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:31.138192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:31.138192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:31.138192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:31.138192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:31.138192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:31.138192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:31.138192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:31.138192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:31.138192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:31.139099 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:10:31.139099 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:10:31.139099 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:10:31.139099 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:10:31.139099 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:10:31.139099 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:10:31.139099 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:31.139099 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:31.144843 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 417/832] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:10:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:31.144843 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:31.148114 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b236d07-524c-4efb-9fd8-5e7595fb80ce None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:31.157915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384af7aa-c8d1-43f3-9c64-8e843d69ed98 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:31.200977 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3f6be-db8a-4f12-900e-95f229df59d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:31.201777 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3f6be-db8a-4f12-900e-95f229df59d3 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:31.202092 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3f6be-db8a-4f12-900e-95f229df59d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:31.202371 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3f6be-db8a-4f12-900e-95f229df59d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:31.216388 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3f6be-db8a-4f12-900e-95f229df59d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:10:31.226157 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-deb3f6be-db8a-4f12-900e-95f229df59d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:10:31.226157 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:31.226157 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:31.226157 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:31.226157 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:31.226157 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:31.226157 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:31.226157 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:31.226157 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:31.226157 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:31.226157 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:31.226157 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:31.226157 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:10:31.226157 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:10:31.226157 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:10:31.226157 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:10:31.227146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:10:31.227146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:10:31.227146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:10:31.227146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:10:31.227146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:31.227146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:31.227146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:31.227146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:31.227146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:31.227146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:31.227146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:31.227146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:31.227146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:31.227146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:31.227146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:31.227146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:31.228012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:31.228012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:31.228012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:31.228012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:31.228012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:10:31.228012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:10:31.228012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:10:31.228012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:10:31.228012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:10:31.228012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:10:31.228012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:10:31.228012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:31.229902 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 416/833] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:10:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:31.233888 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3f6be-db8a-4f12-900e-95f229df59d3 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:31.285589 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b236d07-524c-4efb-9fd8-5e7595fb80ce None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:31.331840 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372caa15-c6b5-4009-abd5-22e73b1ba7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:31.332960 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372caa15-c6b5-4009-abd5-22e73b1ba7eb None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:31.334599 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372caa15-c6b5-4009-abd5-22e73b1ba7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:31.335732 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372caa15-c6b5-4009-abd5-22e73b1ba7eb None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:31.336810 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372caa15-c6b5-4009-abd5-22e73b1ba7eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:31.337316 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372caa15-c6b5-4009-abd5-22e73b1ba7eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:31.339877 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372caa15-c6b5-4009-abd5-22e73b1ba7eb None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:31.346708 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:31.364716 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 418/834] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:10:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:31.366164 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372caa15-c6b5-4009-abd5-22e73b1ba7eb None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:31.373175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3f6be-db8a-4f12-900e-95f229df59d3 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:31.410642 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839df309-e90a-4492-8774-fb9858419618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:31.412107 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839df309-e90a-4492-8774-fb9858419618 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:31.413083 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839df309-e90a-4492-8774-fb9858419618 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:31.413898 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839df309-e90a-4492-8774-fb9858419618 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:31.414972 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839df309-e90a-4492-8774-fb9858419618 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:31.415487 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839df309-e90a-4492-8774-fb9858419618 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:31.417080 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839df309-e90a-4492-8774-fb9858419618 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:31.429992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 417/835] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:10:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:31.435746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839df309-e90a-4492-8774-fb9858419618 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:31.441015 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:31.486968 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372caa15-c6b5-4009-abd5-22e73b1ba7eb None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:31.526131 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2cebeb-1d5d-4e18-8f4d-aadd85b2dde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:31.527268 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2cebeb-1d5d-4e18-8f4d-aadd85b2dde3 None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:31.527715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2cebeb-1d5d-4e18-8f4d-aadd85b2dde3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:31.528147 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2cebeb-1d5d-4e18-8f4d-aadd85b2dde3 None admin] PATH_INFO: `/v3/projects/634c9a1745ef44c0ad66e02493d79af0/users/aff5d82384e84b669eeb00089ab8e09a/roles/c9ec7276464a4d87ab2b6fc52a3bfeae` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:31.543474 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2cebeb-1d5d-4e18-8f4d-aadd85b2dde3 None admin] RBAC: Authorizing `identity:create_grant(project_id=634c9a1745ef44c0ad66e02493d79af0, user_id=aff5d82384e84b669eeb00089ab8e09a, role_id=c9ec7276464a4d87ab2b6fc52a3bfeae)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:31.545148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2cebeb-1d5d-4e18-8f4d-aadd85b2dde3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:31.545954 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839df309-e90a-4492-8774-fb9858419618 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:31.566699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 419/836] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jun 4 08:10:31 2022] PUT /identity/v3/projects/634c9a1745ef44c0ad66e02493d79af0/users/aff5d82384e84b669eeb00089ab8e09a/roles/c9ec7276464a4d87ab2b6fc52a3bfeae => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:10:31.587951 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91340e48-9a9c-41ac-898b-b34c17a26b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:31.589031 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91340e48-9a9c-41ac-898b-b34c17a26b69 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:31.589481 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91340e48-9a9c-41ac-898b-b34c17a26b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:31.589939 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91340e48-9a9c-41ac-898b-b34c17a26b69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:31.604405 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91340e48-9a9c-41ac-898b-b34c17a26b69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:31.606394 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91340e48-9a9c-41ac-898b-b34c17a26b69 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:31.614808 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:31.627895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-91340e48-9a9c-41ac-898b-b34c17a26b69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:31.627895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:31.627895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:31.627895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:31.627895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:31.627895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:31.627895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:31.627895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:31.627895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:31.627895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:31.627895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:31.627895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:31.627895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:31.627895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:31.627895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:31.629015 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:31.629015 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:31.629015 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:31.629015 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:31.629015 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:31.629015 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:31.629015 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:31.629015 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:31.629015 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:31.629015 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:31.629015 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:31.629015 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:31.629015 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:31.629015 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:31.629015 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:31.629015 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:31.629015 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:31.630145 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:31.630145 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:31.630145 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:31.630145 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:31.636674 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 418/837] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:31.638492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2cebeb-1d5d-4e18-8f4d-aadd85b2dde3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:31.677208 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463acb6-3f5a-492c-af8a-553e2f721eaa None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:31.677488 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463acb6-3f5a-492c-af8a-553e2f721eaa None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:31.677766 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463acb6-3f5a-492c-af8a-553e2f721eaa None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:31.679586 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 419/838] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 08:10:31.685284 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8af5f-d0b6-478b-b521-fb24a2dd04fe None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:31.685881 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8af5f-d0b6-478b-b521-fb24a2dd04fe None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:31.686374 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8af5f-d0b6-478b-b521-fb24a2dd04fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:31.707017 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-84f8af5f-d0b6-478b-b521-fb24a2dd04fe None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:31.708236 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-84f8af5f-d0b6-478b-b521-fb24a2dd04fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:31.766474 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2cebeb-1d5d-4e18-8f4d-aadd85b2dde3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:31.776758 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:31.791264 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 420/839] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 08:10:31.816941 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8af5f-d0b6-478b-b521-fb24a2dd04fe None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:31.822602 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1f49f-2123-4609-9a92-9d37f3824a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:31.823363 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1f49f-2123-4609-9a92-9d37f3824a37 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:31.823715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1f49f-2123-4609-9a92-9d37f3824a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:31.824049 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1f49f-2123-4609-9a92-9d37f3824a37 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:31.824866 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1f49f-2123-4609-9a92-9d37f3824a37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:31.825282 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1f49f-2123-4609-9a92-9d37f3824a37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:31.826867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1f49f-2123-4609-9a92-9d37f3824a37 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:31.840456 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 420/840] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:31.846645 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1f49f-2123-4609-9a92-9d37f3824a37 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:31.946287 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8af5f-d0b6-478b-b521-fb24a2dd04fe None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:31.962877 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1f49f-2123-4609-9a92-9d37f3824a37 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:31.975999 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:31.983835 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6941a-aed1-42d9-8806-b76db79657e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:31.984637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6941a-aed1-42d9-8806-b76db79657e9 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:31.984923 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6941a-aed1-42d9-8806-b76db79657e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:31.985197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6941a-aed1-42d9-8806-b76db79657e9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:31.986553 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6941a-aed1-42d9-8806-b76db79657e9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:31.987989 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6941a-aed1-42d9-8806-b76db79657e9 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:32.000895 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a6829-b06e-46fd-aed8-55d7b178ca9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:32.001682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-25e6941a-aed1-42d9-8806-b76db79657e9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 08:10:32.001682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:32.001682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 08:10:32.001682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 08:10:32.001682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 08:10:32.001682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 08:10:32.001682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 08:10:32.001682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:32.001682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 08:10:32.001682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:32.001682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 08:10:32.001682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:32.001682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:32.001682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:32.001682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:32.001682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:32.001682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:32.002703 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:32.002703 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:32.002703 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:32.002703 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:32.002703 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:32.002703 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:32.002703 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 08:10:32.002703 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 08:10:32.002703 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 08:10:32.002703 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 08:10:32.002703 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:32.002703 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:32.002703 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:32.002703 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:32.002703 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:32.002703 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:32.003552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:32.003552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:32.003552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:32.003552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:32.003552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:32.003552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:32.003552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:32.003552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:32.003552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:32.003552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:32.003552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 08:10:32.003552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:32.003552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 08:10:32.003552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:32.003552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 421/841] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jun 4 08:10:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:10:32.005334 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a6829-b06e-46fd-aed8-55d7b178ca9c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:32.005844 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a6829-b06e-46fd-aed8-55d7b178ca9c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:32.006311 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a6829-b06e-46fd-aed8-55d7b178ca9c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:32.008722 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6941a-aed1-42d9-8806-b76db79657e9 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:32.015125 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a6829-b06e-46fd-aed8-55d7b178ca9c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:32.016870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a6829-b06e-46fd-aed8-55d7b178ca9c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:32.031935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-911a6829-b06e-46fd-aed8-55d7b178ca9c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 04 08:10:32.031935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:32.031935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:32.031935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:32.031935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:32.031935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:32.031935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:32.031935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:32.031935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:32.031935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:32.031935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:32.031935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:32.031935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:10:32.031935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:10:32.031935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:10:32.031935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:10:32.033803 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:32.033803 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:32.033803 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:10:32.033803 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:32.033803 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:10:32.033803 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:32.033803 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:32.033803 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:32.033803 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:32.033803 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:32.033803 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:32.033803 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:32.033803 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:32.033803 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:32.033803 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:32.033803 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:32.033803 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:32.033803 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:32.034792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:32.034792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:32.034792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:10:32.034792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:10:32.034792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:10:32.034792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:10:32.034792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:10:32.034792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:10:32.034792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 04 08:10:32.034792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:32.037366 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 421/842] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:10:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:10:32.045493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a6829-b06e-46fd-aed8-55d7b178ca9c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:32.073427 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:32.118635 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6941a-aed1-42d9-8806-b76db79657e9 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:32.164147 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f0318-7f42-4ba8-88ad-7c698f5a3e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:32.164362 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a6829-b06e-46fd-aed8-55d7b178ca9c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:32.165049 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f0318-7f42-4ba8-88ad-7c698f5a3e2f None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:32.165481 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f0318-7f42-4ba8-88ad-7c698f5a3e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:32.166026 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f0318-7f42-4ba8-88ad-7c698f5a3e2f None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:32.167695 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f0318-7f42-4ba8-88ad-7c698f5a3e2f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:32.168077 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f0318-7f42-4ba8-88ad-7c698f5a3e2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:32.169511 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f0318-7f42-4ba8-88ad-7c698f5a3e2f None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:32.175812 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 422/843] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jun 4 08:10:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:32.181634 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f0318-7f42-4ba8-88ad-7c698f5a3e2f None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:32.203224 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9a067-911b-4e2f-a957-e5fa4adc0348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:32.203900 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9a067-911b-4e2f-a957-e5fa4adc0348 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:32.204184 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9a067-911b-4e2f-a957-e5fa4adc0348 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:32.204458 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9a067-911b-4e2f-a957-e5fa4adc0348 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:32.206105 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9a067-911b-4e2f-a957-e5fa4adc0348 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:32.206413 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9a067-911b-4e2f-a957-e5fa4adc0348 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:32.207843 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9a067-911b-4e2f-a957-e5fa4adc0348 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:32.226781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 422/844] 10.222.0.57 () {56 vars in 1135 bytes} [Sat Jun 4 08:10:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:32.235611 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9a067-911b-4e2f-a957-e5fa4adc0348 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:32.245916 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:32.296386 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f0318-7f42-4ba8-88ad-7c698f5a3e2f None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:32.332617 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d31e94-9e3b-470e-9a07-a1e446fee997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:32.333290 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d31e94-9e3b-470e-9a07-a1e446fee997 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:32.333574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d31e94-9e3b-470e-9a07-a1e446fee997 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:32.333876 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d31e94-9e3b-470e-9a07-a1e446fee997 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:32.334591 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d31e94-9e3b-470e-9a07-a1e446fee997 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:32.334898 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d31e94-9e3b-470e-9a07-a1e446fee997 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:32.337398 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d31e94-9e3b-470e-9a07-a1e446fee997 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:32.348367 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 423/845] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jun 4 08:10:32 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:32.356899 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:32.370577 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9a067-911b-4e2f-a957-e5fa4adc0348 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:32.414125 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d3d94-9e33-469a-b3ff-40218a20b935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:32.414800 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d3d94-9e33-469a-b3ff-40218a20b935 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:32.415082 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d3d94-9e33-469a-b3ff-40218a20b935 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:32.415355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d3d94-9e33-469a-b3ff-40218a20b935 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:32.497667 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d3d94-9e33-469a-b3ff-40218a20b935 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:32.499204 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d3d94-9e33-469a-b3ff-40218a20b935 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:32.592033 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:32.608585 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 423/846] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:10:32 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 08:10:32.614311 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d31e94-9e3b-470e-9a07-a1e446fee997 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:32.726425 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d31e94-9e3b-470e-9a07-a1e446fee997 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:32.747800 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:32.764214 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1f0d4-e4eb-4408-af76-045f09c9c301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:32.765249 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1f0d4-e4eb-4408-af76-045f09c9c301 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:32.765678 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1f0d4-e4eb-4408-af76-045f09c9c301 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:32.766125 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1f0d4-e4eb-4408-af76-045f09c9c301 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:32.777472 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1f0d4-e4eb-4408-af76-045f09c9c301 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:32.779130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1f0d4-e4eb-4408-af76-045f09c9c301 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:32.796718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-66c1f0d4-e4eb-4408-af76-045f09c9c301 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:32.796718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:32.796718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:32.796718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:32.796718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:32.796718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:32.796718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:32.796718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:32.796718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:32.796718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:32.796718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:32.796718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:32.796718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:32.796718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:32.796718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:32.798275 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:32.798275 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:32.798275 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:32.798275 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:32.798275 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:32.798275 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:32.798275 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:32.798275 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:32.798275 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:32.798275 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:32.798275 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:32.798275 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:32.798275 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:32.798275 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:32.798275 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:32.798275 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:32.798275 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:32.799971 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:32.799971 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:32.799971 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:32.799971 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:32.807246 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 424/847] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:32.809009 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59a642-107b-4556-9c7b-ef30f6c1b0b6 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:32.809301 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59a642-107b-4556-9c7b-ef30f6c1b0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:32.809574 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59a642-107b-4556-9c7b-ef30f6c1b0b6 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:32.811063 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 424/848] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:32.812160 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1f0d4-e4eb-4408-af76-045f09c9c301 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:32.819070 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f9493-4e48-4807-80bb-4b30aa9e07fd None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:32.819524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f9493-4e48-4807-80bb-4b30aa9e07fd None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:32.819947 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f9493-4e48-4807-80bb-4b30aa9e07fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:32.840656 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6e9f9493-4e48-4807-80bb-4b30aa9e07fd None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:32.842268 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6e9f9493-4e48-4807-80bb-4b30aa9e07fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:32.921800 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 425/849] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:10:32.932735 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1f0d4-e4eb-4408-af76-045f09c9c301 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:32.945328 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f9493-4e48-4807-80bb-4b30aa9e07fd None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:32.977344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102bff5-e114-4219-9ed5-ad741255af68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:32.978631 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102bff5-e114-4219-9ed5-ad741255af68 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:32.979097 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102bff5-e114-4219-9ed5-ad741255af68 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:32.979551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102bff5-e114-4219-9ed5-ad741255af68 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:32.980611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102bff5-e114-4219-9ed5-ad741255af68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:32.981904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102bff5-e114-4219-9ed5-ad741255af68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:32.983506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102bff5-e114-4219-9ed5-ad741255af68 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:33.004525 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 425/850] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:33.006378 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102bff5-e114-4219-9ed5-ad741255af68 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:33.050281 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:33.056912 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f9493-4e48-4807-80bb-4b30aa9e07fd None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:33.086173 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:33.102821 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa51790-687e-4973-a8f6-33d483e25856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:33.103830 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa51790-687e-4973-a8f6-33d483e25856 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:33.104253 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa51790-687e-4973-a8f6-33d483e25856 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:33.104667 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa51790-687e-4973-a8f6-33d483e25856 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:33.105450 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa51790-687e-4973-a8f6-33d483e25856 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:33.107015 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa51790-687e-4973-a8f6-33d483e25856 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:33.119524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-faa51790-687e-4973-a8f6-33d483e25856 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 08:10:33.119524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:33.119524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 08:10:33.119524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 08:10:33.119524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 08:10:33.119524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 08:10:33.119524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 08:10:33.119524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:33.119524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 08:10:33.119524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:33.119524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 08:10:33.119524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:33.119524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:33.119524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:33.119524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:33.119524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:33.120470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:33.120470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:33.120470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:33.120470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:33.120470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:33.120470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:33.120470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:33.120470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 08:10:33.120470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 08:10:33.120470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 08:10:33.120470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 08:10:33.120470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:33.120470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:33.120470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:33.120470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:33.120470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:33.121310 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:33.121310 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:33.121310 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:33.121310 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:33.121310 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:33.121310 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:33.121310 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:33.121310 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:33.121310 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:33.121310 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:33.121310 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:33.121310 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 08:10:33.121310 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:33.121310 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 08:10:33.121310 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:33.129419 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 426/851] 10.222.0.57 () {56 vars in 1132 bytes} [Sat Jun 4 08:10:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:10:33.130527 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa51790-687e-4973-a8f6-33d483e25856 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:33.142815 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102bff5-e114-4219-9ed5-ad741255af68 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:33.192991 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7222d3f-910f-4ca0-927c-597d9f2d6e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:33.194314 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7222d3f-910f-4ca0-927c-597d9f2d6e58 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:33.194646 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7222d3f-910f-4ca0-927c-597d9f2d6e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:33.195249 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7222d3f-910f-4ca0-927c-597d9f2d6e58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:33.204547 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7222d3f-910f-4ca0-927c-597d9f2d6e58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:33.207677 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7222d3f-910f-4ca0-927c-597d9f2d6e58 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:33.226434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-c7222d3f-910f-4ca0-927c-597d9f2d6e58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:33.226434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:33.226434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:33.226434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:33.226434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:33.226434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:33.226434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:33.226434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:33.226434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:33.226434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:33.226434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:33.226434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:33.226434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:10:33.226434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:10:33.226434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:10:33.227392 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:10:33.227392 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:33.227392 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:33.227392 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:33.227392 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:33.227392 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:33.227392 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:33.227392 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:33.227392 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:33.227392 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:33.227392 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:33.227392 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:33.227392 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:33.227392 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:33.227392 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:33.227392 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:33.227392 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:33.228285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:10:33.228285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:10:33.228285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:10:33.228285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:10:33.228285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:10:33.228285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:10:33.228285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:33.228285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:33.232839 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 426/852] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:10:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:33.235041 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7222d3f-910f-4ca0-927c-597d9f2d6e58 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:33.249173 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa51790-687e-4973-a8f6-33d483e25856 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:33.295918 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fde25d-9297-4d04-93ec-3f7a7ad831e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:33.296624 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fde25d-9297-4d04-93ec-3f7a7ad831e4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:33.296915 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fde25d-9297-4d04-93ec-3f7a7ad831e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:33.297251 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fde25d-9297-4d04-93ec-3f7a7ad831e4 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:33.298240 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fde25d-9297-4d04-93ec-3f7a7ad831e4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:33.298584 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fde25d-9297-4d04-93ec-3f7a7ad831e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:33.300533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fde25d-9297-4d04-93ec-3f7a7ad831e4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:33.306720 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 427/853] 10.222.0.57 () {56 vars in 1126 bytes} [Sat Jun 4 08:10:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:33.312363 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fde25d-9297-4d04-93ec-3f7a7ad831e4 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:33.337723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:33.347714 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7222d3f-910f-4ca0-927c-597d9f2d6e58 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:33.360784 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:33.384132 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fee826-ec08-4224-a0f0-975ec267f69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:33.385129 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fee826-ec08-4224-a0f0-975ec267f69c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:33.385635 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fee826-ec08-4224-a0f0-975ec267f69c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:33.386200 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fee826-ec08-4224-a0f0-975ec267f69c None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:33.387188 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fee826-ec08-4224-a0f0-975ec267f69c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:33.387690 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fee826-ec08-4224-a0f0-975ec267f69c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:33.389299 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fee826-ec08-4224-a0f0-975ec267f69c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:33.403411 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 427/854] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:10:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:33.410250 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fee826-ec08-4224-a0f0-975ec267f69c None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:33.433336 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fde25d-9297-4d04-93ec-3f7a7ad831e4 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:33.477037 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e461410-a5b6-46c5-ae60-3fddf0e86617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:33.478149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e461410-a5b6-46c5-ae60-3fddf0e86617 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:33.478659 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e461410-a5b6-46c5-ae60-3fddf0e86617 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:33.479232 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e461410-a5b6-46c5-ae60-3fddf0e86617 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:33.480124 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e461410-a5b6-46c5-ae60-3fddf0e86617 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:33.480631 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e461410-a5b6-46c5-ae60-3fddf0e86617 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:33.482250 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e461410-a5b6-46c5-ae60-3fddf0e86617 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:33.488064 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 428/855] 10.222.0.57 () {56 vars in 1126 bytes} [Sat Jun 4 08:10:33 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:33.522442 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fee826-ec08-4224-a0f0-975ec267f69c None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:33.561135 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91b61b-106f-43c0-8249-899c7e714a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:33.562189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91b61b-106f-43c0-8249-899c7e714a53 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:33.562722 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91b61b-106f-43c0-8249-899c7e714a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:33.563219 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91b61b-106f-43c0-8249-899c7e714a53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:33.564901 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91b61b-106f-43c0-8249-899c7e714a53 None admin] RBAC: Adding query filter params (role.id=431cef539cfb476aad50d2470e763b5f, scope.project.id=634c9a1745ef44c0ad66e02493d79af0, user.id=05ea412cab4244c58a2670c66f5a311c) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:33.565429 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91b61b-106f-43c0-8249-899c7e714a53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:33.567263 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91b61b-106f-43c0-8249-899c7e714a53 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:33.576347 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 428/856] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:10:33 2022] GET /identity/v3/role_assignments?user.id=05ea412cab4244c58a2670c66f5a311c&scope.project.id=634c9a1745ef44c0ad66e02493d79af0&role.id=431cef539cfb476aad50d2470e763b5f => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:34.039201 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af8a58-0d1c-4e05-b02d-5aef36d23239 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:34.039572 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af8a58-0d1c-4e05-b02d-5aef36d23239 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:34.039751 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af8a58-0d1c-4e05-b02d-5aef36d23239 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:34.041242 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 429/857] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:34.046840 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce924a0-ca08-46b5-a201-11573c4092a8 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:34.047708 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce924a0-ca08-46b5-a201-11573c4092a8 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:34.048198 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce924a0-ca08-46b5-a201-11573c4092a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:34.066322 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-fce924a0-ca08-46b5-a201-11573c4092a8 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:34.067864 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-fce924a0-ca08-46b5-a201-11573c4092a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:34.080771 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:34.145067 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 429/858] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 08:10:34.168014 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af8a58-0d1c-4e05-b02d-5aef36d23239 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:34.278753 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af8a58-0d1c-4e05-b02d-5aef36d23239 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:34.288906 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:34.314373 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e878771-62db-46e4-a0b7-c8062985848c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:34.315389 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e878771-62db-46e4-a0b7-c8062985848c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:34.315864 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e878771-62db-46e4-a0b7-c8062985848c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:34.316450 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e878771-62db-46e4-a0b7-c8062985848c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:34.327936 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e878771-62db-46e4-a0b7-c8062985848c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:10:34.336721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-7e878771-62db-46e4-a0b7-c8062985848c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:10:34.336721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:34.336721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:34.336721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:34.336721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:34.336721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:34.336721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:34.336721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:34.336721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:34.336721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:34.336721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:34.336721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:34.336721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:10:34.336721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:10:34.336721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:10:34.336721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:10:34.337794 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:10:34.337794 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:10:34.337794 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:10:34.337794 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:10:34.337794 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:34.337794 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:34.337794 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:34.337794 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:34.337794 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:34.337794 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:34.337794 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:34.337794 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:34.337794 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:34.337794 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:34.337794 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:34.337794 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:34.339186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:34.339186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:34.339186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:34.339186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:34.339186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:10:34.339186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:10:34.339186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:10:34.339186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:10:34.339186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:10:34.339186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:10:34.339186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:10:34.339186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:34.339186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 430/859] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jun 4 08:10:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:34.347073 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce924a0-ca08-46b5-a201-11573c4092a8 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:34.450008 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce924a0-ca08-46b5-a201-11573c4092a8 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:34.485125 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046e98f-deab-4f56-ab69-50fc54c660b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:34.485894 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046e98f-deab-4f56-ab69-50fc54c660b3 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:34.486199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046e98f-deab-4f56-ab69-50fc54c660b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:34.486480 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046e98f-deab-4f56-ab69-50fc54c660b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:34.487238 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046e98f-deab-4f56-ab69-50fc54c660b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:34.487549 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046e98f-deab-4f56-ab69-50fc54c660b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:34.488938 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046e98f-deab-4f56-ab69-50fc54c660b3 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:34.497556 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 430/860] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jun 4 08:10:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:34.503029 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e878771-62db-46e4-a0b7-c8062985848c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:34.612421 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e878771-62db-46e4-a0b7-c8062985848c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:34.647547 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d770627-953f-452a-ae24-79059cd3fcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:34.648340 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d770627-953f-452a-ae24-79059cd3fcd2 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:34.648622 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d770627-953f-452a-ae24-79059cd3fcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:34.648895 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d770627-953f-452a-ae24-79059cd3fcd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:34.659791 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d770627-953f-452a-ae24-79059cd3fcd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:34.661247 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d770627-953f-452a-ae24-79059cd3fcd2 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:34.670266 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a7eb5-4d04-4400-bb1a-c5688cc2d66e None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:34.670551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a7eb5-4d04-4400-bb1a-c5688cc2d66e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:34.670828 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a7eb5-4d04-4400-bb1a-c5688cc2d66e None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:34.672403 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 431/861] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:34.677356 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56ea94-9a25-44b4-bf39-57f2c6d41e1d None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:34.677641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56ea94-9a25-44b4-bf39-57f2c6d41e1d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:34.677955 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56ea94-9a25-44b4-bf39-57f2c6d41e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:34.679156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-7d770627-953f-452a-ae24-79059cd3fcd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:34.679156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:34.679156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:34.679156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:34.679156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:34.679156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:34.679156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:34.679156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:34.679156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:34.679156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:34.679156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:34.679156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:34.679156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:34.679156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:34.679156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:34.680050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:34.680050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:34.680050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:34.680050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:34.680050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:34.680050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:34.680050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:34.680050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:34.680050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:34.680050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:34.680050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:34.680050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:34.680050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:34.680050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:34.680050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:34.680050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:34.680050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:34.680991 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:34.680991 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:34.680991 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:34.680991 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:34.680991 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 431/862] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:34.687278 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d770627-953f-452a-ae24-79059cd3fcd2 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:34.700109 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-6b56ea94-9a25-44b4-bf39-57f2c6d41e1d None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:34.701228 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-6b56ea94-9a25-44b4-bf39-57f2c6d41e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:34.714155 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:34.722231 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:34.777199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 432/863] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 08:10:34.800700 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56ea94-9a25-44b4-bf39-57f2c6d41e1d None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:34.808621 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d770627-953f-452a-ae24-79059cd3fcd2 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:34.843858 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afbf17-b08d-4f29-af4a-85e0c1ea34c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:34.844523 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afbf17-b08d-4f29-af4a-85e0c1ea34c4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:34.844802 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afbf17-b08d-4f29-af4a-85e0c1ea34c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:34.845077 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afbf17-b08d-4f29-af4a-85e0c1ea34c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:34.845837 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70afbf17-b08d-4f29-af4a-85e0c1ea34c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:34.846151 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70afbf17-b08d-4f29-af4a-85e0c1ea34c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:34.847521 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70afbf17-b08d-4f29-af4a-85e0c1ea34c4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:34.859951 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 432/864] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:34.866528 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afbf17-b08d-4f29-af4a-85e0c1ea34c4 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:34.918451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56ea94-9a25-44b4-bf39-57f2c6d41e1d None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:34.957179 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beee3f2-b861-41ef-8b99-97b6496b0901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:34.958217 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beee3f2-b861-41ef-8b99-97b6496b0901 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:34.958650 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beee3f2-b861-41ef-8b99-97b6496b0901 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:34.959175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beee3f2-b861-41ef-8b99-97b6496b0901 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:34.960036 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beee3f2-b861-41ef-8b99-97b6496b0901 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:34.961542 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beee3f2-b861-41ef-8b99-97b6496b0901 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:34.972315 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:34.979876 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:34.997984 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 433/865] 10.222.0.57 () {60 vars in 1141 bytes} [Sat Jun 4 08:10:34 2022] POST /identity/v3/services => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:10:35.007648 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afbf17-b08d-4f29-af4a-85e0c1ea34c4 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:35.056010 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3d5a6-59de-4b25-a9fb-fc6eadc0b1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:35.056823 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3d5a6-59de-4b25-a9fb-fc6eadc0b1e2 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:35.057100 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3d5a6-59de-4b25-a9fb-fc6eadc0b1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:35.057373 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3d5a6-59de-4b25-a9fb-fc6eadc0b1e2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:35.066831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3d5a6-59de-4b25-a9fb-fc6eadc0b1e2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:35.068335 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3d5a6-59de-4b25-a9fb-fc6eadc0b1e2 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:35.086025 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-0fb3d5a6-59de-4b25-a9fb-fc6eadc0b1e2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 08:10:35.086025 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:35.086025 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:35.086025 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:35.086025 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:35.086025 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:35.086025 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:35.086025 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:35.086025 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:35.086025 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:35.086025 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:35.086025 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:35.086025 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:10:35.086025 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:10:35.086025 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:10:35.086025 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:10:35.087046 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:35.087046 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:35.087046 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:10:35.087046 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:35.087046 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:10:35.087046 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:35.087046 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:35.087046 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:35.087046 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:35.087046 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:35.087046 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:35.087046 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:35.087046 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:35.087046 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:35.087046 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:35.087046 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:35.087046 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:35.087046 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:35.088020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:35.088020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:35.088020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:10:35.088020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:10:35.088020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:10:35.088020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:10:35.088020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:10:35.088020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:10:35.088020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 08:10:35.088020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:35.088020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 433/866] 10.222.0.57 () {56 vars in 1117 bytes} [Sat Jun 4 08:10:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:10:35.099129 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beee3f2-b861-41ef-8b99-97b6496b0901 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:35.214353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beee3f2-b861-41ef-8b99-97b6496b0901 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:35.252332 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25124d77-82ef-47b4-bee4-be31e25fdd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:35.253004 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25124d77-82ef-47b4-bee4-be31e25fdd07 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:35.253294 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25124d77-82ef-47b4-bee4-be31e25fdd07 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:35.253565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25124d77-82ef-47b4-bee4-be31e25fdd07 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:35.254439 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25124d77-82ef-47b4-bee4-be31e25fdd07 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:35.254748 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25124d77-82ef-47b4-bee4-be31e25fdd07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:35.256183 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25124d77-82ef-47b4-bee4-be31e25fdd07 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:35.274656 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 434/867] 10.222.0.57 () {56 vars in 1149 bytes} [Sat Jun 4 08:10:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:35.280168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3d5a6-59de-4b25-a9fb-fc6eadc0b1e2 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:35.385230 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3d5a6-59de-4b25-a9fb-fc6eadc0b1e2 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:35.421476 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c1891-fec1-4ac7-940a-d71da4cb0661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:35.422436 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c1891-fec1-4ac7-940a-d71da4cb0661 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:35.422877 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c1891-fec1-4ac7-940a-d71da4cb0661 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:35.423326 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c1891-fec1-4ac7-940a-d71da4cb0661 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:35.427816 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:35.497712 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c1891-fec1-4ac7-940a-d71da4cb0661 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:35.499520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c1891-fec1-4ac7-940a-d71da4cb0661 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:35.606458 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 434/868] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:10:35 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 08:10:35.612289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25124d77-82ef-47b4-bee4-be31e25fdd07 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:35.670725 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:35.724557 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25124d77-82ef-47b4-bee4-be31e25fdd07 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:35.767705 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4b871-0b73-4251-85aa-0d5a360e17f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:35.768955 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4b871-0b73-4251-85aa-0d5a360e17f3 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:35.769474 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4b871-0b73-4251-85aa-0d5a360e17f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:35.769992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4b871-0b73-4251-85aa-0d5a360e17f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:35.781299 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4b871-0b73-4251-85aa-0d5a360e17f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:35.783321 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4b871-0b73-4251-85aa-0d5a360e17f3 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:35.802762 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-01a4b871-0b73-4251-85aa-0d5a360e17f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:35.802762 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:35.802762 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:35.802762 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:35.802762 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:35.802762 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:35.802762 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:35.802762 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:35.802762 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:35.802762 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:35.802762 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:35.802762 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:35.802762 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:35.802762 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:35.802762 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:35.804046 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:35.804046 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:35.804046 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:35.804046 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:35.804046 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:35.804046 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:35.804046 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:35.804046 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:35.804046 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:35.804046 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:35.804046 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:35.804046 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:35.804046 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:35.804046 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:35.804046 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:35.804046 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:35.804046 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:35.805040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:35.805040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:35.805040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:35.805040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:35.807324 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 435/869] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:35.817848 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c1891-fec1-4ac7-940a-d71da4cb0661 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:35.848726 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:35.905216 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249f0b6-5207-4205-9401-58d64d9dda3a None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:35.905904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249f0b6-5207-4205-9401-58d64d9dda3a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:35.906389 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249f0b6-5207-4205-9401-58d64d9dda3a None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:35.907905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 436/870] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:35.913259 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c3abc-ef95-4a21-9441-cfee5d79c92c None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:35.913866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c3abc-ef95-4a21-9441-cfee5d79c92c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:35.914362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c3abc-ef95-4a21-9441-cfee5d79c92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:35.929646 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c1891-fec1-4ac7-940a-d71da4cb0661 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:35.935188 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-f53c3abc-ef95-4a21-9441-cfee5d79c92c None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:35.936607 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f53c3abc-ef95-4a21-9441-cfee5d79c92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:35.970906 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890fe13-3d72-4e0c-a05b-b526e5ce5297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:35.971587 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890fe13-3d72-4e0c-a05b-b526e5ce5297 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:35.971860 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890fe13-3d72-4e0c-a05b-b526e5ce5297 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:35.972133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890fe13-3d72-4e0c-a05b-b526e5ce5297 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:35.972857 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890fe13-3d72-4e0c-a05b-b526e5ce5297 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:35.973195 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890fe13-3d72-4e0c-a05b-b526e5ce5297 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:35.974632 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890fe13-3d72-4e0c-a05b-b526e5ce5297 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:35.989914 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 435/871] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:35.996243 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890fe13-3d72-4e0c-a05b-b526e5ce5297 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:36.029983 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 437/872] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:35 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:10:36.034504 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d72c2e-9b12-4631-8949-f094323bbdd1 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:36.034795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d72c2e-9b12-4631-8949-f094323bbdd1 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:36.035074 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d72c2e-9b12-4631-8949-f094323bbdd1 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:36.040248 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 438/873] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 08:10:36.041406 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c06a1c-49c4-4465-be51-17825da0ce92 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:36.041696 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c06a1c-49c4-4465-be51-17825da0ce92 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:36.042005 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c06a1c-49c4-4465-be51-17825da0ce92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:36.060970 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-f6c06a1c-49c4-4465-be51-17825da0ce92 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:36.061409 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f6c06a1c-49c4-4465-be51-17825da0ce92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:36.095890 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:36.101546 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890fe13-3d72-4e0c-a05b-b526e5ce5297 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:36.102001 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:36.138420 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0df12-1c03-45cd-b689-95cf5c4633d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:36.139292 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0df12-1c03-45cd-b689-95cf5c4633d2 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:36.139578 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0df12-1c03-45cd-b689-95cf5c4633d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:36.139855 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0df12-1c03-45cd-b689-95cf5c4633d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:36.142797 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 439/874] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:36 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:10:36.143758 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c06a1c-49c4-4465-be51-17825da0ce92 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:36.156758 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0df12-1c03-45cd-b689-95cf5c4633d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:36.158308 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0df12-1c03-45cd-b689-95cf5c4633d2 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:36.172722 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-e3e0df12-1c03-45cd-b689-95cf5c4633d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:36.172722 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:36.172722 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:36.172722 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:36.172722 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:36.172722 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:36.172722 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:36.172722 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:36.172722 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:36.172722 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:36.172722 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:36.172722 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:36.172722 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:10:36.172722 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:10:36.172722 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:10:36.173708 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:10:36.173708 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:36.173708 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:36.173708 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:36.173708 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:36.173708 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:36.173708 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:36.173708 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:36.173708 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:36.173708 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:36.173708 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:36.173708 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:36.173708 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:36.173708 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:36.173708 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:36.173708 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:36.173708 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:36.175165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:10:36.175165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:10:36.175165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:10:36.175165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:10:36.175165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:10:36.175165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:10:36.175165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:36.175165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:36.175165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 436/875] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:10:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:10:36.175165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0df12-1c03-45cd-b689-95cf5c4633d2 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:36.255527 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c06a1c-49c4-4465-be51-17825da0ce92 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:36.280363 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0df12-1c03-45cd-b689-95cf5c4633d2 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:36.293253 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12e103-61bc-4889-8331-eb431c43094f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:36.293956 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12e103-61bc-4889-8331-eb431c43094f None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:36.294233 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12e103-61bc-4889-8331-eb431c43094f None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:36.294509 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12e103-61bc-4889-8331-eb431c43094f None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:36.295240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12e103-61bc-4889-8331-eb431c43094f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:36.296620 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12e103-61bc-4889-8331-eb431c43094f None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:36.322071 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 440/876] 10.222.0.57 () {60 vars in 1141 bytes} [Sat Jun 4 08:10:36 2022] POST /identity/v3/services => generated 269 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:10:36.323618 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12e103-61bc-4889-8331-eb431c43094f None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:36.327054 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4f651-925d-4862-8478-96ad27270061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:36.328007 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4f651-925d-4862-8478-96ad27270061 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:36.328575 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4f651-925d-4862-8478-96ad27270061 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:36.328950 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4f651-925d-4862-8478-96ad27270061 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:36.330343 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d4f651-925d-4862-8478-96ad27270061 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:36.331898 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d4f651-925d-4862-8478-96ad27270061 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:36.345721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-f0d4f651-925d-4862-8478-96ad27270061 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 08:10:36.345721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:36.345721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 08:10:36.345721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 08:10:36.345721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 08:10:36.345721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 08:10:36.345721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 08:10:36.345721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:36.345721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 08:10:36.345721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:36.345721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 08:10:36.345721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:36.345721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:36.345721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:36.345721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:36.345721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:36.345721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:36.347133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:36.347133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:36.347133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:36.347133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:36.347133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:36.347133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:36.347133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 08:10:36.347133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 08:10:36.347133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 08:10:36.347133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 08:10:36.347133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:36.347133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:36.347133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:36.347133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:36.347133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:36.347133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:36.350151 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:36.350151 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:36.350151 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:36.350151 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:36.350151 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:36.350151 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:36.350151 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:36.350151 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:36.350151 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:36.350151 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:36.350151 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 08:10:36.350151 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:36.350151 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 08:10:36.350151 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:36.350151 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 437/877] 10.222.0.57 () {56 vars in 1126 bytes} [Sat Jun 4 08:10:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:36.359050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4f651-925d-4862-8478-96ad27270061 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:36.363361 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:36.442253 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:36.472248 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12e103-61bc-4889-8331-eb431c43094f None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:36.504181 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4f651-925d-4862-8478-96ad27270061 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:36.516350 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a5cdf-479e-48f8-a6ba-537137b454cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:36.517156 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a5cdf-479e-48f8-a6ba-537137b454cb None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:36.517444 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a5cdf-479e-48f8-a6ba-537137b454cb None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:36.517714 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a5cdf-479e-48f8-a6ba-537137b454cb None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:36.518550 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a5cdf-479e-48f8-a6ba-537137b454cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:36.518860 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a5cdf-479e-48f8-a6ba-537137b454cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:36.520291 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a5cdf-479e-48f8-a6ba-537137b454cb None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:36.534657 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 441/878] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:10:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:36.540094 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a5cdf-479e-48f8-a6ba-537137b454cb None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:36.554892 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990eddf-875f-4cf2-825e-d2fe54e75a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:36.555565 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990eddf-875f-4cf2-825e-d2fe54e75a63 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:36.555849 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990eddf-875f-4cf2-825e-d2fe54e75a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:36.556129 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990eddf-875f-4cf2-825e-d2fe54e75a63 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:36.556999 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990eddf-875f-4cf2-825e-d2fe54e75a63 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:36.557688 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990eddf-875f-4cf2-825e-d2fe54e75a63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:36.559404 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990eddf-875f-4cf2-825e-d2fe54e75a63 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:36.565629 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 438/879] 10.222.0.57 () {56 vars in 1122 bytes} [Sat Jun 4 08:10:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:36.570927 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990eddf-875f-4cf2-825e-d2fe54e75a63 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:36.646441 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:36.662614 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a5cdf-479e-48f8-a6ba-537137b454cb None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:36.677815 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:36.700242 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990eddf-875f-4cf2-825e-d2fe54e75a63 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:36.711599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4dd19-4b6e-4256-ad89-02d32c570d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:36.712262 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4dd19-4b6e-4256-ad89-02d32c570d84 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:36.712576 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4dd19-4b6e-4256-ad89-02d32c570d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:36.713250 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4dd19-4b6e-4256-ad89-02d32c570d84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:36.714301 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4dd19-4b6e-4256-ad89-02d32c570d84 None admin] RBAC: Adding query filter params (role.id=c9ec7276464a4d87ab2b6fc52a3bfeae, scope.project.id=634c9a1745ef44c0ad66e02493d79af0, user.id=aff5d82384e84b669eeb00089ab8e09a) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:36.714717 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4dd19-4b6e-4256-ad89-02d32c570d84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:36.716432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4dd19-4b6e-4256-ad89-02d32c570d84 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:36.731182 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 442/880] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:10:36 2022] GET /identity/v3/role_assignments?user.id=aff5d82384e84b669eeb00089ab8e09a&scope.project.id=634c9a1745ef44c0ad66e02493d79af0&role.id=c9ec7276464a4d87ab2b6fc52a3bfeae => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:36.746368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a7c6e-b790-426d-a2ba-a8248bd03b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:36.747052 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a7c6e-b790-426d-a2ba-a8248bd03b2d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:36.747339 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a7c6e-b790-426d-a2ba-a8248bd03b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:36.747620 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a7c6e-b790-426d-a2ba-a8248bd03b2d None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:36.748340 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a7c6e-b790-426d-a2ba-a8248bd03b2d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:36.748721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a7c6e-b790-426d-a2ba-a8248bd03b2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:36.750259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a7c6e-b790-426d-a2ba-a8248bd03b2d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:36.756871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 439/881] 10.222.0.57 () {56 vars in 1122 bytes} [Sat Jun 4 08:10:36 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:37.436456 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acb205-fc89-455a-94f9-09c6a3717eb6 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:37.437006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acb205-fc89-455a-94f9-09c6a3717eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:37.437006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acb205-fc89-455a-94f9-09c6a3717eb6 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:37.438623 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 443/882] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:37.443978 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd540a2-b806-4a98-bce2-971651ff64f9 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:37.444418 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd540a2-b806-4a98-bce2-971651ff64f9 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:37.444616 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd540a2-b806-4a98-bce2-971651ff64f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:37.461921 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-3cd540a2-b806-4a98-bce2-971651ff64f9 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:37.463097 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3cd540a2-b806-4a98-bce2-971651ff64f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:37.533875 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 440/883] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:10:37.556529 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5acb205-fc89-455a-94f9-09c6a3717eb6 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:37.669585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5acb205-fc89-455a-94f9-09c6a3717eb6 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:37.706482 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62097789-573f-435f-ba56-0e5d657aaa18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:37.707271 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62097789-573f-435f-ba56-0e5d657aaa18 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:37.707558 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62097789-573f-435f-ba56-0e5d657aaa18 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:37.707838 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62097789-573f-435f-ba56-0e5d657aaa18 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:37.708490 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62097789-573f-435f-ba56-0e5d657aaa18 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:37.709895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62097789-573f-435f-ba56-0e5d657aaa18 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:37.722186 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-62097789-573f-435f-ba56-0e5d657aaa18 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 08:10:37.722186 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:37.722186 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 08:10:37.722186 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 08:10:37.722186 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 08:10:37.722186 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 08:10:37.722186 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 08:10:37.722186 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:37.722186 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 08:10:37.722186 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:37.722186 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 08:10:37.722186 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:37.722186 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:37.722186 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:37.722186 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:37.722186 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:37.722186 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:37.723225 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:37.723225 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:37.723225 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:37.723225 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:37.723225 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:37.723225 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:37.723225 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 08:10:37.723225 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 08:10:37.723225 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 08:10:37.723225 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 08:10:37.723225 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:37.723225 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:37.723225 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:37.723225 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:37.723225 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:37.723225 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:37.724704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:37.724704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:37.724704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:37.724704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:37.724704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:37.724704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:37.724704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:37.724704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:37.724704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:37.724704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:37.724704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 08:10:37.724704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:37.724704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 08:10:37.724704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:37.724704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 444/884] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jun 4 08:10:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:37.729633 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd540a2-b806-4a98-bce2-971651ff64f9 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:37.809984 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:37.836632 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd540a2-b806-4a98-bce2-971651ff64f9 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:37.870797 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704cf21-cb32-430b-bc1c-9107b801708d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:37.871463 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704cf21-cb32-430b-bc1c-9107b801708d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:37.871745 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704cf21-cb32-430b-bc1c-9107b801708d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:37.872019 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704cf21-cb32-430b-bc1c-9107b801708d None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:37.872725 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704cf21-cb32-430b-bc1c-9107b801708d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:37.873028 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704cf21-cb32-430b-bc1c-9107b801708d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:37.874479 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704cf21-cb32-430b-bc1c-9107b801708d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:37.880021 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 441/885] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jun 4 08:10:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:37.885217 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62097789-573f-435f-ba56-0e5d657aaa18 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:37.905995 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:38.008999 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62097789-573f-435f-ba56-0e5d657aaa18 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:38.044495 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38914b42-6313-4680-8321-175b3866089f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:38.045162 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38914b42-6313-4680-8321-175b3866089f None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:38.045443 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38914b42-6313-4680-8321-175b3866089f None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:38.045715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38914b42-6313-4680-8321-175b3866089f None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:38.046457 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38914b42-6313-4680-8321-175b3866089f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:38.046758 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38914b42-6313-4680-8321-175b3866089f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:38.048144 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38914b42-6313-4680-8321-175b3866089f None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:38.054652 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 445/886] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jun 4 08:10:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:38.060025 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704cf21-cb32-430b-bc1c-9107b801708d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:38.165392 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704cf21-cb32-430b-bc1c-9107b801708d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:38.206052 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e4f4e-f72a-4965-9174-ae4089b67af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:38.206717 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e4f4e-f72a-4965-9174-ae4089b67af2 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:38.207055 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e4f4e-f72a-4965-9174-ae4089b67af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:38.207332 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e4f4e-f72a-4965-9174-ae4089b67af2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:38.208121 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e4f4e-f72a-4965-9174-ae4089b67af2 None admin] RBAC: Adding query filter params (interface=public, service_id=db7dd79b73144215902fc3c8decca34e, region_id=RegionOne) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:38.208431 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e4f4e-f72a-4965-9174-ae4089b67af2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:38.209795 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e4f4e-f72a-4965-9174-ae4089b67af2 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:38.215354 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 442/887] 10.222.0.57 () {56 vars in 1251 bytes} [Sat Jun 4 08:10:38 2022] GET /identity/v3/endpoints?service_id=db7dd79b73144215902fc3c8decca34e&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:38.220779 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38914b42-6313-4680-8321-175b3866089f None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:38.309086 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:38.329176 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38914b42-6313-4680-8321-175b3866089f None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:38.365230 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca6d50-6538-4a31-9028-827fd958a495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:38.365925 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca6d50-6538-4a31-9028-827fd958a495 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:38.366299 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca6d50-6538-4a31-9028-827fd958a495 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:38.366594 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca6d50-6538-4a31-9028-827fd958a495 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:38.367249 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca6d50-6538-4a31-9028-827fd958a495 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:38.368607 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca6d50-6538-4a31-9028-827fd958a495 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:38.374826 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 446/888] 10.222.0.57 () {56 vars in 1087 bytes} [Sat Jun 4 08:10:38 2022] GET /identity/v3/services => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:10:38.776935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112fa9f-12db-4ba2-b4e0-caa949896142 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:38.778111 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112fa9f-12db-4ba2-b4e0-caa949896142 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:38.778616 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112fa9f-12db-4ba2-b4e0-caa949896142 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:38.780746 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 443/889] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:38.787775 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bb6db-e8f2-4fe8-9d23-d0717022a642 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:38.788757 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bb6db-e8f2-4fe8-9d23-d0717022a642 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:38.789297 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bb6db-e8f2-4fe8-9d23-d0717022a642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:38.807877 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-033bb6db-e8f2-4fe8-9d23-d0717022a642 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:38.809461 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-033bb6db-e8f2-4fe8-9d23-d0717022a642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:38.885925 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 447/890] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:10:38.904010 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112fa9f-12db-4ba2-b4e0-caa949896142 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:38.907299 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:39.012811 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112fa9f-12db-4ba2-b4e0-caa949896142 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:39.048293 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1ff64-bea3-41f0-97c3-6c956eeddb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:39.049025 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1ff64-bea3-41f0-97c3-6c956eeddb44 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:39.049310 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1ff64-bea3-41f0-97c3-6c956eeddb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:39.049588 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1ff64-bea3-41f0-97c3-6c956eeddb44 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:39.050281 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1ff64-bea3-41f0-97c3-6c956eeddb44 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:39.051789 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1ff64-bea3-41f0-97c3-6c956eeddb44 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:39.064554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-d3e1ff64-bea3-41f0-97c3-6c956eeddb44 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 08:10:39.064554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:39.064554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 08:10:39.064554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 08:10:39.064554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 08:10:39.064554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 08:10:39.064554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 08:10:39.064554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:39.064554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 08:10:39.064554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:39.064554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 08:10:39.064554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:39.064554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:39.064554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:39.064554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:39.064554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:39.065541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:39.065541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:39.065541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:39.065541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:39.065541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:39.065541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:39.065541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:39.065541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 08:10:39.065541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 08:10:39.065541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 08:10:39.065541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 08:10:39.065541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:39.065541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:39.065541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:39.065541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:39.065541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:39.066438 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:39.066438 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:39.066438 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:39.066438 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:39.066438 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:39.066438 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:39.066438 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:39.066438 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:39.066438 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:39.066438 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:39.066438 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:39.066438 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 08:10:39.066438 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:39.066438 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 08:10:39.066438 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:39.066438 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 444/891] 10.222.0.57 () {56 vars in 1132 bytes} [Sat Jun 4 08:10:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:39.071871 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bb6db-e8f2-4fe8-9d23-d0717022a642 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:39.100135 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f69d65-1fbc-4a42-8960-4abbf053a65e None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:39.100473 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f69d65-1fbc-4a42-8960-4abbf053a65e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:39.100664 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f69d65-1fbc-4a42-8960-4abbf053a65e None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:39.102322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 445/892] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:39.107271 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877d717-8012-49ef-b40c-cb2ecb9e17fa None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:39.107555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877d717-8012-49ef-b40c-cb2ecb9e17fa None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:39.107833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877d717-8012-49ef-b40c-cb2ecb9e17fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:39.125170 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-2877d717-8012-49ef-b40c-cb2ecb9e17fa None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:39.126925 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2877d717-8012-49ef-b40c-cb2ecb9e17fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:39.167573 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:39.194659 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:39.200616 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bb6db-e8f2-4fe8-9d23-d0717022a642 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:39.205863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 446/893] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:10:39.205863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552bb8f-0cd2-45be-a11d-f1d577b2bfda None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:39.205863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552bb8f-0cd2-45be-a11d-f1d577b2bfda None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:39.205863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552bb8f-0cd2-45be-a11d-f1d577b2bfda None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:39.207238 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 447/894] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:39.213490 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b5914-94b6-496b-87e5-875c202a3252 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:39.214078 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b5914-94b6-496b-87e5-875c202a3252 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:39.214574 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b5914-94b6-496b-87e5-875c202a3252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:39.237970 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f02b5914-94b6-496b-87e5-875c202a3252 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:39.239141 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f02b5914-94b6-496b-87e5-875c202a3252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:39.255215 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1a55d-4bb0-4279-9eb6-3f1d0018d058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:39.256259 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1a55d-4bb0-4279-9eb6-3f1d0018d058 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:39.256547 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1a55d-4bb0-4279-9eb6-3f1d0018d058 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:39.256977 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1a55d-4bb0-4279-9eb6-3f1d0018d058 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:39.257685 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1a55d-4bb0-4279-9eb6-3f1d0018d058 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:39.258086 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1a55d-4bb0-4279-9eb6-3f1d0018d058 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:39.259393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1a55d-4bb0-4279-9eb6-3f1d0018d058 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:39.269056 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 448/895] 10.222.0.57 () {56 vars in 1126 bytes} [Sat Jun 4 08:10:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:39.269056 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1a55d-4bb0-4279-9eb6-3f1d0018d058 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:39.316463 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 448/896] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 08:10:39.317081 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b5914-94b6-496b-87e5-875c202a3252 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:39.386155 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1a55d-4bb0-4279-9eb6-3f1d0018d058 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:39.420697 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e6c1a-579d-4c14-9249-b260ab4bee96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:39.421501 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e6c1a-579d-4c14-9249-b260ab4bee96 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:39.421772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e6c1a-579d-4c14-9249-b260ab4bee96 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:39.422088 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e6c1a-579d-4c14-9249-b260ab4bee96 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:39.424145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b5914-94b6-496b-87e5-875c202a3252 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:39.429149 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:39.433410 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e6c1a-579d-4c14-9249-b260ab4bee96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:10:39.442611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-156e6c1a-579d-4c14-9249-b260ab4bee96 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 08:10:39.442611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:39.442611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:39.442611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:39.442611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:39.442611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:39.442611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:39.442611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:39.442611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:39.442611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:39.442611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:39.442611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:39.442611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:10:39.442611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:10:39.442611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:10:39.442611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:10:39.443580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:10:39.443580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:10:39.443580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:10:39.443580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:10:39.443580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:39.443580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:39.443580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:39.443580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:39.443580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:39.443580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:39.443580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:39.443580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:39.443580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:39.443580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:39.443580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:39.443580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:39.444442 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:39.444442 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:39.444442 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:39.444442 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:39.444442 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:10:39.444442 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:10:39.444442 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:10:39.444442 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:10:39.444442 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:10:39.444442 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:10:39.444442 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 08:10:39.444442 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:39.448631 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 449/897] 10.222.0.57 () {56 vars in 1120 bytes} [Sat Jun 4 08:10:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:39.449435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e6c1a-579d-4c14-9249-b260ab4bee96 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:39.455780 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:39.465897 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f652ed-6236-4b2d-9202-2491d0acefc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:39.466376 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f652ed-6236-4b2d-9202-2491d0acefc7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:39.466660 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f652ed-6236-4b2d-9202-2491d0acefc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:39.467032 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f652ed-6236-4b2d-9202-2491d0acefc7 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:39.467637 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f652ed-6236-4b2d-9202-2491d0acefc7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:39.467947 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f652ed-6236-4b2d-9202-2491d0acefc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:39.469457 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f652ed-6236-4b2d-9202-2491d0acefc7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:39.479147 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 449/898] 10.222.0.57 () {56 vars in 1126 bytes} [Sat Jun 4 08:10:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:39.479147 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f652ed-6236-4b2d-9202-2491d0acefc7 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:39.562056 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e6c1a-579d-4c14-9249-b260ab4bee96 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:39.586920 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f652ed-6236-4b2d-9202-2491d0acefc7 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:39.598732 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80b43d-d87c-4ffb-abd5-a9a6b8e7094c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:39.599426 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80b43d-d87c-4ffb-abd5-a9a6b8e7094c None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:39.599706 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80b43d-d87c-4ffb-abd5-a9a6b8e7094c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:39.599976 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80b43d-d87c-4ffb-abd5-a9a6b8e7094c None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:39.600749 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80b43d-d87c-4ffb-abd5-a9a6b8e7094c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:39.602124 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80b43d-d87c-4ffb-abd5-a9a6b8e7094c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:39.616357 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 450/899] 10.222.0.57 () {60 vars in 1141 bytes} [Sat Jun 4 08:10:39 2022] POST /identity/v3/services => generated 241 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:10:39.616992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80b43d-d87c-4ffb-abd5-a9a6b8e7094c None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:39.644686 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691d302-5106-4371-90fb-4ec5f4d680b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:39.645375 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691d302-5106-4371-90fb-4ec5f4d680b8 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:39.645654 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691d302-5106-4371-90fb-4ec5f4d680b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:39.646006 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691d302-5106-4371-90fb-4ec5f4d680b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:39.646894 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b691d302-5106-4371-90fb-4ec5f4d680b8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:39.647203 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b691d302-5106-4371-90fb-4ec5f4d680b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:39.648903 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b691d302-5106-4371-90fb-4ec5f4d680b8 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:39.662023 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 450/900] 10.222.0.57 () {56 vars in 1115 bytes} [Sat Jun 4 08:10:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:39.667818 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691d302-5106-4371-90fb-4ec5f4d680b8 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:39.707049 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:39.738247 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:39.775673 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80b43d-d87c-4ffb-abd5-a9a6b8e7094c None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:39.797021 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691d302-5106-4371-90fb-4ec5f4d680b8 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:39.832534 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a90b50-69de-4cbe-8809-744bc771f4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:39.833243 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a90b50-69de-4cbe-8809-744bc771f4dc None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:39.833524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a90b50-69de-4cbe-8809-744bc771f4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:39.833795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a90b50-69de-4cbe-8809-744bc771f4dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:39.834622 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a90b50-69de-4cbe-8809-744bc771f4dc None admin] RBAC: Adding query filter params (interface=public, service_id=acdde161cb6942af9489710b78cfe1a7, region_id=RegionOne) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:39.834933 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a90b50-69de-4cbe-8809-744bc771f4dc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:39.836288 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a90b50-69de-4cbe-8809-744bc771f4dc None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:39.843236 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 451/901] 10.222.0.57 () {56 vars in 1251 bytes} [Sat Jun 4 08:10:39 2022] GET /identity/v3/endpoints?service_id=acdde161cb6942af9489710b78cfe1a7&interface=public®ion_id=RegionOne => generated 194 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:39.845685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ce69b-6fca-4b2f-9451-c22355b203ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:39.846506 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ce69b-6fca-4b2f-9451-c22355b203ca None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:39.846780 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ce69b-6fca-4b2f-9451-c22355b203ca None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:39.847047 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ce69b-6fca-4b2f-9451-c22355b203ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:39.849091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a90b50-69de-4cbe-8809-744bc771f4dc None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:39.863778 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ce69b-6fca-4b2f-9451-c22355b203ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:39.865085 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ce69b-6fca-4b2f-9451-c22355b203ca None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:39.883705 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-288ce69b-6fca-4b2f-9451-c22355b203ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:39.883705 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:39.883705 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:39.883705 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:39.883705 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:39.883705 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:39.883705 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:39.883705 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:39.883705 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:39.883705 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:39.883705 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:39.883705 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:39.883705 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:39.883705 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:39.883705 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:39.884741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:39.884741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:39.884741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:39.884741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:39.884741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:39.884741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:39.884741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:39.884741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:39.884741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:39.884741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:39.884741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:39.884741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:39.884741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:39.884741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:39.884741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:39.884741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:39.884741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:39.885638 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:39.885638 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:39.885638 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:39.885638 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:39.885638 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 451/902] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:10:39.890671 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ce69b-6fca-4b2f-9451-c22355b203ca None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:39.968898 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a90b50-69de-4cbe-8809-744bc771f4dc None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:39.991096 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:39.993939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ce69b-6fca-4b2f-9451-c22355b203ca None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:39.996309 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:40.010872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99561449-d778-400d-96dd-0795e8643529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:40.012096 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99561449-d778-400d-96dd-0795e8643529 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:40.012984 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99561449-d778-400d-96dd-0795e8643529 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:40.013462 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99561449-d778-400d-96dd-0795e8643529 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:40.014384 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99561449-d778-400d-96dd-0795e8643529 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:40.016489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99561449-d778-400d-96dd-0795e8643529 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:40.026153 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 452/903] 10.222.0.57 () {56 vars in 1087 bytes} [Sat Jun 4 08:10:39 2022] GET /identity/v3/services => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:10:40.038779 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3f483-c635-4823-8edb-39fcb0205ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:40.039876 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3f483-c635-4823-8edb-39fcb0205ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:40.040356 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3f483-c635-4823-8edb-39fcb0205ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:40.040826 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3f483-c635-4823-8edb-39fcb0205ad8 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:40.041795 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3f483-c635-4823-8edb-39fcb0205ad8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:40.042361 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3f483-c635-4823-8edb-39fcb0205ad8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:40.044018 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3f483-c635-4823-8edb-39fcb0205ad8 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:40.060683 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 452/904] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:40.065946 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99561449-d778-400d-96dd-0795e8643529 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:40.187437 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99561449-d778-400d-96dd-0795e8643529 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:40.230073 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea8ab5-9479-42f2-b1c3-05eb8e2efb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:40.230902 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea8ab5-9479-42f2-b1c3-05eb8e2efb88 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:40.231228 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea8ab5-9479-42f2-b1c3-05eb8e2efb88 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:40.231465 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea8ab5-9479-42f2-b1c3-05eb8e2efb88 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:40.240718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea8ab5-9479-42f2-b1c3-05eb8e2efb88 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:40.243199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea8ab5-9479-42f2-b1c3-05eb8e2efb88 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:40.259493 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-51ea8ab5-9479-42f2-b1c3-05eb8e2efb88 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 08:10:40.259493 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:40.259493 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:40.259493 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:40.259493 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:40.259493 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:40.259493 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:40.259493 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:40.259493 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:40.259493 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:40.259493 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:40.259493 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:40.259493 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:10:40.259493 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:10:40.259493 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:10:40.259493 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:10:40.260510 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:40.260510 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:40.260510 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:10:40.260510 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:40.260510 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:10:40.260510 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:40.260510 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:40.260510 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:40.260510 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:40.260510 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:40.260510 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:40.260510 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:40.260510 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:40.260510 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:40.260510 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:40.260510 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:40.260510 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:40.260510 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:40.261496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:40.261496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:40.261496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:10:40.261496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:10:40.261496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:10:40.261496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:10:40.261496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:10:40.261496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:10:40.261496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 08:10:40.261496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:40.264250 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 453/905] 10.222.0.57 () {56 vars in 1117 bytes} [Sat Jun 4 08:10:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:10:40.270055 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3f483-c635-4823-8edb-39fcb0205ad8 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:40.386191 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3f483-c635-4823-8edb-39fcb0205ad8 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:40.422430 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956a41c-79a3-4908-a231-471ad64fe954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:40.423110 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956a41c-79a3-4908-a231-471ad64fe954 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:40.423441 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956a41c-79a3-4908-a231-471ad64fe954 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:40.423714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956a41c-79a3-4908-a231-471ad64fe954 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:40.424544 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956a41c-79a3-4908-a231-471ad64fe954 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:40.424847 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956a41c-79a3-4908-a231-471ad64fe954 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:40.426308 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956a41c-79a3-4908-a231-471ad64fe954 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:40.445072 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 453/906] 10.222.0.57 () {56 vars in 1149 bytes} [Sat Jun 4 08:10:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:40.450308 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea8ab5-9479-42f2-b1c3-05eb8e2efb88 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:40.500791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:40.562681 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea8ab5-9479-42f2-b1c3-05eb8e2efb88 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:40.601723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d4bcf-cf95-40b2-9ac9-4d70b34088f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:40.602408 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d4bcf-cf95-40b2-9ac9-4d70b34088f3 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:40.602690 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d4bcf-cf95-40b2-9ac9-4d70b34088f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:40.602969 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d4bcf-cf95-40b2-9ac9-4d70b34088f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:40.674887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d4bcf-cf95-40b2-9ac9-4d70b34088f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:40.676336 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d4bcf-cf95-40b2-9ac9-4d70b34088f3 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:40.690404 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23dc4b-ef33-46de-807b-32c2ae4095c8 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:40.690696 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23dc4b-ef33-46de-807b-32c2ae4095c8 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:40.690955 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23dc4b-ef33-46de-807b-32c2ae4095c8 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:40.692544 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 454/907] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:40.697543 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad7505-4280-4c7b-91a1-cd19dc3002df None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:40.697777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad7505-4280-4c7b-91a1-cd19dc3002df None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:40.698099 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad7505-4280-4c7b-91a1-cd19dc3002df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:40.716192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-97ad7505-4280-4c7b-91a1-cd19dc3002df None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:40.717520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-97ad7505-4280-4c7b-91a1-cd19dc3002df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:40.725148 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:40.732071 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:40.782179 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 454/908] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:10:40 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 08:10:40.787418 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d4bcf-cf95-40b2-9ac9-4d70b34088f3 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:40.801962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 455/909] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 08:10:40.818040 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad7505-4280-4c7b-91a1-cd19dc3002df None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:40.921705 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d4bcf-cf95-40b2-9ac9-4d70b34088f3 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:40.940661 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad7505-4280-4c7b-91a1-cd19dc3002df None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:40.962433 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ffd1d-066d-4efe-94ab-ea87d93ea978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:40.963759 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ffd1d-066d-4efe-94ab-ea87d93ea978 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:40.964254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ffd1d-066d-4efe-94ab-ea87d93ea978 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:40.964720 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ffd1d-066d-4efe-94ab-ea87d93ea978 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:40.976316 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ffd1d-066d-4efe-94ab-ea87d93ea978 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:40.978229 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ffd1d-066d-4efe-94ab-ea87d93ea978 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:40.982967 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131026f3-66c6-4620-8306-0402f5145cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:40.983771 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131026f3-66c6-4620-8306-0402f5145cea None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:40.984037 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131026f3-66c6-4620-8306-0402f5145cea None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:40.984309 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131026f3-66c6-4620-8306-0402f5145cea None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:40.984959 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131026f3-66c6-4620-8306-0402f5145cea None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:40.986858 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131026f3-66c6-4620-8306-0402f5145cea None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:40.988308 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:41.000831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-131026f3-66c6-4620-8306-0402f5145cea None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 08:10:41.000831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:41.000831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 08:10:41.000831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 08:10:41.000831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 08:10:41.000831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 08:10:41.000831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 08:10:41.000831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:41.000831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 08:10:41.000831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:41.000831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 08:10:41.000831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:41.000831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:41.000831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:41.000831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:41.000831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:41.000831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:41.002687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:41.002687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:41.002687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:41.002687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:41.002687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:41.002687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:41.002687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 08:10:41.002687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 08:10:41.002687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 08:10:41.002687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 08:10:41.002687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:41.002687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:41.002687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:41.002687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:41.002687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:41.002687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:41.003517 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:41.003517 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:41.003517 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:41.003517 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:41.003517 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:41.003517 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:41.003517 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:41.003517 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:41.003517 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:41.003517 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:41.003517 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 08:10:41.003517 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:41.003517 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 08:10:41.003517 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:41.003517 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 456/910] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jun 4 08:10:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:41.009763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-cd3ffd1d-066d-4efe-94ab-ea87d93ea978 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:41.009763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:41.009763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:41.009763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:41.009763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:41.009763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:41.009763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:41.009763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:41.009763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:41.009763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:41.009763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:41.009763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:41.009763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:41.009763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:41.009763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:41.010760 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:41.010760 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:41.010760 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:41.010760 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:41.010760 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:41.010760 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:41.010760 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:41.010760 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:41.010760 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:41.010760 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:41.010760 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:41.010760 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:41.010760 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:41.010760 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:41.010760 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:41.010760 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:41.010760 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:41.012734 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:41.012734 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:41.012734 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:41.012734 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:41.012734 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 455/911] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:10:41.013526 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131026f3-66c6-4620-8306-0402f5145cea None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:41.013672 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ffd1d-066d-4efe-94ab-ea87d93ea978 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:41.031264 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:41.123506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ffd1d-066d-4efe-94ab-ea87d93ea978 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:41.154380 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131026f3-66c6-4620-8306-0402f5145cea None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:41.161080 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749979b-855c-4b3e-b3ea-2323a28fe2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:41.162024 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749979b-855c-4b3e-b3ea-2323a28fe2bb None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:41.162524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749979b-855c-4b3e-b3ea-2323a28fe2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:41.163013 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749979b-855c-4b3e-b3ea-2323a28fe2bb None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:41.163918 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749979b-855c-4b3e-b3ea-2323a28fe2bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:41.164431 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749979b-855c-4b3e-b3ea-2323a28fe2bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:41.166032 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749979b-855c-4b3e-b3ea-2323a28fe2bb None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:41.178858 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 456/912] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:41.183774 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749979b-855c-4b3e-b3ea-2323a28fe2bb None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:41.201084 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fe7b2-c934-4ee3-a48e-caaa300fa2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:41.201768 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fe7b2-c934-4ee3-a48e-caaa300fa2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:41.202101 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fe7b2-c934-4ee3-a48e-caaa300fa2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:41.202377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fe7b2-c934-4ee3-a48e-caaa300fa2d5 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:41.203421 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77fe7b2-c934-4ee3-a48e-caaa300fa2d5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:41.203734 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77fe7b2-c934-4ee3-a48e-caaa300fa2d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:41.206058 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77fe7b2-c934-4ee3-a48e-caaa300fa2d5 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:41.213930 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 457/913] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jun 4 08:10:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:41.218433 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fe7b2-c934-4ee3-a48e-caaa300fa2d5 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:41.258205 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:41.306261 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749979b-855c-4b3e-b3ea-2323a28fe2bb None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:41.322022 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:41.350589 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839a3d7-bf92-42bb-812e-980188583cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:41.351721 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839a3d7-bf92-42bb-812e-980188583cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:41.352171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fe7b2-c934-4ee3-a48e-caaa300fa2d5 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:41.352357 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839a3d7-bf92-42bb-812e-980188583cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:41.352806 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839a3d7-bf92-42bb-812e-980188583cb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:41.362247 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839a3d7-bf92-42bb-812e-980188583cb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:41.364303 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839a3d7-bf92-42bb-812e-980188583cb3 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:41.381564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-e839a3d7-bf92-42bb-812e-980188583cb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:41.381564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:41.381564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:41.381564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:41.381564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:41.381564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:41.381564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:41.381564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:41.381564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:41.381564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:41.381564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:41.381564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:41.381564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:10:41.381564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:10:41.381564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:10:41.382660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:10:41.382660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:41.382660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:41.382660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:41.382660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:41.382660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:41.382660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:41.382660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:41.382660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:41.382660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:41.382660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:41.382660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:41.382660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:41.382660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:41.382660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:41.382660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:41.382660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:41.383567 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:10:41.383567 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:10:41.383567 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:10:41.383567 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:10:41.383567 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:10:41.383567 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:10:41.383567 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:41.383567 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:41.383567 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 457/914] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:10:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:41.388248 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839a3d7-bf92-42bb-812e-980188583cb3 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:41.404196 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d63332-17ae-4e37-81fb-5a4d3ded0319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:41.404931 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d63332-17ae-4e37-81fb-5a4d3ded0319 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:41.405222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d63332-17ae-4e37-81fb-5a4d3ded0319 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:41.405495 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d63332-17ae-4e37-81fb-5a4d3ded0319 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:41.406229 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d63332-17ae-4e37-81fb-5a4d3ded0319 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:41.406536 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d63332-17ae-4e37-81fb-5a4d3ded0319 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:41.408491 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d63332-17ae-4e37-81fb-5a4d3ded0319 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:41.418235 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 458/915] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jun 4 08:10:41 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:41.419757 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d63332-17ae-4e37-81fb-5a4d3ded0319 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:41.502848 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839a3d7-bf92-42bb-812e-980188583cb3 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:41.521191 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:41.529955 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d63332-17ae-4e37-81fb-5a4d3ded0319 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:41.540499 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9eca86-a568-4d29-800c-5dba6b67847b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:41.541163 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9eca86-a568-4d29-800c-5dba6b67847b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:41.541435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9eca86-a568-4d29-800c-5dba6b67847b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:41.541721 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9eca86-a568-4d29-800c-5dba6b67847b None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:41.542534 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9eca86-a568-4d29-800c-5dba6b67847b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:41.542841 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9eca86-a568-4d29-800c-5dba6b67847b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:41.544275 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9eca86-a568-4d29-800c-5dba6b67847b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:41.557332 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 458/916] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:10:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:41.566851 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9eca86-a568-4d29-800c-5dba6b67847b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:41.570431 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6378f3-5850-4c28-94ea-de6fd7378c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:41.571295 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6378f3-5850-4c28-94ea-de6fd7378c8a None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:41.571725 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6378f3-5850-4c28-94ea-de6fd7378c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:41.572138 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6378f3-5850-4c28-94ea-de6fd7378c8a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:41.573011 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6378f3-5850-4c28-94ea-de6fd7378c8a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:41.574552 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6378f3-5850-4c28-94ea-de6fd7378c8a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:41.583319 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:41.605864 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 459/917] 10.222.0.57 () {60 vars in 1144 bytes} [Sat Jun 4 08:10:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:10:41.706599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9eca86-a568-4d29-800c-5dba6b67847b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:41.753801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995cf8b4-2561-4c8d-bcc4-c38c008a2790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:41.754835 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cf8b4-2561-4c8d-bcc4-c38c008a2790 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:41.755337 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cf8b4-2561-4c8d-bcc4-c38c008a2790 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:41.755804 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cf8b4-2561-4c8d-bcc4-c38c008a2790 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:41.756846 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995cf8b4-2561-4c8d-bcc4-c38c008a2790 None admin] RBAC: Adding query filter params (role.id=725918a0815f44dca0cc6586938c7b2f, scope.project.id=634c9a1745ef44c0ad66e02493d79af0, user.id=aff5d82384e84b669eeb00089ab8e09a) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:41.757364 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995cf8b4-2561-4c8d-bcc4-c38c008a2790 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:41.759074 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995cf8b4-2561-4c8d-bcc4-c38c008a2790 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:41.766513 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 459/918] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:10:41 2022] GET /identity/v3/role_assignments?user.id=aff5d82384e84b669eeb00089ab8e09a&scope.project.id=634c9a1745ef44c0ad66e02493d79af0&role.id=725918a0815f44dca0cc6586938c7b2f => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:42.037217 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8cd7b-b791-45df-bc25-92320b7a8fe9 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:42.037720 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8cd7b-b791-45df-bc25-92320b7a8fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:42.037720 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8cd7b-b791-45df-bc25-92320b7a8fe9 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:42.039415 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 460/919] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:42.045575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fa166-aae3-4533-a7e0-0e2c66a35774 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:42.046129 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fa166-aae3-4533-a7e0-0e2c66a35774 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:42.046207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fa166-aae3-4533-a7e0-0e2c66a35774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:42.065146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-410fa166-aae3-4533-a7e0-0e2c66a35774 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:42.066415 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-410fa166-aae3-4533-a7e0-0e2c66a35774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:42.099083 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:42.144611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 460/920] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 08:10:42.167049 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8cd7b-b791-45df-bc25-92320b7a8fe9 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:42.279580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8cd7b-b791-45df-bc25-92320b7a8fe9 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:42.321582 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ee1d6-2a96-48eb-af4f-bccc0744c812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:42.322366 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ee1d6-2a96-48eb-af4f-bccc0744c812 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:42.322649 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ee1d6-2a96-48eb-af4f-bccc0744c812 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:42.322924 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ee1d6-2a96-48eb-af4f-bccc0744c812 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:42.323637 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ee1d6-2a96-48eb-af4f-bccc0744c812 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:42.325020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ee1d6-2a96-48eb-af4f-bccc0744c812 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:42.338466 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-361ee1d6-2a96-48eb-af4f-bccc0744c812 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 08:10:42.338466 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:42.338466 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 08:10:42.338466 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 08:10:42.338466 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 08:10:42.338466 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 08:10:42.338466 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 08:10:42.338466 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:42.338466 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 08:10:42.338466 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:42.338466 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 08:10:42.338466 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:42.338466 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:42.338466 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:42.338466 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:42.338466 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:42.338466 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:42.339520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:42.339520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:42.339520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:42.339520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:42.339520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:42.339520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:42.339520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 08:10:42.339520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 08:10:42.339520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 08:10:42.339520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 08:10:42.339520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:42.339520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:42.339520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:42.339520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:42.339520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:42.339520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:42.340377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:42.340377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:42.340377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:42.340377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:42.340377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:42.340377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:42.340377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:42.340377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:42.340377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:42.340377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:42.340377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 08:10:42.340377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:42.340377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 08:10:42.340377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:42.344813 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 461/921] 10.222.0.57 () {56 vars in 1126 bytes} [Sat Jun 4 08:10:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:42.346231 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fa166-aae3-4533-a7e0-0e2c66a35774 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:42.387705 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f207cf-bff5-48c5-9e83-3e48235acfa7 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:42.387990 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f207cf-bff5-48c5-9e83-3e48235acfa7 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:42.388273 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f207cf-bff5-48c5-9e83-3e48235acfa7 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:42.393961 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 462/922] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 08:10:42.395799 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad409c-ac39-46f6-a39f-fd656b21e086 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:42.396089 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad409c-ac39-46f6-a39f-fd656b21e086 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:42.396360 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad409c-ac39-46f6-a39f-fd656b21e086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:42.416606 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-0bad409c-ac39-46f6-a39f-fd656b21e086 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:42.416939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0bad409c-ac39-46f6-a39f-fd656b21e086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:42.464043 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fa166-aae3-4533-a7e0-0e2c66a35774 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:42.489336 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:42.509964 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883bd6c-83c2-49c3-8b80-6d94941f73a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:42.510794 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883bd6c-83c2-49c3-8b80-6d94941f73a2 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:42.511129 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883bd6c-83c2-49c3-8b80-6d94941f73a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:42.511404 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883bd6c-83c2-49c3-8b80-6d94941f73a2 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:42.512109 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883bd6c-83c2-49c3-8b80-6d94941f73a2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:42.512412 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883bd6c-83c2-49c3-8b80-6d94941f73a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:42.513774 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883bd6c-83c2-49c3-8b80-6d94941f73a2 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:42.514187 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 463/923] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:10:42.519100 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 461/924] 10.222.0.57 () {56 vars in 1122 bytes} [Sat Jun 4 08:10:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:42.524598 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad409c-ac39-46f6-a39f-fd656b21e086 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:42.529799 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883bd6c-83c2-49c3-8b80-6d94941f73a2 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:42.574282 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:42.642527 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883bd6c-83c2-49c3-8b80-6d94941f73a2 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:42.648490 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad409c-ac39-46f6-a39f-fd656b21e086 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:42.679110 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78f079-0281-4389-ac2b-80e3e72eee5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:42.680368 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78f079-0281-4389-ac2b-80e3e72eee5e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:42.680859 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78f079-0281-4389-ac2b-80e3e72eee5e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:42.681336 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78f079-0281-4389-ac2b-80e3e72eee5e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:42.682239 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78f079-0281-4389-ac2b-80e3e72eee5e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:42.683828 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78f079-0281-4389-ac2b-80e3e72eee5e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:42.691216 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990c4df-08cc-4ea8-be1d-6fe058f1adea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:42.691876 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990c4df-08cc-4ea8-be1d-6fe058f1adea None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:42.692155 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990c4df-08cc-4ea8-be1d-6fe058f1adea None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:42.692430 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990c4df-08cc-4ea8-be1d-6fe058f1adea None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:42.693125 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990c4df-08cc-4ea8-be1d-6fe058f1adea None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:42.693428 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990c4df-08cc-4ea8-be1d-6fe058f1adea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:42.695004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990c4df-08cc-4ea8-be1d-6fe058f1adea None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:42.698709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-4f78f079-0281-4389-ac2b-80e3e72eee5e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 08:10:42.698709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:42.698709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 08:10:42.698709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 08:10:42.698709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 08:10:42.698709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 08:10:42.698709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 08:10:42.698709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:42.698709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 08:10:42.698709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:42.698709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 08:10:42.698709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:42.698709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:42.698709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:42.698709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:42.698709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:42.705733 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:42.705733 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:42.705733 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:42.705733 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:42.705733 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:42.705733 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:42.705733 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:42.705733 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 08:10:42.705733 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 08:10:42.705733 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 08:10:42.705733 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 08:10:42.705733 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:42.705733 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:42.705733 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:42.705733 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:42.705733 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:42.706667 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:42.706667 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:42.706667 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:42.706667 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:42.706667 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:42.706667 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:42.706667 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:42.706667 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:42.706667 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:42.706667 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:42.706667 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:42.706667 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 08:10:42.706667 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:42.706667 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 08:10:42.706667 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:42.707477 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 464/925] 10.222.0.57 () {56 vars in 1122 bytes} [Sat Jun 4 08:10:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:42.708014 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 462/926] 10.222.0.57 () {56 vars in 1132 bytes} [Sat Jun 4 08:10:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:10:42.710824 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990c4df-08cc-4ea8-be1d-6fe058f1adea None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:42.711177 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78f079-0281-4389-ac2b-80e3e72eee5e None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:42.787190 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:42.816273 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:42.822839 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78f079-0281-4389-ac2b-80e3e72eee5e None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:42.853464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990c4df-08cc-4ea8-be1d-6fe058f1adea None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:42.864813 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33104da2-c3e9-4c17-95d5-0d3ce9fbdd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:42.865481 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33104da2-c3e9-4c17-95d5-0d3ce9fbdd0a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:42.865763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33104da2-c3e9-4c17-95d5-0d3ce9fbdd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:42.866068 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33104da2-c3e9-4c17-95d5-0d3ce9fbdd0a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:42.866964 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33104da2-c3e9-4c17-95d5-0d3ce9fbdd0a None admin] RBAC: Adding query filter params (interface=public, service_id=00821a1b56424c6f9c2ec95bccff27f8, region_id=RegionOne) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:42.867283 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33104da2-c3e9-4c17-95d5-0d3ce9fbdd0a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:42.868757 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33104da2-c3e9-4c17-95d5-0d3ce9fbdd0a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:42.874898 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 463/927] 10.222.0.57 () {56 vars in 1251 bytes} [Sat Jun 4 08:10:42 2022] GET /identity/v3/endpoints?service_id=00821a1b56424c6f9c2ec95bccff27f8&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:42.880362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33104da2-c3e9-4c17-95d5-0d3ce9fbdd0a None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:42.896389 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf7628-b066-4028-b7f1-80f8a717fd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:42.897384 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf7628-b066-4028-b7f1-80f8a717fd39 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:42.897939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf7628-b066-4028-b7f1-80f8a717fd39 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:42.898485 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf7628-b066-4028-b7f1-80f8a717fd39 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:42.899489 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf7628-b066-4028-b7f1-80f8a717fd39 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:42.900013 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf7628-b066-4028-b7f1-80f8a717fd39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:42.901643 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf7628-b066-4028-b7f1-80f8a717fd39 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:42.907331 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 465/928] 10.222.0.57 () {56 vars in 1126 bytes} [Sat Jun 4 08:10:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:42.919795 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf7628-b066-4028-b7f1-80f8a717fd39 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:43.023749 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33104da2-c3e9-4c17-95d5-0d3ce9fbdd0a None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:43.030707 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf7628-b066-4028-b7f1-80f8a717fd39 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:43.055525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:43.065040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448a2a4-99b8-4913-b723-30fbaf691f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:43.066424 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448a2a4-99b8-4913-b723-30fbaf691f07 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:43.067039 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448a2a4-99b8-4913-b723-30fbaf691f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:43.067521 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448a2a4-99b8-4913-b723-30fbaf691f07 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:43.068409 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448a2a4-99b8-4913-b723-30fbaf691f07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:43.070192 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448a2a4-99b8-4913-b723-30fbaf691f07 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:43.075780 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc16b8-2cea-482e-aa5a-10f15ae624c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:43.076449 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc16b8-2cea-482e-aa5a-10f15ae624c3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:43.076730 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc16b8-2cea-482e-aa5a-10f15ae624c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:43.077004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc16b8-2cea-482e-aa5a-10f15ae624c3 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:43.077707 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc16b8-2cea-482e-aa5a-10f15ae624c3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:43.078057 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc16b8-2cea-482e-aa5a-10f15ae624c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:43.084838 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc16b8-2cea-482e-aa5a-10f15ae624c3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:43.085321 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 464/930] 10.222.0.57 () {56 vars in 1087 bytes} [Sat Jun 4 08:10:42 2022] GET /identity/v3/services => generated 1497 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:10:43.089749 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 466/930] 10.222.0.57 () {56 vars in 1126 bytes} [Sat Jun 4 08:10:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:43.090992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448a2a4-99b8-4913-b723-30fbaf691f07 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:43.126434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:43.212233 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448a2a4-99b8-4913-b723-30fbaf691f07 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:43.253918 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae9a4f8-9a48-4e29-a725-debde2f45dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:43.254854 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9a4f8-9a48-4e29-a725-debde2f45dc8 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:43.255292 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9a4f8-9a48-4e29-a725-debde2f45dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:43.255717 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9a4f8-9a48-4e29-a725-debde2f45dc8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:43.256658 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae9a4f8-9a48-4e29-a725-debde2f45dc8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:43.258251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae9a4f8-9a48-4e29-a725-debde2f45dc8 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:43.285418 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 465/931] 10.222.0.57 () {60 vars in 1144 bytes} [Sat Jun 4 08:10:43 2022] POST /identity/v3/endpoints => generated 347 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:10:43.953543 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d51d37-071c-4b66-b4e0-8059d9f6f384 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:43.953846 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d51d37-071c-4b66-b4e0-8059d9f6f384 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:43.954135 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d51d37-071c-4b66-b4e0-8059d9f6f384 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:43.955777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 467/932] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:43.961170 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbc6b9-28d4-48f5-ab15-26dcaf14be3a None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:43.961460 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbc6b9-28d4-48f5-ab15-26dcaf14be3a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:43.961740 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbc6b9-28d4-48f5-ab15-26dcaf14be3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:43.980303 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-aabbc6b9-28d4-48f5-ab15-26dcaf14be3a None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:43.981492 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-aabbc6b9-28d4-48f5-ab15-26dcaf14be3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:44.055808 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 466/933] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:10:44.079905 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d51d37-071c-4b66-b4e0-8059d9f6f384 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:44.150998 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe88089-1098-4db2-aa57-dd189e6a0d91 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:44.151552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe88089-1098-4db2-aa57-dd189e6a0d91 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:44.151552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe88089-1098-4db2-aa57-dd189e6a0d91 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:44.153167 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 467/934] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:44.159667 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae30993-09c3-44ab-bc25-c6b9d5ab5316 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:44.160033 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae30993-09c3-44ab-bc25-c6b9d5ab5316 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:44.160388 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae30993-09c3-44ab-bc25-c6b9d5ab5316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:44.173881 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:44.185457 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-1ae30993-09c3-44ab-bc25-c6b9d5ab5316 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:44.186930 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1ae30993-09c3-44ab-bc25-c6b9d5ab5316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:44.188026 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d51d37-071c-4b66-b4e0-8059d9f6f384 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:44.226870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db831327-85ee-4fc2-8546-7fdd8e5a29d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:44.227566 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db831327-85ee-4fc2-8546-7fdd8e5a29d0 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:44.227848 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db831327-85ee-4fc2-8546-7fdd8e5a29d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:44.228130 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db831327-85ee-4fc2-8546-7fdd8e5a29d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:44.228827 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db831327-85ee-4fc2-8546-7fdd8e5a29d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:44.230296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db831327-85ee-4fc2-8546-7fdd8e5a29d0 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:44.232020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: WARNING keystone.server.flask.common [None req-db831327-85ee-4fc2-8546-7fdd8e5a29d0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 04 08:10:44.251517 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.sql.core [None req-db831327-85ee-4fc2-8546-7fdd8e5a29d0 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 04 08:10:44.251517 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 04 08:10:44.251517 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [parameters: {'id': 'd7d2700988574d23b9f43dd31f63a573', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 04 08:10:44.251517 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80164) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 04 08:10:44.273879 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-db831327-85ee-4fc2-8546-7fdd8e5a29d0 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d7d2700988574d23b9f43dd31f63a573.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d7d2700988574d23b9f43dd31f63a573. Jun 04 08:10:44.273879 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:44.273879 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 04 08:10:44.273879 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 04 08:10:44.273879 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 04 08:10:44.273879 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 04 08:10:44.273879 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 04 08:10:44.273879 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application result = self._query(query) Jun 04 08:10:44.273879 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 04 08:10:44.273879 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application conn.query(q) Jun 04 08:10:44.273879 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 04 08:10:44.273879 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 04 08:10:44.273879 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 04 08:10:44.275202 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application result.read() Jun 04 08:10:44.275202 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 04 08:10:44.275202 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 04 08:10:44.275202 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 04 08:10:44.275202 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 04 08:10:44.275202 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 04 08:10:44.275202 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 04 08:10:44.275202 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 04 08:10:44.275202 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 04 08:10:44.275202 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 04 08:10:44.275202 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:44.275202 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 04 08:10:44.275202 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:44.275202 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:44.275202 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 04 08:10:44.275202 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 04 08:10:44.275202 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 04 08:10:44.275202 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 04 08:10:44.276361 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 04 08:10:44.276361 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application next(self.gen) Jun 04 08:10:44.276361 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 04 08:10:44.276361 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application yield resource Jun 04 08:10:44.276361 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 04 08:10:44.276361 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application next(self.gen) Jun 04 08:10:44.276361 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 04 08:10:44.276361 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self.session.rollback() Jun 04 08:10:44.276361 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 08:10:44.276361 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self.force_reraise() Jun 04 08:10:44.276361 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 08:10:44.276361 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise self.value Jun 04 08:10:44.276361 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 04 08:10:44.276361 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 04 08:10:44.276361 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 04 08:10:44.276361 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application session.commit() Jun 04 08:10:44.276361 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 04 08:10:44.277286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 04 08:10:44.277286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 04 08:10:44.277286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._prepare_impl() Jun 04 08:10:44.277286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 04 08:10:44.277286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self.session.flush() Jun 04 08:10:44.277286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 04 08:10:44.277286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._flush(objects) Jun 04 08:10:44.277286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 04 08:10:44.277286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 04 08:10:44.277286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 04 08:10:44.277286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application compat.raise_( Jun 04 08:10:44.277286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 08:10:44.277286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception Jun 04 08:10:44.277286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 04 08:10:44.277286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application flush_context.execute() Jun 04 08:10:44.277286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 04 08:10:44.277286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rec.execute(self) Jun 04 08:10:44.278427 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 04 08:10:44.278427 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 04 08:10:44.278427 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 04 08:10:44.278427 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 04 08:10:44.278427 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 04 08:10:44.278427 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 04 08:10:44.278427 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 04 08:10:44.278427 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 04 08:10:44.278427 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 04 08:10:44.278427 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 04 08:10:44.278427 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 04 08:10:44.278427 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 04 08:10:44.278427 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 04 08:10:44.278427 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 04 08:10:44.278427 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 04 08:10:44.279405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 04 08:10:44.279405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 08:10:44.279405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception Jun 04 08:10:44.279405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 04 08:10:44.279405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 04 08:10:44.279405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 04 08:10:44.279405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 04 08:10:44.279405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 04 08:10:44.279405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application result = self._query(query) Jun 04 08:10:44.279405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 04 08:10:44.279405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application conn.query(q) Jun 04 08:10:44.279405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 04 08:10:44.279405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 04 08:10:44.279405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 04 08:10:44.279405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application result.read() Jun 04 08:10:44.279405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 04 08:10:44.279405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 04 08:10:44.280555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 04 08:10:44.280555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 04 08:10:44.280555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 04 08:10:44.280555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 04 08:10:44.280555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 04 08:10:44.280555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 04 08:10:44.280555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 04 08:10:44.280555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 04 08:10:44.280555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [parameters: {'id': 'd7d2700988574d23b9f43dd31f63a573', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 04 08:10:44.280555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 04 08:10:44.280555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:44.280555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 08:10:44.280555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:44.280555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:44.280555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 04 08:10:44.281567 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 04 08:10:44.281567 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 04 08:10:44.281567 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 04 08:10:44.281567 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 04 08:10:44.281567 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:44.281567 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 08:10:44.281567 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:44.281567 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:44.281567 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:44.281567 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:44.281567 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:44.281567 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:44.281567 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:44.281567 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:44.281567 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:44.281567 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:44.281567 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:44.283264 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:44.283264 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 04 08:10:44.283264 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 04 08:10:44.283264 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:44.283264 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:44.283264 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 04 08:10:44.283264 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 04 08:10:44.283264 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d7d2700988574d23b9f43dd31f63a573. Jun 04 08:10:44.283264 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:44.283869 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 468/936] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:10:44.283955 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 468/936] 10.222.0.57 () {60 vars in 1140 bytes} [Sat Jun 4 08:10:44 2022] POST /identity/v3/projects => generated 262 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:44.284035 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae30993-09c3-44ab-bc25-c6b9d5ab5316 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:44.302950 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db831327-85ee-4fc2-8546-7fdd8e5a29d0 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:44.349715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:44.400513 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae30993-09c3-44ab-bc25-c6b9d5ab5316 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:44.419047 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db831327-85ee-4fc2-8546-7fdd8e5a29d0 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:44.439415 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c56ff9-bb9f-40cd-abe3-6a437d065f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:44.440140 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c56ff9-bb9f-40cd-abe3-6a437d065f3e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:44.440422 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c56ff9-bb9f-40cd-abe3-6a437d065f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:44.440694 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c56ff9-bb9f-40cd-abe3-6a437d065f3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:44.443610 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:44.449052 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c56ff9-bb9f-40cd-abe3-6a437d065f3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:44.450736 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c56ff9-bb9f-40cd-abe3-6a437d065f3e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:44.457939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24698fd3-f1e4-4765-892b-36ce2f228178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:44.458906 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24698fd3-f1e4-4765-892b-36ce2f228178 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:44.459250 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24698fd3-f1e4-4765-892b-36ce2f228178 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:44.459618 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24698fd3-f1e4-4765-892b-36ce2f228178 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:44.467641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-a5c56ff9-bb9f-40cd-abe3-6a437d065f3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:44.467641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:44.467641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:44.467641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:44.467641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:44.467641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:44.467641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:44.467641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:44.467641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:44.467641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:44.467641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:44.467641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:44.467641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:10:44.467641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:10:44.467641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:10:44.468684 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:10:44.468684 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:44.468684 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:44.468684 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:44.468684 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:44.468684 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:44.468684 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:44.468684 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:44.468684 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:44.468684 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:44.468684 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:44.468684 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:44.468684 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:44.468684 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:44.468684 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:44.468684 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:44.468684 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:44.469776 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:10:44.469776 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:10:44.469776 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:10:44.469776 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:10:44.469776 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:10:44.469776 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:10:44.469776 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:44.469776 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:44.471958 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 469/937] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:10:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:44.477406 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c56ff9-bb9f-40cd-abe3-6a437d065f3e None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:44.479183 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24698fd3-f1e4-4765-892b-36ce2f228178 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:10:44.490169 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-24698fd3-f1e4-4765-892b-36ce2f228178 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 08:10:44.490169 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:44.490169 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:44.490169 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:44.490169 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:44.490169 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:44.490169 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:44.490169 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:44.490169 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:44.490169 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:44.490169 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:44.490169 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:44.490169 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:10:44.490169 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:10:44.490169 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:10:44.490169 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:10:44.491152 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:10:44.491152 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:10:44.491152 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:10:44.491152 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:10:44.491152 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:44.491152 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:44.491152 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:44.491152 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:44.491152 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:44.491152 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:44.491152 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:44.491152 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:44.491152 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:44.491152 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:44.491152 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:44.491152 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:44.492024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:44.492024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:44.492024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:44.492024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:44.492024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:10:44.492024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:10:44.492024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:10:44.492024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:10:44.492024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:10:44.492024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:10:44.492024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 08:10:44.492024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:44.496821 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 469/938] 10.222.0.57 () {56 vars in 1120 bytes} [Sat Jun 4 08:10:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:44.498050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24698fd3-f1e4-4765-892b-36ce2f228178 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:44.590920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c56ff9-bb9f-40cd-abe3-6a437d065f3e None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:44.601296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:44.605610 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24698fd3-f1e4-4765-892b-36ce2f228178 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:44.627344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544ba1a-422b-4393-8622-516abe2c4233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:44.628334 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544ba1a-422b-4393-8622-516abe2c4233 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:44.628797 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544ba1a-422b-4393-8622-516abe2c4233 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:44.629274 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544ba1a-422b-4393-8622-516abe2c4233 None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:44.630227 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544ba1a-422b-4393-8622-516abe2c4233 None admin] RBAC: Adding query filter params (name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:44.630715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544ba1a-422b-4393-8622-516abe2c4233 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:44.632318 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544ba1a-422b-4393-8622-516abe2c4233 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:44.642782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4701d-7e58-425e-ba44-ea667b749287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:44.643449 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4701d-7e58-425e-ba44-ea667b749287 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:44.643729 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4701d-7e58-425e-ba44-ea667b749287 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:44.644405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4701d-7e58-425e-ba44-ea667b749287 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:44.644735 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4701d-7e58-425e-ba44-ea667b749287 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:44.645039 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4701d-7e58-425e-ba44-ea667b749287 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:44.646644 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4701d-7e58-425e-ba44-ea667b749287 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:44.657941 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 470/939] 10.222.0.57 () {56 vars in 1112 bytes} [Sat Jun 4 08:10:44 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:44.658314 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 470/940] 10.222.0.57 () {56 vars in 1115 bytes} [Sat Jun 4 08:10:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:44.664264 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544ba1a-422b-4393-8622-516abe2c4233 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:44.727636 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:44.776970 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544ba1a-422b-4393-8622-516abe2c4233 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:44.821483 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1db597-e038-42b4-a108-257baf2ed710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:44.822715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1db597-e038-42b4-a108-257baf2ed710 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:44.823228 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1db597-e038-42b4-a108-257baf2ed710 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:44.823703 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1db597-e038-42b4-a108-257baf2ed710 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:44.836111 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1db597-e038-42b4-a108-257baf2ed710 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:44.837994 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1db597-e038-42b4-a108-257baf2ed710 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:44.857518 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-9f1db597-e038-42b4-a108-257baf2ed710 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:44.857518 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:44.857518 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:44.857518 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:44.857518 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:44.857518 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:44.857518 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:44.857518 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:44.857518 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:44.857518 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:44.857518 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:44.857518 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:44.857518 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:44.857518 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:44.857518 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:44.858533 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:44.858533 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:44.858533 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:44.858533 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:44.858533 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:44.858533 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:44.858533 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:44.858533 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:44.858533 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:44.858533 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:44.858533 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:44.858533 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:44.858533 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:44.858533 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:44.858533 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:44.858533 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:44.858533 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:44.859450 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:44.859450 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:44.859450 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:44.859450 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:44.862384 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 471/941] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:44.872168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4701d-7e58-425e-ba44-ea667b749287 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:44.984061 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4701d-7e58-425e-ba44-ea667b749287 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:45.020092 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d68df-f23b-4232-8072-489bc9795298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:45.020762 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d68df-f23b-4232-8072-489bc9795298 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:45.021047 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d68df-f23b-4232-8072-489bc9795298 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:45.021322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d68df-f23b-4232-8072-489bc9795298 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:45.022078 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d68df-f23b-4232-8072-489bc9795298 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:45.022385 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d68df-f23b-4232-8072-489bc9795298 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:45.023756 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d68df-f23b-4232-8072-489bc9795298 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:45.036377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 471/942] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:45.041923 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1db597-e038-42b4-a108-257baf2ed710 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:45.151401 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1db597-e038-42b4-a108-257baf2ed710 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:45.163924 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:45.192523 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c9799-28a2-4a93-94a8-a811cf9d3eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:45.193374 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c9799-28a2-4a93-94a8-a811cf9d3eab None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:45.193667 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c9799-28a2-4a93-94a8-a811cf9d3eab None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:45.193974 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c9799-28a2-4a93-94a8-a811cf9d3eab None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:45.201495 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c9799-28a2-4a93-94a8-a811cf9d3eab None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:45.203027 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c9799-28a2-4a93-94a8-a811cf9d3eab None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:45.219289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-107c9799-28a2-4a93-94a8-a811cf9d3eab None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 08:10:45.219289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:45.219289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:45.219289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:45.219289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:45.219289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:45.219289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:45.219289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:45.219289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:45.219289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:45.219289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:45.219289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:45.219289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:10:45.219289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:10:45.219289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:10:45.219289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:10:45.220352 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:45.220352 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:45.220352 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:10:45.220352 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:45.220352 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:10:45.220352 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:45.220352 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:45.220352 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:45.220352 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:45.220352 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:45.220352 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:45.220352 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:45.220352 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:45.220352 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:45.220352 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:45.220352 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:45.220352 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:45.220352 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:45.221321 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:45.221321 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:45.221321 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:10:45.221321 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:10:45.221321 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:10:45.221321 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:10:45.221321 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:10:45.221321 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:10:45.221321 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 08:10:45.221321 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:45.221321 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 472/943] 10.222.0.57 () {56 vars in 1117 bytes} [Sat Jun 4 08:10:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:45.228592 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d68df-f23b-4232-8072-489bc9795298 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:45.255461 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:45.340084 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d68df-f23b-4232-8072-489bc9795298 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:45.374892 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2319a4-bdfa-4d66-b621-0e0b2ba2826a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:45.375580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2319a4-bdfa-4d66-b621-0e0b2ba2826a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:45.375865 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2319a4-bdfa-4d66-b621-0e0b2ba2826a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:45.376143 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2319a4-bdfa-4d66-b621-0e0b2ba2826a None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:45.377530 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2319a4-bdfa-4d66-b621-0e0b2ba2826a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:45.377854 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2319a4-bdfa-4d66-b621-0e0b2ba2826a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:45.379300 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2319a4-bdfa-4d66-b621-0e0b2ba2826a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:45.398308 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 472/944] 10.222.0.57 () {56 vars in 1149 bytes} [Sat Jun 4 08:10:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:45.403949 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c9799-28a2-4a93-94a8-a811cf9d3eab None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:45.512681 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c9799-28a2-4a93-94a8-a811cf9d3eab None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:45.516503 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96155e3a-c2eb-47a3-bc7c-a8cac90f78fc None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:45.516824 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96155e3a-c2eb-47a3-bc7c-a8cac90f78fc None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:45.517114 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96155e3a-c2eb-47a3-bc7c-a8cac90f78fc None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:45.518785 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 473/945] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:45.523745 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd87fe9-e601-4e65-9acf-4abb193a8a6e None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:45.524035 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd87fe9-e601-4e65-9acf-4abb193a8a6e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:45.524315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd87fe9-e601-4e65-9acf-4abb193a8a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:45.541492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-0cd87fe9-e601-4e65-9acf-4abb193a8a6e None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:45.543151 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0cd87fe9-e601-4e65-9acf-4abb193a8a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:45.552779 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817957e4-66fd-4d48-81cc-46b61aa30532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:45.554248 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817957e4-66fd-4d48-81cc-46b61aa30532 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:45.554876 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817957e4-66fd-4d48-81cc-46b61aa30532 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:45.555314 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817957e4-66fd-4d48-81cc-46b61aa30532 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:45.567435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817957e4-66fd-4d48-81cc-46b61aa30532 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:45.569001 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817957e4-66fd-4d48-81cc-46b61aa30532 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:45.587783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-817957e4-66fd-4d48-81cc-46b61aa30532 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:45.587783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:45.587783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:45.587783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:45.587783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:45.587783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:45.587783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:45.587783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:45.587783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:45.587783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:45.587783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:45.587783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:45.587783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:45.587783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:45.587783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:45.588725 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:45.588725 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:45.588725 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:45.588725 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:45.588725 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:45.588725 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:45.588725 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:45.588725 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:45.588725 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:45.588725 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:45.588725 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:45.588725 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:45.588725 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:45.588725 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:45.588725 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:45.588725 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:45.588725 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:45.589638 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:45.589638 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:45.589638 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:45.589638 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:45.589638 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 473/946] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:45.590850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee00c5-ce2f-4f30-9b9d-7f295a3aa882 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:45.590850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee00c5-ce2f-4f30-9b9d-7f295a3aa882 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:45.591035 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee00c5-ce2f-4f30-9b9d-7f295a3aa882 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:45.592629 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 474/947] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:45.597272 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee00c5-ce2f-4f30-9b9d-7f295a3aa882 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:45.620416 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:45.621474 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 474/948] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:10:45.623154 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f1c37-8a2a-4e17-9ddc-b5de76cb40a7 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:45.623619 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f1c37-8a2a-4e17-9ddc-b5de76cb40a7 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:45.623886 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f1c37-8a2a-4e17-9ddc-b5de76cb40a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:45.644849 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-825f1c37-8a2a-4e17-9ddc-b5de76cb40a7 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:45.646071 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-825f1c37-8a2a-4e17-9ddc-b5de76cb40a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:45.648293 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:45.722063 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 475/949] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:10:45.722063 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f1c37-8a2a-4e17-9ddc-b5de76cb40a7 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:45.730674 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee00c5-ce2f-4f30-9b9d-7f295a3aa882 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:45.770775 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2b755-f6bc-491d-87a9-2ac8f5a77a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:45.771487 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2b755-f6bc-491d-87a9-2ac8f5a77a02 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:45.771615 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2b755-f6bc-491d-87a9-2ac8f5a77a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:45.771887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2b755-f6bc-491d-87a9-2ac8f5a77a02 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:45.772604 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a2b755-f6bc-491d-87a9-2ac8f5a77a02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:45.772911 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a2b755-f6bc-491d-87a9-2ac8f5a77a02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:45.774659 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a2b755-f6bc-491d-87a9-2ac8f5a77a02 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:45.791187 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 475/950] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:45.792052 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2b755-f6bc-491d-87a9-2ac8f5a77a02 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:45.823905 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f1c37-8a2a-4e17-9ddc-b5de76cb40a7 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:45.859958 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8b420-e4ac-4115-8705-144e7963f6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:45.861594 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8b420-e4ac-4115-8705-144e7963f6e3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:45.862103 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8b420-e4ac-4115-8705-144e7963f6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:45.862378 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8b420-e4ac-4115-8705-144e7963f6e3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:45.863026 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8b420-e4ac-4115-8705-144e7963f6e3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:45.864484 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8b420-e4ac-4115-8705-144e7963f6e3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:45.876714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-1db8b420-e4ac-4115-8705-144e7963f6e3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 08:10:45.876714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:45.876714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 08:10:45.876714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 08:10:45.876714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 08:10:45.876714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 08:10:45.876714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 08:10:45.876714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:45.876714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 08:10:45.876714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:45.876714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 08:10:45.876714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:45.876714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:45.876714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:45.876714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:45.876714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:45.876714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:45.878241 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:45.878241 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:45.878241 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:45.878241 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:45.878241 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:45.878241 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:45.878241 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 08:10:45.878241 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 08:10:45.878241 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 08:10:45.878241 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 08:10:45.878241 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:45.878241 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:45.878241 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:45.878241 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:45.878241 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:45.878241 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:45.879274 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:45.879274 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:45.879274 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:45.879274 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:45.879274 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:45.879274 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:45.879274 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:45.879274 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:45.879274 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:45.879274 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:45.879274 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 08:10:45.879274 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:45.879274 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 08:10:45.879274 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:45.880029 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:45.880113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 476/951] 10.222.0.57 () {56 vars in 1126 bytes} [Sat Jun 4 08:10:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:45.882898 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8b420-e4ac-4115-8705-144e7963f6e3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:45.886295 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:45.900555 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2b755-f6bc-491d-87a9-2ac8f5a77a02 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:45.937700 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51267f5d-2f94-4b8e-8368-405b0d5c2085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:45.938560 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51267f5d-2f94-4b8e-8368-405b0d5c2085 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:45.938872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51267f5d-2f94-4b8e-8368-405b0d5c2085 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:45.939145 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51267f5d-2f94-4b8e-8368-405b0d5c2085 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:45.939815 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51267f5d-2f94-4b8e-8368-405b0d5c2085 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:45.941248 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51267f5d-2f94-4b8e-8368-405b0d5c2085 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:45.954572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-51267f5d-2f94-4b8e-8368-405b0d5c2085 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 08:10:45.954572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:45.954572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 08:10:45.954572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 08:10:45.954572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 08:10:45.954572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 08:10:45.954572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 08:10:45.954572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:45.954572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 08:10:45.954572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:45.954572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 08:10:45.954572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:45.954572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:45.954572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:45.954572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:45.954572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:45.954572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:45.955875 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:45.955875 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:45.955875 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:45.955875 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:45.955875 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:45.955875 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:45.955875 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 08:10:45.955875 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 08:10:45.955875 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 08:10:45.955875 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 08:10:45.955875 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:45.955875 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:45.955875 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:45.955875 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:45.955875 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:45.955875 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:45.956978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:45.956978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:45.956978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:45.956978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:45.956978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:45.956978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:45.956978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:45.956978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:45.956978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:45.956978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:45.956978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 08:10:45.956978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:45.956978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 08:10:45.956978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:45.956978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 476/952] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:10:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:45.957878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51267f5d-2f94-4b8e-8368-405b0d5c2085 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:46.010151 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8b420-e4ac-4115-8705-144e7963f6e3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:46.044700 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ec03d-3ced-4592-82e4-64cc393ec3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:46.045417 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ec03d-3ced-4592-82e4-64cc393ec3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:46.045703 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ec03d-3ced-4592-82e4-64cc393ec3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:46.046011 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ec03d-3ced-4592-82e4-64cc393ec3e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:46.053328 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ec03d-3ced-4592-82e4-64cc393ec3e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:46.055066 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ec03d-3ced-4592-82e4-64cc393ec3e4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:46.069226 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-a62ec03d-3ced-4592-82e4-64cc393ec3e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:46.069226 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:46.069226 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:46.069226 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:46.069226 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:46.069226 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:46.069226 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:46.069226 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:46.069226 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:46.069226 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:46.069226 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:46.069226 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:46.069226 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:10:46.069226 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:10:46.069226 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:10:46.070212 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:10:46.070212 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:46.070212 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:46.070212 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:46.070212 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:46.070212 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:46.070212 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:46.070212 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:46.070212 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:46.070212 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:46.070212 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:46.070212 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:46.070212 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:46.070212 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:46.070212 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:46.070212 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:46.070212 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:46.071102 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:10:46.071102 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:10:46.071102 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:10:46.071102 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:10:46.071102 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:10:46.071102 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:10:46.071102 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:46.071102 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:46.071615 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51267f5d-2f94-4b8e-8368-405b0d5c2085 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:46.075203 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 477/953] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:10:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:46.076040 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ec03d-3ced-4592-82e4-64cc393ec3e4 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:46.107948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ffc38-8454-4a24-a0e6-cba760ee8be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:46.108614 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ffc38-8454-4a24-a0e6-cba760ee8be4 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:46.109016 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ffc38-8454-4a24-a0e6-cba760ee8be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:46.109291 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ffc38-8454-4a24-a0e6-cba760ee8be4 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:46.110136 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ffc38-8454-4a24-a0e6-cba760ee8be4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:46.110442 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ffc38-8454-4a24-a0e6-cba760ee8be4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:46.112438 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ffc38-8454-4a24-a0e6-cba760ee8be4 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:46.121857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 477/954] 10.222.0.57 () {56 vars in 1122 bytes} [Sat Jun 4 08:10:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:46.121857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ffc38-8454-4a24-a0e6-cba760ee8be4 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:46.132088 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:46.142620 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:46.184940 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ec03d-3ced-4592-82e4-64cc393ec3e4 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:46.222012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ffc38-8454-4a24-a0e6-cba760ee8be4 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:46.222531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276899d-d934-4e33-ac37-b102f7c84a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:46.222843 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276899d-d934-4e33-ac37-b102f7c84a2e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:46.223125 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276899d-d934-4e33-ac37-b102f7c84a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:46.223511 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276899d-d934-4e33-ac37-b102f7c84a2e None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:46.224320 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276899d-d934-4e33-ac37-b102f7c84a2e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:46.224631 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276899d-d934-4e33-ac37-b102f7c84a2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:46.226013 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276899d-d934-4e33-ac37-b102f7c84a2e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:46.236454 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 478/955] 10.222.0.57 () {56 vars in 1112 bytes} [Sat Jun 4 08:10:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:46.237264 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276899d-d934-4e33-ac37-b102f7c84a2e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:46.256842 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8947cdb-dcf4-4821-a052-5c563945a715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:46.257503 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8947cdb-dcf4-4821-a052-5c563945a715 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:46.257794 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8947cdb-dcf4-4821-a052-5c563945a715 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:46.258104 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8947cdb-dcf4-4821-a052-5c563945a715 None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:46.258883 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8947cdb-dcf4-4821-a052-5c563945a715 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:46.259195 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8947cdb-dcf4-4821-a052-5c563945a715 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:46.260645 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8947cdb-dcf4-4821-a052-5c563945a715 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:46.273220 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 478/956] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:10:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:46.274699 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8947cdb-dcf4-4821-a052-5c563945a715 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:46.341544 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276899d-d934-4e33-ac37-b102f7c84a2e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:46.347405 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:46.368642 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:46.379434 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27399c1-1dbd-488c-83f8-3785378adf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:46.380101 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27399c1-1dbd-488c-83f8-3785378adf14 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:46.380385 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27399c1-1dbd-488c-83f8-3785378adf14 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:46.380658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27399c1-1dbd-488c-83f8-3785378adf14 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:46.381358 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27399c1-1dbd-488c-83f8-3785378adf14 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:46.381666 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27399c1-1dbd-488c-83f8-3785378adf14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:46.383092 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27399c1-1dbd-488c-83f8-3785378adf14 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:46.387592 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8947cdb-dcf4-4821-a052-5c563945a715 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:46.388071 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 479/957] 10.222.0.57 () {56 vars in 1122 bytes} [Sat Jun 4 08:10:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:46.388810 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27399c1-1dbd-488c-83f8-3785378adf14 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:46.428749 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0302586-b436-43ae-a50c-8442a1b627b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:46.429707 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0302586-b436-43ae-a50c-8442a1b627b4 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:46.430204 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0302586-b436-43ae-a50c-8442a1b627b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:46.430624 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0302586-b436-43ae-a50c-8442a1b627b4 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:46.431707 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0302586-b436-43ae-a50c-8442a1b627b4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:46.432154 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0302586-b436-43ae-a50c-8442a1b627b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:46.433767 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0302586-b436-43ae-a50c-8442a1b627b4 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:46.439632 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 479/958] 10.222.0.57 () {56 vars in 1112 bytes} [Sat Jun 4 08:10:46 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:46.440636 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0302586-b436-43ae-a50c-8442a1b627b4 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:46.507707 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27399c1-1dbd-488c-83f8-3785378adf14 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:46.548578 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293689c6-986e-443d-8725-47d03110b96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:46.549770 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293689c6-986e-443d-8725-47d03110b96f None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:46.550197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293689c6-986e-443d-8725-47d03110b96f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:46.550649 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293689c6-986e-443d-8725-47d03110b96f None admin] PATH_INFO: `/v3/projects/634c9a1745ef44c0ad66e02493d79af0/users/aff5d82384e84b669eeb00089ab8e09a/roles/725918a0815f44dca0cc6586938c7b2f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:46.553362 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293689c6-986e-443d-8725-47d03110b96f None admin] RBAC: Authorizing `identity:create_grant(project_id=634c9a1745ef44c0ad66e02493d79af0, user_id=aff5d82384e84b669eeb00089ab8e09a, role_id=725918a0815f44dca0cc6586938c7b2f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:46.555300 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293689c6-986e-443d-8725-47d03110b96f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:46.556845 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0302586-b436-43ae-a50c-8442a1b627b4 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:46.578166 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 480/959] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jun 4 08:10:46 2022] PUT /identity/v3/projects/634c9a1745ef44c0ad66e02493d79af0/users/aff5d82384e84b669eeb00089ab8e09a/roles/725918a0815f44dca0cc6586938c7b2f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:10:46.597087 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:46.604286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba7d5a-a73f-4761-a093-af01b13190f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:46.605661 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba7d5a-a73f-4761-a093-af01b13190f4 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:46.606471 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba7d5a-a73f-4761-a093-af01b13190f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:46.606934 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba7d5a-a73f-4761-a093-af01b13190f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:46.607872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba7d5a-a73f-4761-a093-af01b13190f4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:46.609593 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba7d5a-a73f-4761-a093-af01b13190f4 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:46.634500 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 480/960] 10.222.0.57 () {60 vars in 1144 bytes} [Sat Jun 4 08:10:46 2022] POST /identity/v3/endpoints => generated 349 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:10:47.122339 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37eaf01-5043-4d3d-9b72-fd98d445d679 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:47.122630 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37eaf01-5043-4d3d-9b72-fd98d445d679 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:47.122909 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37eaf01-5043-4d3d-9b72-fd98d445d679 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:47.124548 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 481/961] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:47.130459 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c924e-19ac-4111-bf15-21c7199ddd8e None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:47.130754 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c924e-19ac-4111-bf15-21c7199ddd8e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:47.131040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c924e-19ac-4111-bf15-21c7199ddd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:47.149289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-b61c924e-19ac-4111-bf15-21c7199ddd8e None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:47.150529 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-b61c924e-19ac-4111-bf15-21c7199ddd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:47.229294 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 481/962] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:10:47.254579 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37eaf01-5043-4d3d-9b72-fd98d445d679 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:47.311906 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:47.367165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37eaf01-5043-4d3d-9b72-fd98d445d679 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:47.402659 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59aeda-384b-4650-84ab-e91a5b83f541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:47.403435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59aeda-384b-4650-84ab-e91a5b83f541 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:47.403716 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59aeda-384b-4650-84ab-e91a5b83f541 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:47.403992 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59aeda-384b-4650-84ab-e91a5b83f541 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:47.404704 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59aeda-384b-4650-84ab-e91a5b83f541 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:47.406159 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59aeda-384b-4650-84ab-e91a5b83f541 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:47.421661 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.sql.core [None req-cc59aeda-384b-4650-84ab-e91a5b83f541 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 04 08:10:47.421661 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 04 08:10:47.421661 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [parameters: {'user_id': '116841b6925046b497de8489b291227c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 04 08:10:47.421661 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80164) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 04 08:10:47.429773 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-cc59aeda-384b-4650-84ab-e91a5b83f541 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 04 08:10:47.429773 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:47.429773 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 04 08:10:47.429773 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 04 08:10:47.429773 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 04 08:10:47.429773 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 04 08:10:47.429773 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 04 08:10:47.429773 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application result = self._query(query) Jun 04 08:10:47.429773 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 04 08:10:47.429773 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application conn.query(q) Jun 04 08:10:47.429773 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 04 08:10:47.429773 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 04 08:10:47.429773 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 04 08:10:47.429773 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application result.read() Jun 04 08:10:47.429773 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 04 08:10:47.430687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 04 08:10:47.430687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 04 08:10:47.430687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 04 08:10:47.430687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 04 08:10:47.430687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 04 08:10:47.430687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 04 08:10:47.430687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 04 08:10:47.430687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 04 08:10:47.430687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:47.430687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 04 08:10:47.430687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:47.430687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:47.430687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 04 08:10:47.430687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 04 08:10:47.430687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 04 08:10:47.430687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 04 08:10:47.430687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 04 08:10:47.430687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application next(self.gen) Jun 04 08:10:47.431777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 04 08:10:47.431777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application yield resource Jun 04 08:10:47.431777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 04 08:10:47.431777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application next(self.gen) Jun 04 08:10:47.431777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 04 08:10:47.431777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self.session.rollback() Jun 04 08:10:47.431777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 08:10:47.431777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self.force_reraise() Jun 04 08:10:47.431777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 08:10:47.431777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise self.value Jun 04 08:10:47.431777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 04 08:10:47.431777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 04 08:10:47.431777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 04 08:10:47.431777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application session.commit() Jun 04 08:10:47.431777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 04 08:10:47.431777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 04 08:10:47.431777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 04 08:10:47.432690 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._prepare_impl() Jun 04 08:10:47.432690 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 04 08:10:47.432690 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self.session.flush() Jun 04 08:10:47.432690 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 04 08:10:47.432690 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._flush(objects) Jun 04 08:10:47.432690 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 04 08:10:47.432690 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 04 08:10:47.432690 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 04 08:10:47.432690 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application compat.raise_( Jun 04 08:10:47.432690 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 08:10:47.432690 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception Jun 04 08:10:47.432690 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 04 08:10:47.432690 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application flush_context.execute() Jun 04 08:10:47.432690 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 04 08:10:47.432690 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rec.execute(self) Jun 04 08:10:47.432690 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 04 08:10:47.432690 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 04 08:10:47.433609 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 04 08:10:47.433609 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 04 08:10:47.433609 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 04 08:10:47.433609 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 04 08:10:47.433609 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 04 08:10:47.433609 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 04 08:10:47.433609 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 04 08:10:47.433609 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 04 08:10:47.433609 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 04 08:10:47.433609 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 04 08:10:47.433609 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 04 08:10:47.433609 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 04 08:10:47.433609 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 04 08:10:47.433609 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 04 08:10:47.433609 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 08:10:47.433609 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception Jun 04 08:10:47.436074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 04 08:10:47.436074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 04 08:10:47.436074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 04 08:10:47.436074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 04 08:10:47.436074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 04 08:10:47.436074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application result = self._query(query) Jun 04 08:10:47.436074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 04 08:10:47.436074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application conn.query(q) Jun 04 08:10:47.436074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 04 08:10:47.436074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 04 08:10:47.436074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 04 08:10:47.436074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application result.read() Jun 04 08:10:47.436074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 04 08:10:47.436074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 04 08:10:47.436074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 04 08:10:47.436074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 04 08:10:47.438194 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 04 08:10:47.438194 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 04 08:10:47.438194 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 04 08:10:47.438194 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 04 08:10:47.438194 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 04 08:10:47.438194 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 04 08:10:47.438194 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [parameters: {'user_id': '116841b6925046b497de8489b291227c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 04 08:10:47.438194 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 04 08:10:47.438194 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:47.438194 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 08:10:47.438194 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:47.438194 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:47.438194 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:47.438194 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:47.438194 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:47.440647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:47.440647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:47.440647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:47.440647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:47.440647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:47.440647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:47.440647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:47.440647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 04 08:10:47.440647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 04 08:10:47.440647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:47.440647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:47.440647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:10:47.440647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:47.440647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:10:47.440647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:47.440647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 04 08:10:47.440647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 04 08:10:47.442798 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 04 08:10:47.442798 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 04 08:10:47.442798 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 04 08:10:47.442798 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 04 08:10:47.442798 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 04 08:10:47.442798 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:47.442798 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 482/963] 10.222.0.57 () {60 vars in 1131 bytes} [Sat Jun 4 08:10:47 2022] POST /identity/v3/users => generated 160 bytes in 177 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:47.443663 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c924e-19ac-4111-bf15-21c7199ddd8e None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:47.546118 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c924e-19ac-4111-bf15-21c7199ddd8e None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:47.561231 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:47.584722 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012c557-2b98-49a0-babb-93ff4ec326f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:47.585921 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012c557-2b98-49a0-babb-93ff4ec326f4 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:47.586446 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012c557-2b98-49a0-babb-93ff4ec326f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:47.586933 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012c557-2b98-49a0-babb-93ff4ec326f4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:47.594750 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a012c557-2b98-49a0-babb-93ff4ec326f4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:47.596440 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a012c557-2b98-49a0-babb-93ff4ec326f4 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:47.611063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-a012c557-2b98-49a0-babb-93ff4ec326f4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 04 08:10:47.611063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:47.611063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:47.611063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:47.611063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:47.611063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:47.611063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:47.611063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:47.611063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:47.611063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:47.611063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:47.611063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:47.611063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:10:47.611063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:10:47.611063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:10:47.611063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:10:47.612011 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:47.612011 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:47.612011 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:10:47.612011 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:47.612011 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:10:47.612011 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:47.612011 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:47.612011 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:47.612011 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:47.612011 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:47.612011 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:47.612011 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:47.612011 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:47.612011 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:47.612011 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:47.612011 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:47.612011 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:47.612011 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:47.613049 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:47.613049 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:47.613049 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:10:47.613049 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:10:47.613049 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:10:47.613049 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:10:47.613049 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:10:47.613049 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:10:47.613049 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 04 08:10:47.613049 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:47.615602 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 482/964] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:10:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:47.624101 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59aeda-384b-4650-84ab-e91a5b83f541 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:47.731172 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59aeda-384b-4650-84ab-e91a5b83f541 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:47.745154 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:47.767361 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489285e-0184-4d3a-9689-4571882cd357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:47.768078 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489285e-0184-4d3a-9689-4571882cd357 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:47.768756 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489285e-0184-4d3a-9689-4571882cd357 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:47.769403 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489285e-0184-4d3a-9689-4571882cd357 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:47.770247 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489285e-0184-4d3a-9689-4571882cd357 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:47.771021 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489285e-0184-4d3a-9689-4571882cd357 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:47.772719 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489285e-0184-4d3a-9689-4571882cd357 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:47.814901 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 483/965] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jun 4 08:10:47 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:48.771699 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0bd0b-8813-4edc-aa40-f21cfdf25b7f None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:48.772265 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0bd0b-8813-4edc-aa40-f21cfdf25b7f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:48.772265 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0bd0b-8813-4edc-aa40-f21cfdf25b7f None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:48.773651 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 483/966] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:48.778872 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a9a1f-8373-4cef-84f2-cd75e61802d6 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:48.779298 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a9a1f-8373-4cef-84f2-cd75e61802d6 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:48.779478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a9a1f-8373-4cef-84f2-cd75e61802d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:48.797006 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-678a9a1f-8373-4cef-84f2-cd75e61802d6 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:48.798554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-678a9a1f-8373-4cef-84f2-cd75e61802d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:48.868517 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 484/967] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:10:48.894837 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0bd0b-8813-4edc-aa40-f21cfdf25b7f None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:48.945301 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9a002-f29d-4a67-8021-93aaef0a51e3 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:48.945585 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9a002-f29d-4a67-8021-93aaef0a51e3 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:48.945887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9a002-f29d-4a67-8021-93aaef0a51e3 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:48.947394 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 485/968] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:48.952238 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e84dd4-f1e2-46ad-8f3c-201544821a38 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:48.952526 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e84dd4-f1e2-46ad-8f3c-201544821a38 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:48.952804 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e84dd4-f1e2-46ad-8f3c-201544821a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:48.970238 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-33e84dd4-f1e2-46ad-8f3c-201544821a38 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:48.971431 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-33e84dd4-f1e2-46ad-8f3c-201544821a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:49.007342 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0bd0b-8813-4edc-aa40-f21cfdf25b7f None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:49.037721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 486/969] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 08:10:49.039323 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bebf8-59df-4483-88c8-01f55e0c61d1 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:49.039614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bebf8-59df-4483-88c8-01f55e0c61d1 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:49.039895 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bebf8-59df-4483-88c8-01f55e0c61d1 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:49.041161 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 487/970] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:49.041336 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8d2bb-51a0-476d-a187-1afb39b42e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:49.042174 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8d2bb-51a0-476d-a187-1afb39b42e3b None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:49.042682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8d2bb-51a0-476d-a187-1afb39b42e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:49.043099 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8d2bb-51a0-476d-a187-1afb39b42e3b None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:49.043966 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8d2bb-51a0-476d-a187-1afb39b42e3b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:49.045622 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8d2bb-51a0-476d-a187-1afb39b42e3b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:49.046632 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f9b7f-afcb-4b2b-aa04-751119fae514 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:49.046918 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f9b7f-afcb-4b2b-aa04-751119fae514 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:49.047192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f9b7f-afcb-4b2b-aa04-751119fae514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:49.061635 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 484/971] 10.222.0.57 () {60 vars in 1141 bytes} [Sat Jun 4 08:10:48 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:10:49.062709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8d2bb-51a0-476d-a187-1afb39b42e3b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:49.075259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-109f9b7f-afcb-4b2b-aa04-751119fae514 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:49.076893 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-109f9b7f-afcb-4b2b-aa04-751119fae514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:49.105754 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:49.105980 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:49.164125 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 488/972] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 08:10:49.189405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f9b7f-afcb-4b2b-aa04-751119fae514 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:49.206745 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8d2bb-51a0-476d-a187-1afb39b42e3b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:49.248062 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e27948-2048-4de9-9973-66bd01df5639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:49.248951 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e27948-2048-4de9-9973-66bd01df5639 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:49.249233 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e27948-2048-4de9-9973-66bd01df5639 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:49.249506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e27948-2048-4de9-9973-66bd01df5639 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:49.265303 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e27948-2048-4de9-9973-66bd01df5639 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:10:49.273617 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-46e27948-2048-4de9-9973-66bd01df5639 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 08:10:49.273617 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:49.273617 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:49.273617 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:49.273617 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:49.273617 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:49.273617 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:49.273617 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:49.273617 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:49.273617 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:49.273617 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:49.273617 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:49.273617 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:10:49.273617 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:10:49.273617 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:10:49.273617 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:10:49.274692 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:10:49.274692 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:10:49.274692 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:10:49.274692 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:10:49.274692 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:49.274692 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:49.274692 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:49.274692 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:49.274692 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:49.274692 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:49.274692 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:49.274692 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:49.274692 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:49.274692 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:49.274692 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:49.274692 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:49.275548 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:49.275548 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:49.275548 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:49.275548 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:49.275548 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:10:49.275548 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:10:49.275548 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:10:49.275548 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:10:49.275548 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:10:49.275548 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:10:49.275548 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 08:10:49.275548 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:49.275548 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 485/973] 10.222.0.57 () {56 vars in 1120 bytes} [Sat Jun 4 08:10:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:49.280647 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e27948-2048-4de9-9973-66bd01df5639 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:49.305332 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f9b7f-afcb-4b2b-aa04-751119fae514 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:49.344163 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c08d32-b3ee-4b27-b16e-971a95b6e5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:49.344986 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c08d32-b3ee-4b27-b16e-971a95b6e5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:49.345267 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c08d32-b3ee-4b27-b16e-971a95b6e5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:49.345544 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c08d32-b3ee-4b27-b16e-971a95b6e5f1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:49.346214 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c08d32-b3ee-4b27-b16e-971a95b6e5f1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:49.347575 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c08d32-b3ee-4b27-b16e-971a95b6e5f1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:49.359426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-92c08d32-b3ee-4b27-b16e-971a95b6e5f1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 08:10:49.359426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:49.359426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 08:10:49.359426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 08:10:49.359426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 08:10:49.359426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 08:10:49.359426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 08:10:49.359426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:49.359426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 08:10:49.359426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:49.359426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 08:10:49.359426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:49.359426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:49.359426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:49.359426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:49.359426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:49.359426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:49.361012 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:49.361012 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:49.361012 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:49.361012 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:49.361012 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:49.361012 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:49.361012 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 08:10:49.361012 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 08:10:49.361012 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 08:10:49.361012 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 08:10:49.361012 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:49.361012 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:49.361012 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:49.361012 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:49.361012 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:49.361012 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:49.362724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:49.362724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:49.362724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:49.362724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:49.362724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:49.362724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:49.362724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:49.362724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:49.362724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:49.362724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:49.362724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 08:10:49.362724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:49.362724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 08:10:49.362724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:49.362724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 489/974] 10.222.0.57 () {56 vars in 1126 bytes} [Sat Jun 4 08:10:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:10:49.367035 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c08d32-b3ee-4b27-b16e-971a95b6e5f1 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:49.387379 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:49.390156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:49.395623 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e27948-2048-4de9-9973-66bd01df5639 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:49.433175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903e66e-b444-4ca4-a438-4b7c6007996b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:49.434002 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903e66e-b444-4ca4-a438-4b7c6007996b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:49.434287 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903e66e-b444-4ca4-a438-4b7c6007996b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:49.434562 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903e66e-b444-4ca4-a438-4b7c6007996b None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:49.435303 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4903e66e-b444-4ca4-a438-4b7c6007996b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:49.435869 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4903e66e-b444-4ca4-a438-4b7c6007996b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:49.437906 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4903e66e-b444-4ca4-a438-4b7c6007996b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:49.454495 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 486/975] 10.222.0.57 () {56 vars in 1115 bytes} [Sat Jun 4 08:10:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:49.455670 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903e66e-b444-4ca4-a438-4b7c6007996b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:49.472209 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c08d32-b3ee-4b27-b16e-971a95b6e5f1 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:49.508576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf16b6-4995-4a1f-9111-9c232c5ff3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:49.509244 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf16b6-4995-4a1f-9111-9c232c5ff3cc None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:49.509528 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf16b6-4995-4a1f-9111-9c232c5ff3cc None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:49.509811 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf16b6-4995-4a1f-9111-9c232c5ff3cc None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:49.510542 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf16b6-4995-4a1f-9111-9c232c5ff3cc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:49.510849 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf16b6-4995-4a1f-9111-9c232c5ff3cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:49.512221 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf16b6-4995-4a1f-9111-9c232c5ff3cc None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:49.517153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 490/976] 10.222.0.57 () {56 vars in 1122 bytes} [Sat Jun 4 08:10:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:49.523020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf16b6-4995-4a1f-9111-9c232c5ff3cc None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:49.571815 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903e66e-b444-4ca4-a438-4b7c6007996b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:49.607253 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af9f20-8368-481c-8922-b6966ec01a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:49.608046 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af9f20-8368-481c-8922-b6966ec01a31 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:49.608325 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af9f20-8368-481c-8922-b6966ec01a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:49.608596 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af9f20-8368-481c-8922-b6966ec01a31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:49.619932 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af9f20-8368-481c-8922-b6966ec01a31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:49.621360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af9f20-8368-481c-8922-b6966ec01a31 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:49.622356 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:49.638866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-f4af9f20-8368-481c-8922-b6966ec01a31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:49.638866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:49.638866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:49.638866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:49.638866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:49.638866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:49.638866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:49.638866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:49.638866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:49.638866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:49.638866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:49.638866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:49.638866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:49.638866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:49.638866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:49.639905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:49.639905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:49.639905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:49.639905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:49.639905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:49.639905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:49.639905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:49.639905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:49.639905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:49.639905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:49.639905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:49.639905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:49.639905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:49.639905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:49.639905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:49.639905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:49.639905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:49.645603 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:49.645603 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:49.645603 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:49.645603 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:49.645868 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf16b6-4995-4a1f-9111-9c232c5ff3cc None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:49.645950 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 487/977] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:49.645950 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af9f20-8368-481c-8922-b6966ec01a31 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:49.656498 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:49.683457 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316b24d-5b8f-4bec-b4a5-56899bc6a209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:49.684184 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316b24d-5b8f-4bec-b4a5-56899bc6a209 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:49.684468 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316b24d-5b8f-4bec-b4a5-56899bc6a209 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:49.684741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316b24d-5b8f-4bec-b4a5-56899bc6a209 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:49.685492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316b24d-5b8f-4bec-b4a5-56899bc6a209 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:49.685802 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316b24d-5b8f-4bec-b4a5-56899bc6a209 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:49.687677 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316b24d-5b8f-4bec-b4a5-56899bc6a209 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:49.698878 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 491/978] 10.222.0.57 () {56 vars in 1122 bytes} [Sat Jun 4 08:10:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:49.699822 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316b24d-5b8f-4bec-b4a5-56899bc6a209 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:49.749731 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af9f20-8368-481c-8922-b6966ec01a31 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:49.785193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092a072-1d5d-40da-b15f-a73d6f6fa6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:49.786003 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092a072-1d5d-40da-b15f-a73d6f6fa6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:49.786266 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092a072-1d5d-40da-b15f-a73d6f6fa6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:49.786542 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092a072-1d5d-40da-b15f-a73d6f6fa6a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:49.787255 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092a072-1d5d-40da-b15f-a73d6f6fa6a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:49.787560 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092a072-1d5d-40da-b15f-a73d6f6fa6a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:49.788919 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092a072-1d5d-40da-b15f-a73d6f6fa6a7 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:49.802106 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316b24d-5b8f-4bec-b4a5-56899bc6a209 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:49.807231 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 488/979] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:49.807793 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092a072-1d5d-40da-b15f-a73d6f6fa6a7 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:49.840829 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9251c-d1d7-4573-ae2a-85caef3081a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:49.841403 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9251c-d1d7-4573-ae2a-85caef3081a2 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:49.841683 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9251c-d1d7-4573-ae2a-85caef3081a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:49.841982 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9251c-d1d7-4573-ae2a-85caef3081a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:49.842766 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9251c-d1d7-4573-ae2a-85caef3081a2 None admin] RBAC: Adding query filter params (interface=admin, service_id=00821a1b56424c6f9c2ec95bccff27f8, region_id=RegionOne) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:49.843074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9251c-d1d7-4573-ae2a-85caef3081a2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:49.844512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9251c-d1d7-4573-ae2a-85caef3081a2 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:49.850096 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 492/980] 10.222.0.57 () {56 vars in 1249 bytes} [Sat Jun 4 08:10:49 2022] GET /identity/v3/endpoints?service_id=00821a1b56424c6f9c2ec95bccff27f8&interface=admin®ion_id=RegionOne => generated 193 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:49.855354 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9251c-d1d7-4573-ae2a-85caef3081a2 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:49.870509 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:49.884878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:49.929394 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092a072-1d5d-40da-b15f-a73d6f6fa6a7 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:49.963684 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9251c-d1d7-4573-ae2a-85caef3081a2 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:49.966232 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525db7c7-186a-4a32-8103-9616c448672f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:49.967036 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525db7c7-186a-4a32-8103-9616c448672f None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:49.967320 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525db7c7-186a-4a32-8103-9616c448672f None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:49.967594 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525db7c7-186a-4a32-8103-9616c448672f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:49.975585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525db7c7-186a-4a32-8103-9616c448672f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:49.977165 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525db7c7-186a-4a32-8103-9616c448672f None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:49.993794 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-525db7c7-186a-4a32-8103-9616c448672f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 08:10:49.993794 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:49.993794 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:49.993794 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:49.993794 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:49.993794 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:49.993794 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:49.993794 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:49.993794 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:49.993794 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:49.993794 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:49.993794 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:49.993794 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:10:49.993794 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:10:49.993794 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:10:49.993794 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:10:49.994789 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:49.994789 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:49.994789 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:10:49.994789 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:49.994789 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:10:49.994789 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:49.994789 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:49.994789 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:49.994789 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:49.994789 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:49.994789 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:49.994789 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:49.994789 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:49.994789 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:49.994789 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:49.994789 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:49.994789 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:49.994789 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:49.995773 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:49.995773 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:49.995773 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:10:49.995773 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:10:49.995773 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:10:49.995773 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:10:49.995773 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:10:49.995773 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:10:49.995773 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 08:10:49.995773 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:49.995773 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 489/981] 10.222.0.57 () {56 vars in 1117 bytes} [Sat Jun 4 08:10:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:10:50.000545 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525db7c7-186a-4a32-8103-9616c448672f None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:50.000933 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3f086-6212-42b9-8c6b-04f3a0261ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:50.001621 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3f086-6212-42b9-8c6b-04f3a0261ccc None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:50.001928 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3f086-6212-42b9-8c6b-04f3a0261ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:50.002210 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3f086-6212-42b9-8c6b-04f3a0261ccc None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:50.002880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3f086-6212-42b9-8c6b-04f3a0261ccc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:50.004250 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3f086-6212-42b9-8c6b-04f3a0261ccc None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:50.010650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 493/982] 10.222.0.57 () {56 vars in 1087 bytes} [Sat Jun 4 08:10:49 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:10:50.109725 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525db7c7-186a-4a32-8103-9616c448672f None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:50.138618 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:50.148551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0af475-9078-455e-b3f8-280b44d10d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:50.149484 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0af475-9078-455e-b3f8-280b44d10d2f None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:50.149950 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0af475-9078-455e-b3f8-280b44d10d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:50.150375 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0af475-9078-455e-b3f8-280b44d10d2f None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:50.151414 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0af475-9078-455e-b3f8-280b44d10d2f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:50.151896 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0af475-9078-455e-b3f8-280b44d10d2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:50.153528 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0af475-9078-455e-b3f8-280b44d10d2f None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:50.173455 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 490/983] 10.222.0.57 () {56 vars in 1149 bytes} [Sat Jun 4 08:10:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:50.179889 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3f086-6212-42b9-8c6b-04f3a0261ccc None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:50.268931 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:50.293436 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3f086-6212-42b9-8c6b-04f3a0261ccc None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:50.328163 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4be8a5-cea6-48b4-9330-2152d1cb7022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:50.328818 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4be8a5-cea6-48b4-9330-2152d1cb7022 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:50.329102 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4be8a5-cea6-48b4-9330-2152d1cb7022 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:50.329408 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4be8a5-cea6-48b4-9330-2152d1cb7022 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:50.397625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4be8a5-cea6-48b4-9330-2152d1cb7022 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:50.399049 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4be8a5-cea6-48b4-9330-2152d1cb7022 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:50.474073 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:50.503226 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 494/984] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:10:50 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 08:10:50.504558 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0af475-9078-455e-b3f8-280b44d10d2f None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:50.603794 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0af475-9078-455e-b3f8-280b44d10d2f None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:50.637682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223cf8c-f166-41b7-943b-11a6654bd3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:50.638506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223cf8c-f166-41b7-943b-11a6654bd3d3 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:50.638789 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223cf8c-f166-41b7-943b-11a6654bd3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:50.639065 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223cf8c-f166-41b7-943b-11a6654bd3d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:50.649863 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223cf8c-f166-41b7-943b-11a6654bd3d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:50.651252 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223cf8c-f166-41b7-943b-11a6654bd3d3 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:50.668466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-4223cf8c-f166-41b7-943b-11a6654bd3d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:50.668466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:50.668466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:50.668466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:50.668466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:50.668466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:50.668466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:50.668466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:50.668466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:50.668466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:50.668466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:50.668466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:50.668466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:50.668466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:50.668466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:50.669377 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:50.669377 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:50.669377 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:50.669377 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:50.669377 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:50.669377 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:50.669377 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:50.669377 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:50.669377 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:50.669377 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:50.669377 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:50.669377 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:50.669377 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:50.669377 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:50.669377 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:50.669377 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:50.669377 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:50.674807 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:50.674807 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:50.674807 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:50.674807 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:50.674807 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 491/985] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:50.675433 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4be8a5-cea6-48b4-9330-2152d1cb7022 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:50.779401 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4be8a5-cea6-48b4-9330-2152d1cb7022 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:50.814583 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe511e3-621e-4443-802e-006cfaa3b410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:50.815331 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe511e3-621e-4443-802e-006cfaa3b410 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:50.815526 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe511e3-621e-4443-802e-006cfaa3b410 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:50.815807 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe511e3-621e-4443-802e-006cfaa3b410 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:50.816529 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe511e3-621e-4443-802e-006cfaa3b410 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:50.816833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe511e3-621e-4443-802e-006cfaa3b410 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:50.818224 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe511e3-621e-4443-802e-006cfaa3b410 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:50.834310 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 495/986] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:50.835603 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223cf8c-f166-41b7-943b-11a6654bd3d3 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:50.877048 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:50.946039 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223cf8c-f166-41b7-943b-11a6654bd3d3 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:50.983200 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660146bf-603b-4955-baae-5b87458d37ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:50.983998 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660146bf-603b-4955-baae-5b87458d37ce None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:50.984408 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660146bf-603b-4955-baae-5b87458d37ce None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:50.984635 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660146bf-603b-4955-baae-5b87458d37ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:50.992047 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660146bf-603b-4955-baae-5b87458d37ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:50.993517 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660146bf-603b-4955-baae-5b87458d37ce None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:51.008178 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-660146bf-603b-4955-baae-5b87458d37ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:51.008178 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:51.008178 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:51.008178 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:51.008178 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:51.008178 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:51.008178 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:51.008178 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:51.008178 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:51.008178 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:51.008178 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:51.008178 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:51.008178 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:10:51.008178 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:10:51.008178 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:10:51.009287 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:10:51.009287 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:51.009287 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:51.009287 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:51.009287 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:51.009287 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:51.009287 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:51.009287 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:51.009287 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:51.009287 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:51.009287 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:51.009287 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:51.009287 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:51.009287 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:51.009287 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:51.009287 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:51.009287 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:51.010252 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:10:51.010252 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:10:51.010252 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:10:51.010252 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:10:51.010252 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:10:51.010252 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:10:51.010252 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:51.010252 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:51.011448 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 492/987] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:10:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:51.015561 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe511e3-621e-4443-802e-006cfaa3b410 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:51.055467 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:51.121968 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe511e3-621e-4443-802e-006cfaa3b410 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:51.157164 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c2d22-5c50-4c1b-aa1f-0e67d59133bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:51.157891 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c2d22-5c50-4c1b-aa1f-0e67d59133bb None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:51.158178 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c2d22-5c50-4c1b-aa1f-0e67d59133bb None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:51.158455 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c2d22-5c50-4c1b-aa1f-0e67d59133bb None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:51.159240 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c2d22-5c50-4c1b-aa1f-0e67d59133bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:51.159546 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c2d22-5c50-4c1b-aa1f-0e67d59133bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:51.160998 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c2d22-5c50-4c1b-aa1f-0e67d59133bb None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:51.173614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 496/988] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:10:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:51.179466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660146bf-603b-4955-baae-5b87458d37ce None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:51.280849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:51.286467 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660146bf-603b-4955-baae-5b87458d37ce None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:51.322559 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbdc34-05c6-4323-868b-80b0afaec21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:51.323216 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbdc34-05c6-4323-868b-80b0afaec21b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:51.323496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbdc34-05c6-4323-868b-80b0afaec21b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:51.323772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbdc34-05c6-4323-868b-80b0afaec21b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:51.324594 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cbdc34-05c6-4323-868b-80b0afaec21b None admin] RBAC: Adding query filter params (role.id=725918a0815f44dca0cc6586938c7b2f, scope.project.id=634c9a1745ef44c0ad66e02493d79af0, user.id=aff5d82384e84b669eeb00089ab8e09a) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:51.324908 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cbdc34-05c6-4323-868b-80b0afaec21b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:51.326376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cbdc34-05c6-4323-868b-80b0afaec21b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:51.332429 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 493/989] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:10:51 2022] GET /identity/v3/role_assignments?user.id=aff5d82384e84b669eeb00089ab8e09a&scope.project.id=634c9a1745ef44c0ad66e02493d79af0&role.id=725918a0815f44dca0cc6586938c7b2f => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:51.352110 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10502b-05bd-46fb-a5b3-ab6f4c9f7bfa None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:51.352414 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10502b-05bd-46fb-a5b3-ab6f4c9f7bfa None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:51.352844 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10502b-05bd-46fb-a5b3-ab6f4c9f7bfa None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:51.354462 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 497/990] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:51.361219 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fa363-12e5-4ecd-b93d-7024e100abb3 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:51.361553 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fa363-12e5-4ecd-b93d-7024e100abb3 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:51.361788 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fa363-12e5-4ecd-b93d-7024e100abb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:51.379642 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-131fa363-12e5-4ecd-b93d-7024e100abb3 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:51.380850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-131fa363-12e5-4ecd-b93d-7024e100abb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:51.453943 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 494/991] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:10:51.477076 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10502b-05bd-46fb-a5b3-ab6f4c9f7bfa None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:51.579960 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:51.587754 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10502b-05bd-46fb-a5b3-ab6f4c9f7bfa None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:51.623056 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d05f15-8845-42d6-b41d-f5c49e764482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:51.624159 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d05f15-8845-42d6-b41d-f5c49e764482 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:51.624613 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d05f15-8845-42d6-b41d-f5c49e764482 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:51.625061 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d05f15-8845-42d6-b41d-f5c49e764482 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:51.625892 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d05f15-8845-42d6-b41d-f5c49e764482 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:51.627509 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d05f15-8845-42d6-b41d-f5c49e764482 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:51.639296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-03d05f15-8845-42d6-b41d-f5c49e764482 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 08:10:51.639296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:51.639296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 08:10:51.639296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 08:10:51.639296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 08:10:51.639296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 08:10:51.639296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 08:10:51.639296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:51.639296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 08:10:51.639296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:51.639296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 08:10:51.639296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:51.639296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:51.639296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:51.639296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:51.639296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:51.639296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:51.640345 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:51.640345 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:51.640345 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:51.640345 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:51.640345 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:51.640345 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:51.640345 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 08:10:51.640345 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 08:10:51.640345 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 08:10:51.640345 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 08:10:51.640345 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:51.640345 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:51.640345 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:51.640345 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:51.640345 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:51.640345 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:51.641200 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:51.641200 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:51.641200 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:51.641200 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:51.641200 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:51.641200 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:51.641200 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:51.641200 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:51.641200 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:51.641200 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:51.641200 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 08:10:51.641200 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:51.641200 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 08:10:51.641200 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:51.645945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 498/992] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:10:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:51.648132 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fa363-12e5-4ecd-b93d-7024e100abb3 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:51.742612 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:51.752650 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fa363-12e5-4ecd-b93d-7024e100abb3 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:51.787752 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86402257-2bd5-404d-b128-ed846e221b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:51.788419 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86402257-2bd5-404d-b128-ed846e221b78 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:51.788702 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86402257-2bd5-404d-b128-ed846e221b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:51.788978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86402257-2bd5-404d-b128-ed846e221b78 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:51.789679 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86402257-2bd5-404d-b128-ed846e221b78 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:51.790017 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86402257-2bd5-404d-b128-ed846e221b78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:51.791393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86402257-2bd5-404d-b128-ed846e221b78 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:51.796446 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 495/993] 10.222.0.57 () {56 vars in 1112 bytes} [Sat Jun 4 08:10:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:51.802081 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d05f15-8845-42d6-b41d-f5c49e764482 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:51.904342 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d05f15-8845-42d6-b41d-f5c49e764482 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:51.944412 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421704d-65ab-44db-a147-a27281f9ba79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:51.945082 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421704d-65ab-44db-a147-a27281f9ba79 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:51.945373 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421704d-65ab-44db-a147-a27281f9ba79 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:51.945644 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421704d-65ab-44db-a147-a27281f9ba79 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:51.946378 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2421704d-65ab-44db-a147-a27281f9ba79 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:51.946686 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2421704d-65ab-44db-a147-a27281f9ba79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:51.948058 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2421704d-65ab-44db-a147-a27281f9ba79 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:51.958992 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 499/994] 10.222.0.57 () {56 vars in 1112 bytes} [Sat Jun 4 08:10:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:51.960547 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86402257-2bd5-404d-b128-ed846e221b78 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:52.065513 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86402257-2bd5-404d-b128-ed846e221b78 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:52.099500 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ead1bf-bfd7-49d4-8086-14ce22df737e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:52.100158 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ead1bf-bfd7-49d4-8086-14ce22df737e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:52.100438 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ead1bf-bfd7-49d4-8086-14ce22df737e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:52.100711 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ead1bf-bfd7-49d4-8086-14ce22df737e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:52.101498 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ead1bf-bfd7-49d4-8086-14ce22df737e None admin] RBAC: Adding query filter params (interface=public, service_id=152a9c7319324c33b00bb04ef35db581, region_id=RegionOne) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:52.101815 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ead1bf-bfd7-49d4-8086-14ce22df737e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:52.103207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ead1bf-bfd7-49d4-8086-14ce22df737e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:52.109476 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 496/995] 10.222.0.57 () {56 vars in 1251 bytes} [Sat Jun 4 08:10:51 2022] GET /identity/v3/endpoints?service_id=152a9c7319324c33b00bb04ef35db581&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:52.113975 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421704d-65ab-44db-a147-a27281f9ba79 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:52.140757 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:52.219475 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421704d-65ab-44db-a147-a27281f9ba79 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:52.254190 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84e9d4-b3b1-4452-98b0-3ce8198e3517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:52.254855 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84e9d4-b3b1-4452-98b0-3ce8198e3517 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:52.255140 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84e9d4-b3b1-4452-98b0-3ce8198e3517 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:52.255417 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84e9d4-b3b1-4452-98b0-3ce8198e3517 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:52.256091 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84e9d4-b3b1-4452-98b0-3ce8198e3517 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:52.257455 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84e9d4-b3b1-4452-98b0-3ce8198e3517 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:52.264961 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 500/996] 10.222.0.57 () {56 vars in 1087 bytes} [Sat Jun 4 08:10:52 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:10:52.302105 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb98e10-2957-40c1-8d0d-b60bbc071f45 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:52.302476 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb98e10-2957-40c1-8d0d-b60bbc071f45 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:52.303062 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb98e10-2957-40c1-8d0d-b60bbc071f45 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:52.304841 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 497/997] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:52.310874 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd183289-a50c-4b93-9224-8be3105fa79d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:52.311170 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd183289-a50c-4b93-9224-8be3105fa79d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:52.311443 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd183289-a50c-4b93-9224-8be3105fa79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:52.329451 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-dd183289-a50c-4b93-9224-8be3105fa79d None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:52.330647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-dd183289-a50c-4b93-9224-8be3105fa79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:52.403171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 501/998] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:10:52.426512 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb98e10-2957-40c1-8d0d-b60bbc071f45 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:52.451446 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:52.540682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb98e10-2957-40c1-8d0d-b60bbc071f45 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:52.576672 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ab090-eb43-4a58-9ce8-cdfbb3c81e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:52.577480 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ab090-eb43-4a58-9ce8-cdfbb3c81e06 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:52.577762 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ab090-eb43-4a58-9ce8-cdfbb3c81e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:52.578065 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ab090-eb43-4a58-9ce8-cdfbb3c81e06 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:52.578745 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ab090-eb43-4a58-9ce8-cdfbb3c81e06 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:52.580202 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ab090-eb43-4a58-9ce8-cdfbb3c81e06 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:52.592238 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-fe5ab090-eb43-4a58-9ce8-cdfbb3c81e06 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 08:10:52.592238 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:52.592238 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 08:10:52.592238 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 08:10:52.592238 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 08:10:52.592238 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 08:10:52.592238 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 08:10:52.592238 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:52.592238 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 08:10:52.592238 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:52.592238 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 08:10:52.592238 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:52.592238 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:52.592238 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:52.592238 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:52.592238 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:52.592238 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:52.593430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:52.593430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:52.593430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:52.593430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:52.593430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:52.593430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:52.593430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 08:10:52.593430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 08:10:52.593430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 08:10:52.593430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 08:10:52.593430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:52.593430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:52.593430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:52.593430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:52.593430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:52.593430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:52.594549 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:52.594549 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:52.594549 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:52.594549 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:52.594549 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:52.594549 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:52.594549 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:52.594549 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:52.594549 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:52.594549 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:52.594549 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 08:10:52.594549 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:52.594549 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 08:10:52.594549 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:52.594549 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 498/999] 10.222.0.57 () {56 vars in 1126 bytes} [Sat Jun 4 08:10:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:52.600338 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd183289-a50c-4b93-9224-8be3105fa79d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:52.619994 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:52.706892 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd183289-a50c-4b93-9224-8be3105fa79d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:52.741722 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b8b16-4a71-4f05-87c6-8f15cf6ee77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:52.742413 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b8b16-4a71-4f05-87c6-8f15cf6ee77f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:52.742699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b8b16-4a71-4f05-87c6-8f15cf6ee77f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:52.742973 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b8b16-4a71-4f05-87c6-8f15cf6ee77f None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:52.743667 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b8b16-4a71-4f05-87c6-8f15cf6ee77f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:52.743971 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b8b16-4a71-4f05-87c6-8f15cf6ee77f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:52.745333 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b8b16-4a71-4f05-87c6-8f15cf6ee77f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:52.754747 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 502/1000] 10.222.0.57 () {56 vars in 1122 bytes} [Sat Jun 4 08:10:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:52.756255 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ab090-eb43-4a58-9ce8-cdfbb3c81e06 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:52.846541 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:52.865191 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ab090-eb43-4a58-9ce8-cdfbb3c81e06 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:52.898720 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ec537-7369-47f5-8db7-ff9de7d2708d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:52.899505 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ec537-7369-47f5-8db7-ff9de7d2708d None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:52.899805 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ec537-7369-47f5-8db7-ff9de7d2708d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:52.900084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ec537-7369-47f5-8db7-ff9de7d2708d None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:52.900835 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ec537-7369-47f5-8db7-ff9de7d2708d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:52.901146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ec537-7369-47f5-8db7-ff9de7d2708d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:52.902539 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ec537-7369-47f5-8db7-ff9de7d2708d None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:52.912722 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 499/1001] 10.222.0.57 () {56 vars in 1122 bytes} [Sat Jun 4 08:10:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:52.916934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b8b16-4a71-4f05-87c6-8f15cf6ee77f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:53.000683 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:53.020715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b8b16-4a71-4f05-87c6-8f15cf6ee77f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:53.055248 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcebba-2e05-4019-a994-c8c5f120d984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:53.055919 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcebba-2e05-4019-a994-c8c5f120d984 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:53.056187 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcebba-2e05-4019-a994-c8c5f120d984 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:53.056462 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcebba-2e05-4019-a994-c8c5f120d984 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:53.057187 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcebba-2e05-4019-a994-c8c5f120d984 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:53.058589 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcebba-2e05-4019-a994-c8c5f120d984 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:53.081860 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 503/1002] 10.222.0.57 () {60 vars in 1144 bytes} [Sat Jun 4 08:10:52 2022] POST /identity/v3/endpoints => generated 325 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:10:53.642107 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0fc56-ecc9-49aa-96ca-282b1cf919e9 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:53.642639 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0fc56-ecc9-49aa-96ca-282b1cf919e9 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:53.642639 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0fc56-ecc9-49aa-96ca-282b1cf919e9 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:53.644027 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 500/1003] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:53.649148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ee1d0-a779-4bde-9dba-92c694a7c942 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:53.649441 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ee1d0-a779-4bde-9dba-92c694a7c942 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:53.649721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ee1d0-a779-4bde-9dba-92c694a7c942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:53.666883 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-738ee1d0-a779-4bde-9dba-92c694a7c942 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:53.668063 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-738ee1d0-a779-4bde-9dba-92c694a7c942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:53.741848 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 504/1004] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:53 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:10:53.763487 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0fc56-ecc9-49aa-96ca-282b1cf919e9 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:53.874857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0fc56-ecc9-49aa-96ca-282b1cf919e9 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:53.909380 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058d2d1-ee69-47a1-a163-59f1a7860b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:53.917310 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058d2d1-ee69-47a1-a163-59f1a7860b5e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:53.917310 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058d2d1-ee69-47a1-a163-59f1a7860b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:53.917310 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058d2d1-ee69-47a1-a163-59f1a7860b5e None admin] PATH_INFO: `/v3/services/image` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:53.917310 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058d2d1-ee69-47a1-a163-59f1a7860b5e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:53.917310 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058d2d1-ee69-47a1-a163-59f1a7860b5e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:53.929563 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-7058d2d1-ee69-47a1-a163-59f1a7860b5e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 08:10:53.929563 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:53.929563 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 08:10:53.929563 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 08:10:53.929563 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 08:10:53.929563 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 08:10:53.929563 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 08:10:53.929563 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:53.929563 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 08:10:53.929563 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:53.929563 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 08:10:53.929563 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:53.929563 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:53.929563 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:53.929563 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:53.929563 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:53.929563 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:53.930723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:53.930723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:53.930723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:53.930723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:53.930723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:53.930723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:53.930723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 08:10:53.930723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 08:10:53.930723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 08:10:53.930723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 08:10:53.930723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:53.930723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:53.930723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:53.930723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:53.930723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:53.930723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:53.931586 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:53.931586 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:53.931586 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:53.931586 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:53.931586 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:53.931586 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:53.931586 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:53.931586 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:53.931586 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:53.931586 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:53.931586 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 08:10:53.931586 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:53.931586 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 08:10:53.931586 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:53.931586 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 501/1005] 10.222.0.57 () {56 vars in 1105 bytes} [Sat Jun 4 08:10:53 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:10:53.936920 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ee1d0-a779-4bde-9dba-92c694a7c942 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:54.006003 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:54.042916 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ee1d0-a779-4bde-9dba-92c694a7c942 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:54.076578 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1dcb3-9e4d-4c74-ab26-aee8b8c351a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:54.077245 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1dcb3-9e4d-4c74-ab26-aee8b8c351a2 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:54.077529 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1dcb3-9e4d-4c74-ab26-aee8b8c351a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:54.077806 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1dcb3-9e4d-4c74-ab26-aee8b8c351a2 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:54.078535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1dcb3-9e4d-4c74-ab26-aee8b8c351a2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:54.078839 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1dcb3-9e4d-4c74-ab26-aee8b8c351a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:54.080853 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1dcb3-9e4d-4c74-ab26-aee8b8c351a2 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:54.090728 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 505/1006] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:54.091662 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058d2d1-ee69-47a1-a163-59f1a7860b5e None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:54.107592 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:54.197186 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058d2d1-ee69-47a1-a163-59f1a7860b5e None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:54.233205 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0019e3-0bf8-4d7e-bdfa-9be435d00e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:54.233931 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0019e3-0bf8-4d7e-bdfa-9be435d00e77 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:54.234276 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0019e3-0bf8-4d7e-bdfa-9be435d00e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:54.234556 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0019e3-0bf8-4d7e-bdfa-9be435d00e77 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:54.235327 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0019e3-0bf8-4d7e-bdfa-9be435d00e77 None admin] RBAC: Adding query filter params (type=image) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:54.235642 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0019e3-0bf8-4d7e-bdfa-9be435d00e77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:54.237127 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0019e3-0bf8-4d7e-bdfa-9be435d00e77 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:54.242960 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 502/1007] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:54 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:54.576247 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47bac6-85c2-4322-b0e2-d0d793b8290d None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:54.576604 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47bac6-85c2-4322-b0e2-d0d793b8290d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:54.576812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47bac6-85c2-4322-b0e2-d0d793b8290d None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:54.578362 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 506/1008] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:54.583667 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9bb5c-1ead-414f-a72e-77b4bdf1d45a None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:54.583963 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9bb5c-1ead-414f-a72e-77b4bdf1d45a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:54.584239 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9bb5c-1ead-414f-a72e-77b4bdf1d45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:54.600934 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-8cd9bb5c-1ead-414f-a72e-77b4bdf1d45a None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:54.602150 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8cd9bb5c-1ead-414f-a72e-77b4bdf1d45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:54.672217 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 503/1009] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:54 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:10:54.696474 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47bac6-85c2-4322-b0e2-d0d793b8290d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:54.802590 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47bac6-85c2-4322-b0e2-d0d793b8290d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:54.832855 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:54.838968 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e83f10-6c69-4b87-94d5-74da2605c265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:54.839769 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e83f10-6c69-4b87-94d5-74da2605c265 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:54.840049 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e83f10-6c69-4b87-94d5-74da2605c265 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:54.840341 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e83f10-6c69-4b87-94d5-74da2605c265 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:54.840973 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e83f10-6c69-4b87-94d5-74da2605c265 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:54.842380 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e83f10-6c69-4b87-94d5-74da2605c265 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:54.854699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-34e83f10-6c69-4b87-94d5-74da2605c265 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 08:10:54.854699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:54.854699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 08:10:54.854699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 08:10:54.854699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 08:10:54.854699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 08:10:54.854699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 08:10:54.854699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:54.854699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 08:10:54.854699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:54.854699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 08:10:54.854699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:54.854699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:54.854699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:54.854699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:54.854699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:54.854699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:54.855702 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:54.855702 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:54.855702 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:54.855702 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:54.855702 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:54.855702 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:54.855702 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 08:10:54.855702 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 08:10:54.855702 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 08:10:54.855702 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 08:10:54.855702 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:54.855702 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:54.855702 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:54.855702 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:54.855702 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:54.855702 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:54.856578 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:54.856578 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:54.856578 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:54.856578 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:54.856578 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:54.856578 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:54.856578 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:54.856578 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:54.856578 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:54.856578 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:54.856578 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 08:10:54.856578 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:54.856578 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 08:10:54.856578 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:54.856578 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 507/1010] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:10:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:54.862376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9bb5c-1ead-414f-a72e-77b4bdf1d45a None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:54.871055 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:54.972309 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9bb5c-1ead-414f-a72e-77b4bdf1d45a None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:55.009671 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4118c-a3bf-47af-8d11-4ee6d7acbfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:55.010410 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4118c-a3bf-47af-8d11-4ee6d7acbfc0 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:55.010695 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4118c-a3bf-47af-8d11-4ee6d7acbfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:55.010973 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4118c-a3bf-47af-8d11-4ee6d7acbfc0 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:55.011701 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4118c-a3bf-47af-8d11-4ee6d7acbfc0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:55.012011 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4118c-a3bf-47af-8d11-4ee6d7acbfc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:55.013429 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4118c-a3bf-47af-8d11-4ee6d7acbfc0 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:55.019354 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 504/1011] 10.222.0.57 () {56 vars in 1112 bytes} [Sat Jun 4 08:10:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:55.024907 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e83f10-6c69-4b87-94d5-74da2605c265 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:55.126272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e83f10-6c69-4b87-94d5-74da2605c265 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:55.159285 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f88bc-8496-4530-b552-b83ccd617b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:55.159952 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f88bc-8496-4530-b552-b83ccd617b36 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:55.160235 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f88bc-8496-4530-b552-b83ccd617b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:55.160512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f88bc-8496-4530-b552-b83ccd617b36 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:55.161211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f88bc-8496-4530-b552-b83ccd617b36 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:55.161519 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f88bc-8496-4530-b552-b83ccd617b36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:55.162939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f88bc-8496-4530-b552-b83ccd617b36 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:55.172499 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 508/1012] 10.222.0.57 () {56 vars in 1112 bytes} [Sat Jun 4 08:10:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:55.173890 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4118c-a3bf-47af-8d11-4ee6d7acbfc0 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:55.243163 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:55.275600 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4118c-a3bf-47af-8d11-4ee6d7acbfc0 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:55.309572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888b8fa-0219-4725-bca4-0cb61adc1b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:55.310254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888b8fa-0219-4725-bca4-0cb61adc1b1e None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:55.310536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888b8fa-0219-4725-bca4-0cb61adc1b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:55.310811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888b8fa-0219-4725-bca4-0cb61adc1b1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:55.311549 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888b8fa-0219-4725-bca4-0cb61adc1b1e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:55.312891 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888b8fa-0219-4725-bca4-0cb61adc1b1e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:55.331895 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27aea6-046e-4b00-badf-6c8df18ee359 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:55.332224 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27aea6-046e-4b00-badf-6c8df18ee359 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:55.332468 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27aea6-046e-4b00-badf-6c8df18ee359 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:55.332571 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 505/1013] 10.222.0.57 () {60 vars in 1144 bytes} [Sat Jun 4 08:10:55 2022] POST /identity/v3/endpoints => generated 334 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:10:55.334166 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 509/1014] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 08:10:55.339706 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7b7a5-8450-420b-abab-8dd65deb6829 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:55.340005 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7b7a5-8450-420b-abab-8dd65deb6829 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:55.340272 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7b7a5-8450-420b-abab-8dd65deb6829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:55.360973 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-e8e7b7a5-8450-420b-abab-8dd65deb6829 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:55.362293 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e8e7b7a5-8450-420b-abab-8dd65deb6829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:55.444094 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 506/1015] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:55 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:10:55.467760 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27aea6-046e-4b00-badf-6c8df18ee359 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:55.534303 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:55.576957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27aea6-046e-4b00-badf-6c8df18ee359 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:55.612827 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe0348-ac8a-4643-ad26-38faacde6900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:55.613631 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe0348-ac8a-4643-ad26-38faacde6900 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:55.613994 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe0348-ac8a-4643-ad26-38faacde6900 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:55.614277 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe0348-ac8a-4643-ad26-38faacde6900 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:55.615468 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe0348-ac8a-4643-ad26-38faacde6900 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:55.616892 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe0348-ac8a-4643-ad26-38faacde6900 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:55.618860 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 510/1016] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:55.624419 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7b7a5-8450-420b-abab-8dd65deb6829 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:55.683937 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:55.734289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7b7a5-8450-420b-abab-8dd65deb6829 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:55.768739 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40566590-d5da-4cc6-933a-f894c42b3f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:55.769394 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40566590-d5da-4cc6-933a-f894c42b3f91 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:55.769678 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40566590-d5da-4cc6-933a-f894c42b3f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:55.769986 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40566590-d5da-4cc6-933a-f894c42b3f91 None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:55.770691 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40566590-d5da-4cc6-933a-f894c42b3f91 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:55.772123 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40566590-d5da-4cc6-933a-f894c42b3f91 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:55.805848 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 507/1017] 10.222.0.57 () {60 vars in 1141 bytes} [Sat Jun 4 08:10:55 2022] POST /identity/v3/projects => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:10:56.508786 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbb0ec-d585-4eb6-bbc3-dadd3b144215 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:56.509344 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbb0ec-d585-4eb6-bbc3-dadd3b144215 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:56.509344 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbb0ec-d585-4eb6-bbc3-dadd3b144215 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:56.510759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 511/1018] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:56.516025 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28eccf0-d38a-4eba-a3aa-c70d5aac9d8e None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:56.516320 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28eccf0-d38a-4eba-a3aa-c70d5aac9d8e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:56.516640 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28eccf0-d38a-4eba-a3aa-c70d5aac9d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:56.533606 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-b28eccf0-d38a-4eba-a3aa-c70d5aac9d8e None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:56.534808 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-b28eccf0-d38a-4eba-a3aa-c70d5aac9d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:56.605248 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 508/1019] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:56 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:10:56.627988 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbb0ec-d585-4eb6-bbc3-dadd3b144215 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:56.732252 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbb0ec-d585-4eb6-bbc3-dadd3b144215 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:56.757950 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:56.767052 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebd271-3139-40d1-8db9-562b88db2f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:56.767659 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebd271-3139-40d1-8db9-562b88db2f36 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:56.767957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebd271-3139-40d1-8db9-562b88db2f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:56.768206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebd271-3139-40d1-8db9-562b88db2f36 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:56.768924 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ebd271-3139-40d1-8db9-562b88db2f36 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:56.770370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ebd271-3139-40d1-8db9-562b88db2f36 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:56.786630 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 512/1020] 10.222.0.57 () {60 vars in 1141 bytes} [Sat Jun 4 08:10:56 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:10:57.715152 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97692fd2-cd89-4120-8a6d-af416c4e514e None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:57.715748 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97692fd2-cd89-4120-8a6d-af416c4e514e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:57.715748 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97692fd2-cd89-4120-8a6d-af416c4e514e None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:57.717185 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 509/1021] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:57.722336 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e7aa5-8977-4602-b190-7b295e53280d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:57.722742 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e7aa5-8977-4602-b190-7b295e53280d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:57.722940 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e7aa5-8977-4602-b190-7b295e53280d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:57.740390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-9f5e7aa5-8977-4602-b190-7b295e53280d None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:57.741633 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9f5e7aa5-8977-4602-b190-7b295e53280d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:57.819273 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 513/1022] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:10:57.842256 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97692fd2-cd89-4120-8a6d-af416c4e514e None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:57.878326 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:57.961099 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97692fd2-cd89-4120-8a6d-af416c4e514e None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:57.996747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1128f-2027-4220-a5da-06580ff418eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:57.997563 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1128f-2027-4220-a5da-06580ff418eb None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:57.997864 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1128f-2027-4220-a5da-06580ff418eb None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:57.998146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1128f-2027-4220-a5da-06580ff418eb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:58.008536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1128f-2027-4220-a5da-06580ff418eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:10:58.016933 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-baf1128f-2027-4220-a5da-06580ff418eb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 08:10:58.016933 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:58.016933 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:58.016933 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:58.016933 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:58.016933 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:58.016933 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:58.016933 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:58.016933 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:58.016933 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:58.016933 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:58.016933 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:58.016933 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:10:58.016933 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:10:58.016933 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:10:58.016933 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:10:58.018142 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:10:58.018142 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:10:58.018142 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:10:58.018142 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:10:58.018142 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:58.018142 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:58.018142 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:58.018142 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:58.018142 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:58.018142 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:58.018142 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:58.018142 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:58.018142 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:58.018142 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:58.018142 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:58.018142 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:58.019009 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:58.019009 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:58.019009 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:58.019009 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:58.019009 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:10:58.019009 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:10:58.019009 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:10:58.019009 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:10:58.019009 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:10:58.019009 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:10:58.019009 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 08:10:58.019009 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:58.021903 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 510/1023] 10.222.0.57 () {56 vars in 1120 bytes} [Sat Jun 4 08:10:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:58.024142 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e7aa5-8977-4602-b190-7b295e53280d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:58.076080 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc6c76-4ab2-4770-9730-6b2378aac5b1 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:58.076369 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc6c76-4ab2-4770-9730-6b2378aac5b1 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:58.076652 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc6c76-4ab2-4770-9730-6b2378aac5b1 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:58.078146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 511/1024] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 08:10:58.083179 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213f794-116d-47c8-8112-18108c4d2466 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:58.083467 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213f794-116d-47c8-8112-18108c4d2466 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:58.083757 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213f794-116d-47c8-8112-18108c4d2466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:58.101026 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-b213f794-116d-47c8-8112-18108c4d2466 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:58.102254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-b213f794-116d-47c8-8112-18108c4d2466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:58.130748 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e7aa5-8977-4602-b190-7b295e53280d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:58.146125 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:58.170291 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345e1a2-94d8-4752-ab8a-76ac38de6095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:58.171082 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345e1a2-94d8-4752-ab8a-76ac38de6095 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:58.171375 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345e1a2-94d8-4752-ab8a-76ac38de6095 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:58.171681 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345e1a2-94d8-4752-ab8a-76ac38de6095 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:58.172425 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345e1a2-94d8-4752-ab8a-76ac38de6095 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:58.172787 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345e1a2-94d8-4752-ab8a-76ac38de6095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:58.174286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 512/1025] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 08:10:58.174709 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345e1a2-94d8-4752-ab8a-76ac38de6095 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:58.187734 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 514/1026] 10.222.0.57 () {56 vars in 1115 bytes} [Sat Jun 4 08:10:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:58.188739 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213f794-116d-47c8-8112-18108c4d2466 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:58.198790 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345e1a2-94d8-4752-ab8a-76ac38de6095 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:58.213421 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:58.291203 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213f794-116d-47c8-8112-18108c4d2466 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:58.307138 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345e1a2-94d8-4752-ab8a-76ac38de6095 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:58.327985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a7965-d658-4ccb-8df8-3cd94eb9538d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:58.329466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a7965-d658-4ccb-8df8-3cd94eb9538d None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:58.329769 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a7965-d658-4ccb-8df8-3cd94eb9538d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:58.330154 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a7965-d658-4ccb-8df8-3cd94eb9538d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:58.340744 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a7965-d658-4ccb-8df8-3cd94eb9538d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:58.341623 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1b196-b469-486e-9f49-8c67d7ff3a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:58.342267 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a7965-d658-4ccb-8df8-3cd94eb9538d None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:58.342436 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1b196-b469-486e-9f49-8c67d7ff3a05 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:58.342704 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1b196-b469-486e-9f49-8c67d7ff3a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:58.342993 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1b196-b469-486e-9f49-8c67d7ff3a05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:58.344124 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1b196-b469-486e-9f49-8c67d7ff3a05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:58.346156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1b196-b469-486e-9f49-8c67d7ff3a05 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:58.347972 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 515/1027] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:58.353171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1b196-b469-486e-9f49-8c67d7ff3a05 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:58.361432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-0c7a7965-d658-4ccb-8df8-3cd94eb9538d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:58.361432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:58.361432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:58.361432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:58.361432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:58.361432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:58.361432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:58.361432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:58.361432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:58.361432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:58.361432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:58.361432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:58.361432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:58.361432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:58.361432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:58.362559 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:58.362559 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:58.362559 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:58.362559 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:58.362559 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:58.362559 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:58.362559 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:58.362559 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:58.362559 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:58.362559 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:58.362559 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:58.362559 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:58.362559 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:58.362559 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:58.362559 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:58.362559 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:58.362559 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:58.363489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:58.363489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:58.363489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:58.363489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:58.363489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 513/1028] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:10:58.368031 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a7965-d658-4ccb-8df8-3cd94eb9538d None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:58.403321 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:58.458623 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1b196-b469-486e-9f49-8c67d7ff3a05 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:58.464648 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:58.492637 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e7a89-ae4f-4620-b7ad-1e94457871a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:58.492840 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a7965-d658-4ccb-8df8-3cd94eb9538d None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:58.493305 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e7a89-ae4f-4620-b7ad-1e94457871a4 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:58.493586 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e7a89-ae4f-4620-b7ad-1e94457871a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:58.493999 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e7a89-ae4f-4620-b7ad-1e94457871a4 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:58.494634 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e7a89-ae4f-4620-b7ad-1e94457871a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:58.496065 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e7a89-ae4f-4620-b7ad-1e94457871a4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:58.518585 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 516/1029] 10.222.0.57 () {60 vars in 1132 bytes} [Sat Jun 4 08:10:58 2022] POST /identity/v3/users => generated 285 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:10:58.538777 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7b07d-e514-47fd-aef0-65ca080f4fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:58.539466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7b07d-e514-47fd-aef0-65ca080f4fcf None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:58.539751 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7b07d-e514-47fd-aef0-65ca080f4fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:58.540025 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7b07d-e514-47fd-aef0-65ca080f4fcf None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:58.540762 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7b07d-e514-47fd-aef0-65ca080f4fcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:58.541068 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7b07d-e514-47fd-aef0-65ca080f4fcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:58.542608 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7b07d-e514-47fd-aef0-65ca080f4fcf None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:58.556747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 514/1030] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:58.562233 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e7a89-ae4f-4620-b7ad-1e94457871a4 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:58.669351 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:58.674091 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e7a89-ae4f-4620-b7ad-1e94457871a4 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:58.713052 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768f58d-6691-48b6-9836-0a905f6cd381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:58.713877 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768f58d-6691-48b6-9836-0a905f6cd381 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:58.714166 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768f58d-6691-48b6-9836-0a905f6cd381 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:58.714445 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768f58d-6691-48b6-9836-0a905f6cd381 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:58.724908 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768f58d-6691-48b6-9836-0a905f6cd381 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:58.727842 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768f58d-6691-48b6-9836-0a905f6cd381 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:58.748537 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-f768f58d-6691-48b6-9836-0a905f6cd381 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 08:10:58.748537 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:58.748537 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:58.748537 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:58.748537 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:58.748537 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:58.748537 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:58.748537 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:58.748537 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:58.748537 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:58.748537 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:58.748537 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:58.748537 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:10:58.748537 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:10:58.748537 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:10:58.748537 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:10:58.749581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:58.749581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:58.749581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:10:58.749581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:58.749581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:10:58.749581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:10:58.749581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:58.749581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:58.749581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:58.749581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:58.749581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:58.749581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:58.749581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:58.749581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:58.749581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:58.749581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:58.749581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:58.749581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:58.750758 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:58.750758 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:58.750758 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:10:58.750758 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:10:58.750758 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:10:58.750758 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:10:58.750758 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:10:58.750758 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:10:58.750758 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 08:10:58.750758 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:58.750758 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 517/1031] 10.222.0.57 () {56 vars in 1093 bytes} [Sat Jun 4 08:10:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:58.755916 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7b07d-e514-47fd-aef0-65ca080f4fcf None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:58.863259 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7b07d-e514-47fd-aef0-65ca080f4fcf None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:58.896755 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc761eb-e03b-41fe-ac88-22d2de2becc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:58.897426 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc761eb-e03b-41fe-ac88-22d2de2becc9 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:58.897708 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc761eb-e03b-41fe-ac88-22d2de2becc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:58.898170 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc761eb-e03b-41fe-ac88-22d2de2becc9 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:58.899013 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc761eb-e03b-41fe-ac88-22d2de2becc9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:58.899314 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc761eb-e03b-41fe-ac88-22d2de2becc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:58.900732 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc761eb-e03b-41fe-ac88-22d2de2becc9 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:58.903328 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:58.928274 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 515/1032] 10.222.0.57 () {56 vars in 1133 bytes} [Sat Jun 4 08:10:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:10:58.934337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768f58d-6691-48b6-9836-0a905f6cd381 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:59.050873 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768f58d-6691-48b6-9836-0a905f6cd381 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:59.070005 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faeb5e7-a28b-418e-8ab6-cb43151df37e None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:59.070317 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faeb5e7-a28b-418e-8ab6-cb43151df37e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:59.070571 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faeb5e7-a28b-418e-8ab6-cb43151df37e None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:59.072068 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 516/1033] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:10:59.076808 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ca27d-9a80-473d-a81c-c4d533e8a909 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:59.077101 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ca27d-9a80-473d-a81c-c4d533e8a909 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:59.077386 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ca27d-9a80-473d-a81c-c4d533e8a909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:59.085481 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2b5ce-a451-459a-97e8-9845a983357e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:59.086230 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2b5ce-a451-459a-97e8-9845a983357e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:59.086510 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2b5ce-a451-459a-97e8-9845a983357e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:59.086781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2b5ce-a451-459a-97e8-9845a983357e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:59.095160 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-666ca27d-9a80-473d-a81c-c4d533e8a909 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:10:59.096378 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-666ca27d-9a80-473d-a81c-c4d533e8a909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:10:59.116591 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:59.163748 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd2b5ce-a451-459a-97e8-9845a983357e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:59.165230 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd2b5ce-a451-459a-97e8-9845a983357e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:59.170819 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 517/1034] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:10:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 08:10:59.193532 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ca27d-9a80-473d-a81c-c4d533e8a909 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:59.280766 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 518/1035] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:10:58 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 04 08:10:59.288245 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2b5ce-a451-459a-97e8-9845a983357e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:59.303950 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ca27d-9a80-473d-a81c-c4d533e8a909 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:59.336101 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:59.351791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514f308-bfff-4226-bfa3-9e5771c4352c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:59.352584 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514f308-bfff-4226-bfa3-9e5771c4352c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:59.352867 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514f308-bfff-4226-bfa3-9e5771c4352c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:59.353141 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514f308-bfff-4226-bfa3-9e5771c4352c None admin] PATH_INFO: `/v3/services/image` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:59.353792 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d514f308-bfff-4226-bfa3-9e5771c4352c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:59.355208 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d514f308-bfff-4226-bfa3-9e5771c4352c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:59.358845 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:59.369997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-d514f308-bfff-4226-bfa3-9e5771c4352c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 08:10:59.369997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:59.369997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 08:10:59.369997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 08:10:59.369997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 08:10:59.369997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 08:10:59.369997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 08:10:59.369997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:59.369997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 08:10:59.369997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:59.369997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 08:10:59.369997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:59.369997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:59.369997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:59.369997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:59.369997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:59.369997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:59.370985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:59.370985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:59.370985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:59.370985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:59.370985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:59.370985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:59.370985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 08:10:59.370985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 08:10:59.370985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 08:10:59.370985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 08:10:59.370985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:59.370985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:59.370985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:59.370985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:59.370985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:59.370985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:59.371849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:59.371849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:59.371849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:59.371849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:59.371849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:59.371849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:59.371849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:59.371849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:59.371849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:59.371849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:59.371849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 08:10:59.371849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:10:59.371849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 08:10:59.371849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:10:59.371849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 518/1036] 10.222.0.57 () {56 vars in 1105 bytes} [Sat Jun 4 08:10:59 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:10:59.377175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514f308-bfff-4226-bfa3-9e5771c4352c None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:59.404946 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2b5ce-a451-459a-97e8-9845a983357e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:59.441300 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb11b7a-420c-4b7d-af6a-dd1257628ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:59.442123 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb11b7a-420c-4b7d-af6a-dd1257628ccb None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:59.442402 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb11b7a-420c-4b7d-af6a-dd1257628ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:59.442687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb11b7a-420c-4b7d-af6a-dd1257628ccb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:59.453179 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb11b7a-420c-4b7d-af6a-dd1257628ccb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:59.454681 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb11b7a-420c-4b7d-af6a-dd1257628ccb None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:59.472233 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-bdb11b7a-420c-4b7d-af6a-dd1257628ccb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:59.472233 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:59.472233 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:59.472233 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:59.472233 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:59.472233 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:59.472233 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:59.472233 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:59.472233 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:59.472233 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:59.472233 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:59.472233 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:59.472233 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:10:59.472233 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:10:59.472233 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:10:59.473322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:10:59.473322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:59.473322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:59.473322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:59.473322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:59.473322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:59.473322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:59.473322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:59.473322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:59.473322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:59.473322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:59.473322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:59.473322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:59.473322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:59.473322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:59.473322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:59.473322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:59.474370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:10:59.474370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:10:59.474370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:10:59.474370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:59.474370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 519/1037] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:10:59.478984 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb11b7a-420c-4b7d-af6a-dd1257628ccb None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:59.490151 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514f308-bfff-4226-bfa3-9e5771c4352c None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:59.523212 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bbe92f-1509-4080-9088-829860a47b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:59.523870 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbe92f-1509-4080-9088-829860a47b80 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:59.524154 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbe92f-1509-4080-9088-829860a47b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:59.524428 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbe92f-1509-4080-9088-829860a47b80 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:59.525124 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bbe92f-1509-4080-9088-829860a47b80 None admin] RBAC: Adding query filter params (name=image) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:59.525428 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bbe92f-1509-4080-9088-829860a47b80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:59.526818 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bbe92f-1509-4080-9088-829860a47b80 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:59.531746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 519/1038] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:59.537746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bbe92f-1509-4080-9088-829860a47b80 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:59.583250 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb11b7a-420c-4b7d-af6a-dd1257628ccb None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:59.593493 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:59.597309 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:59.620115 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0442bb-2e99-4c89-b632-4b8d22b3c192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:59.620716 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0442bb-2e99-4c89-b632-4b8d22b3c192 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:59.621000 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0442bb-2e99-4c89-b632-4b8d22b3c192 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:59.621281 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0442bb-2e99-4c89-b632-4b8d22b3c192 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:59.622028 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0442bb-2e99-4c89-b632-4b8d22b3c192 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:59.622337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0442bb-2e99-4c89-b632-4b8d22b3c192 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:59.623707 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0442bb-2e99-4c89-b632-4b8d22b3c192 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:59.639496 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 520/1039] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:59.640631 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0442bb-2e99-4c89-b632-4b8d22b3c192 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:59.643900 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bbe92f-1509-4080-9088-829860a47b80 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:59.679996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab973e1c-e379-492a-bb4c-10c8875165db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:59.680662 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab973e1c-e379-492a-bb4c-10c8875165db None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:59.680972 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab973e1c-e379-492a-bb4c-10c8875165db None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:59.681222 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab973e1c-e379-492a-bb4c-10c8875165db None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:59.681952 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab973e1c-e379-492a-bb4c-10c8875165db None admin] RBAC: Adding query filter params (type=image) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:59.682260 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab973e1c-e379-492a-bb4c-10c8875165db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:59.683629 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab973e1c-e379-492a-bb4c-10c8875165db None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:59.688668 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 520/1040] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:10:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:59.694227 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab973e1c-e379-492a-bb4c-10c8875165db None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:59.749884 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0442bb-2e99-4c89-b632-4b8d22b3c192 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:59.785754 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ccb78-541d-4cbc-8070-5cf6fe5141c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:59.786575 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ccb78-541d-4cbc-8070-5cf6fe5141c9 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:59.786857 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ccb78-541d-4cbc-8070-5cf6fe5141c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:59.787130 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ccb78-541d-4cbc-8070-5cf6fe5141c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:59.793993 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ccb78-541d-4cbc-8070-5cf6fe5141c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:59.795435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ccb78-541d-4cbc-8070-5cf6fe5141c9 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:59.804546 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab973e1c-e379-492a-bb4c-10c8875165db None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:59.810867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-b55ccb78-541d-4cbc-8070-5cf6fe5141c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:59.810867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:10:59.810867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:10:59.810867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:10:59.810867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:10:59.810867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:10:59.810867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:10:59.810867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:10:59.810867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:10:59.810867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:10:59.810867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:10:59.810867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:10:59.810867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:10:59.810867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:10:59.810867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:10:59.811833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:10:59.811833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:10:59.811833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:10:59.811833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:10:59.811833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:10:59.811833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:10:59.811833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:10:59.811833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:10:59.811833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:10:59.811833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:10:59.811833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:10:59.811833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:10:59.811833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:10:59.811833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:10:59.811833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:10:59.811833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:10:59.811833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:10:59.812776 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:10:59.812776 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:10:59.812776 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:10:59.812776 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:10:59.812776 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:10:59.812776 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:10:59.812776 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:10:59.812776 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:10:59.812776 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 521/1041] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:10:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:10:59.818149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ccb78-541d-4cbc-8070-5cf6fe5141c9 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:59.824128 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:59.845742 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c342f-04c5-459f-9145-0894d0eeb561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:59.846438 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c342f-04c5-459f-9145-0894d0eeb561 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:59.846720 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c342f-04c5-459f-9145-0894d0eeb561 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:59.846996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c342f-04c5-459f-9145-0894d0eeb561 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:59.847787 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c342f-04c5-459f-9145-0894d0eeb561 None admin] RBAC: Adding query filter params (interface=public, service_id=97a3c4e796b947a78964c4a980a5f8ef, region_id=RegionOne) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:59.848335 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c342f-04c5-459f-9145-0894d0eeb561 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:59.849485 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c342f-04c5-459f-9145-0894d0eeb561 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:59.851223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:10:59.856325 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 521/1042] 10.222.0.57 () {56 vars in 1251 bytes} [Sat Jun 4 08:10:59 2022] GET /identity/v3/endpoints?service_id=97a3c4e796b947a78964c4a980a5f8ef&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:59.862091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c342f-04c5-459f-9145-0894d0eeb561 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:10:59.933046 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ccb78-541d-4cbc-8070-5cf6fe5141c9 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:59.969086 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdace6-2506-4212-b75f-d81053ebbb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:10:59.970632 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdace6-2506-4212-b75f-d81053ebbb92 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:10:59.970917 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdace6-2506-4212-b75f-d81053ebbb92 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:10:59.971193 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdace6-2506-4212-b75f-d81053ebbb92 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:10:59.971973 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdace6-2506-4212-b75f-d81053ebbb92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:10:59.972283 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdace6-2506-4212-b75f-d81053ebbb92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:10:59.972635 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c342f-04c5-459f-9145-0894d0eeb561 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:10:59.973747 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdace6-2506-4212-b75f-d81053ebbb92 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:10:59.985586 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 522/1043] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:10:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:10:59.991386 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdace6-2506-4212-b75f-d81053ebbb92 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:00.007165 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7f163-f122-4268-aba0-bb6ffce88b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:00.007829 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7f163-f122-4268-aba0-bb6ffce88b6d None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:00.008107 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7f163-f122-4268-aba0-bb6ffce88b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:00.008384 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7f163-f122-4268-aba0-bb6ffce88b6d None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:00.009069 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd7f163-f122-4268-aba0-bb6ffce88b6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:00.010734 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd7f163-f122-4268-aba0-bb6ffce88b6d None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:00.018136 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 522/1044] 10.222.0.57 () {56 vars in 1087 bytes} [Sat Jun 4 08:10:59 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:11:00.089025 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:00.100384 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdace6-2506-4212-b75f-d81053ebbb92 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:00.137000 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099246e-f3ec-4859-81e4-7c17a650708c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:00.137676 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099246e-f3ec-4859-81e4-7c17a650708c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:00.138009 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099246e-f3ec-4859-81e4-7c17a650708c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:00.138287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099246e-f3ec-4859-81e4-7c17a650708c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:00.139132 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4099246e-f3ec-4859-81e4-7c17a650708c None admin] RBAC: Adding query filter params (role.id=725918a0815f44dca0cc6586938c7b2f, scope.project.id=634c9a1745ef44c0ad66e02493d79af0, user.id=7e64d002241242928936dd0d991ecdc1) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:00.139445 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4099246e-f3ec-4859-81e4-7c17a650708c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:00.140906 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4099246e-f3ec-4859-81e4-7c17a650708c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:00.147878 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 523/1045] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:10:59 2022] GET /identity/v3/role_assignments?user.id=7e64d002241242928936dd0d991ecdc1&scope.project.id=634c9a1745ef44c0ad66e02493d79af0&role.id=725918a0815f44dca0cc6586938c7b2f => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:11:00.847288 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183fd72-4aff-4f6f-9af2-d65a99ffb67c None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:00.847817 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183fd72-4aff-4f6f-9af2-d65a99ffb67c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:00.847817 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183fd72-4aff-4f6f-9af2-d65a99ffb67c None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:00.849223 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 523/1046] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:11:00.854600 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70f9a7-8c1b-458a-b95c-b8500958caca None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:00.855045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70f9a7-8c1b-458a-b95c-b8500958caca None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:00.855190 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70f9a7-8c1b-458a-b95c-b8500958caca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:00.871976 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-ab70f9a7-8c1b-458a-b95c-b8500958caca None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:11:00.873160 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ab70f9a7-8c1b-458a-b95c-b8500958caca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:11:00.947795 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 524/1047] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:11:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:11:00.970836 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183fd72-4aff-4f6f-9af2-d65a99ffb67c None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:01.019383 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:01.075647 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183fd72-4aff-4f6f-9af2-d65a99ffb67c None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:01.109286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa2fca-1e7f-4194-af66-7aa9dc55f910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:01.110029 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa2fca-1e7f-4194-af66-7aa9dc55f910 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:01.110337 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa2fca-1e7f-4194-af66-7aa9dc55f910 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:01.110609 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa2fca-1e7f-4194-af66-7aa9dc55f910 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:01.120740 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa2fca-1e7f-4194-af66-7aa9dc55f910 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:11:01.129551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-a2fa2fca-1e7f-4194-af66-7aa9dc55f910 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:11:01.129551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:11:01.129551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:11:01.129551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:11:01.129551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:11:01.129551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:11:01.129551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:11:01.129551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:11:01.129551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:11:01.129551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:11:01.129551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:11:01.129551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:11:01.129551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:11:01.129551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:11:01.129551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:11:01.129551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:11:01.130687 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:11:01.130687 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:11:01.130687 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:11:01.130687 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:11:01.130687 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:11:01.130687 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:11:01.130687 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:11:01.130687 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:11:01.130687 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:11:01.130687 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:11:01.130687 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:11:01.130687 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:11:01.130687 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:11:01.130687 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:11:01.130687 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:11:01.130687 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:11:01.131558 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:11:01.131558 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:11:01.131558 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:11:01.131558 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:11:01.131558 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:11:01.131558 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:11:01.131558 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:11:01.131558 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:11:01.131558 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:11:01.131558 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:11:01.131558 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:11:01.131558 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:11:01.132875 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 524/1048] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:11:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:11:01.136685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab70f9a7-8c1b-458a-b95c-b8500958caca None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:01.225789 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:01.242810 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab70f9a7-8c1b-458a-b95c-b8500958caca None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:01.279699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77925e28-a49a-4ec5-8167-43bafd487b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:01.280375 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77925e28-a49a-4ec5-8167-43bafd487b4a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:01.280657 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77925e28-a49a-4ec5-8167-43bafd487b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:01.280932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77925e28-a49a-4ec5-8167-43bafd487b4a None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:01.281675 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77925e28-a49a-4ec5-8167-43bafd487b4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:01.282035 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77925e28-a49a-4ec5-8167-43bafd487b4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:01.283407 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77925e28-a49a-4ec5-8167-43bafd487b4a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:01.296205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 525/1049] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:11:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:11:01.297418 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa2fca-1e7f-4194-af66-7aa9dc55f910 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:01.403540 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa2fca-1e7f-4194-af66-7aa9dc55f910 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:01.406634 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:01.441250 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc65e9-8dc1-462c-828a-a20a6673821c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:01.442147 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc65e9-8dc1-462c-828a-a20a6673821c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:01.442431 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc65e9-8dc1-462c-828a-a20a6673821c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:01.442716 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc65e9-8dc1-462c-828a-a20a6673821c None admin] PATH_INFO: `/v3/users/646dd7c8174a4084947e962288fb491b` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:01.455946 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc65e9-8dc1-462c-828a-a20a6673821c None admin] RBAC: Authorizing `identity:get_user(user_id=646dd7c8174a4084947e962288fb491b)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:01.457681 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc65e9-8dc1-462c-828a-a20a6673821c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:01.459538 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 525/1050] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:11:01 2022] GET /identity/v3/users/646dd7c8174a4084947e962288fb491b => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:11:01.465023 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77925e28-a49a-4ec5-8167-43bafd487b4a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:01.564104 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77925e28-a49a-4ec5-8167-43bafd487b4a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:01.596834 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cae75-908c-4d58-a560-8dce6bd2426f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:01.597478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cae75-908c-4d58-a560-8dce6bd2426f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:01.597762 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cae75-908c-4d58-a560-8dce6bd2426f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:01.598065 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cae75-908c-4d58-a560-8dce6bd2426f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:01.616012 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:01.667451 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901cae75-908c-4d58-a560-8dce6bd2426f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:01.668814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901cae75-908c-4d58-a560-8dce6bd2426f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:01.773321 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 526/1051] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:11:01 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 08:11:01.774551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc65e9-8dc1-462c-828a-a20a6673821c None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:01.874277 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc65e9-8dc1-462c-828a-a20a6673821c None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:01.909138 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e850c-d253-4e26-bdc9-b928b4db02e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:01.913291 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e850c-d253-4e26-bdc9-b928b4db02e1 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:01.913291 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e850c-d253-4e26-bdc9-b928b4db02e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:01.913291 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e850c-d253-4e26-bdc9-b928b4db02e1 None admin] PATH_INFO: `/v3/projects/175b9b4ab6024c8fbe6dc9b2b9e261a6` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:01.916934 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e850c-d253-4e26-bdc9-b928b4db02e1 None admin] RBAC: Authorizing `identity:get_project(project_id=175b9b4ab6024c8fbe6dc9b2b9e261a6)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:01.923986 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e850c-d253-4e26-bdc9-b928b4db02e1 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:01.923986 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 526/1052] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:11:01 2022] GET /identity/v3/projects/175b9b4ab6024c8fbe6dc9b2b9e261a6 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:11:01.925240 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cae75-908c-4d58-a560-8dce6bd2426f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:01.979483 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:02.031495 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cae75-908c-4d58-a560-8dce6bd2426f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:02.068465 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce5aa7-7713-4a62-98ad-670adbe822ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:02.069142 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce5aa7-7713-4a62-98ad-670adbe822ae None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:02.069422 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce5aa7-7713-4a62-98ad-670adbe822ae None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:02.069694 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce5aa7-7713-4a62-98ad-670adbe822ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:02.070575 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce5aa7-7713-4a62-98ad-670adbe822ae None admin] RBAC: Adding query filter params (role.id=431cef539cfb476aad50d2470e763b5f, scope.project.id=175b9b4ab6024c8fbe6dc9b2b9e261a6, user.id=646dd7c8174a4084947e962288fb491b) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:02.070888 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce5aa7-7713-4a62-98ad-670adbe822ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:02.072357 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce5aa7-7713-4a62-98ad-670adbe822ae None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:02.085905 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 527/1053] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:11:01 2022] GET /identity/v3/role_assignments?user.id=646dd7c8174a4084947e962288fb491b&scope.project.id=175b9b4ab6024c8fbe6dc9b2b9e261a6&role.id=431cef539cfb476aad50d2470e763b5f => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:02.280716 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e6462-5f4b-4725-96f6-c0fd23f92f5d None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:02.281013 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e6462-5f4b-4725-96f6-c0fd23f92f5d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:02.281264 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e6462-5f4b-4725-96f6-c0fd23f92f5d None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:02.282829 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 527/1054] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:11:02.288005 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee46a51-e0e1-4d02-a758-abbcc0b1dbd7 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:02.288296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee46a51-e0e1-4d02-a758-abbcc0b1dbd7 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:02.288566 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee46a51-e0e1-4d02-a758-abbcc0b1dbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:02.305739 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-3ee46a51-e0e1-4d02-a758-abbcc0b1dbd7 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:11:02.306939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3ee46a51-e0e1-4d02-a758-abbcc0b1dbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:11:02.376376 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 528/1055] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:11:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:11:02.399644 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e6462-5f4b-4725-96f6-c0fd23f92f5d None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:02.415023 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8155bbc-fd10-4bcd-a3dc-554abad3ee3c None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:02.415328 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8155bbc-fd10-4bcd-a3dc-554abad3ee3c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:02.415584 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8155bbc-fd10-4bcd-a3dc-554abad3ee3c None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:02.417000 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 529/1056] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:11:02.421848 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd998abc-40f7-4e12-9e94-a4ad4a809339 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:02.422162 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd998abc-40f7-4e12-9e94-a4ad4a809339 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:02.422438 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd998abc-40f7-4e12-9e94-a4ad4a809339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:02.437187 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:02.441140 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-bd998abc-40f7-4e12-9e94-a4ad4a809339 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:11:02.442365 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-bd998abc-40f7-4e12-9e94-a4ad4a809339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:11:02.487485 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:02.512868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e6462-5f4b-4725-96f6-c0fd23f92f5d None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:02.520892 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 530/1057] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:11:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 08:11:02.543375 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd998abc-40f7-4e12-9e94-a4ad4a809339 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:02.551725 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63985cf7-2efb-45fe-964a-4d0a826e7fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:02.552519 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63985cf7-2efb-45fe-964a-4d0a826e7fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:02.552802 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63985cf7-2efb-45fe-964a-4d0a826e7fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:02.553077 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63985cf7-2efb-45fe-964a-4d0a826e7fd8 None admin] PATH_INFO: `/v3/services/image` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:02.554023 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63985cf7-2efb-45fe-964a-4d0a826e7fd8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:02.555429 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63985cf7-2efb-45fe-964a-4d0a826e7fd8 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:02.567336 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-63985cf7-2efb-45fe-964a-4d0a826e7fd8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 08:11:02.567336 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:11:02.567336 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 08:11:02.567336 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 08:11:02.567336 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 08:11:02.567336 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 08:11:02.567336 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 08:11:02.567336 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:11:02.567336 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 08:11:02.567336 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:11:02.567336 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 08:11:02.567336 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:11:02.567336 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:11:02.567336 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:11:02.567336 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:11:02.567336 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:11:02.567336 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:11:02.568369 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:11:02.568369 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:11:02.568369 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:11:02.568369 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:11:02.568369 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:11:02.568369 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:11:02.568369 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 08:11:02.568369 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 08:11:02.568369 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 08:11:02.568369 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 08:11:02.568369 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:11:02.568369 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:11:02.568369 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:11:02.568369 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:11:02.568369 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:11:02.568369 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:11:02.569385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:11:02.569385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:11:02.569385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:11:02.569385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:11:02.569385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:11:02.569385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:11:02.569385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:11:02.569385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:11:02.569385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:11:02.569385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:11:02.569385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 08:11:02.569385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:11:02.569385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 08:11:02.569385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:11:02.569385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 528/1058] 10.222.0.57 () {56 vars in 1105 bytes} [Sat Jun 4 08:11:02 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:11:02.574515 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63985cf7-2efb-45fe-964a-4d0a826e7fd8 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:02.649238 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd998abc-40f7-4e12-9e94-a4ad4a809339 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:02.669229 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:02.677497 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63985cf7-2efb-45fe-964a-4d0a826e7fd8 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:02.686198 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b002935-2062-45e8-954f-06a0aee29eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:02.687014 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b002935-2062-45e8-954f-06a0aee29eaa None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:02.687299 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b002935-2062-45e8-954f-06a0aee29eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:02.687576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b002935-2062-45e8-954f-06a0aee29eaa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:02.698673 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b002935-2062-45e8-954f-06a0aee29eaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:11:02.707014 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-4b002935-2062-45e8-954f-06a0aee29eaa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 08:11:02.707014 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:11:02.707014 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:11:02.707014 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:11:02.707014 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:11:02.707014 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:11:02.707014 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:11:02.707014 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:11:02.707014 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:11:02.707014 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:11:02.707014 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:11:02.707014 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:11:02.707014 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:11:02.707014 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:11:02.707014 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:11:02.707014 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:11:02.707987 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:11:02.707987 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:11:02.707987 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:11:02.707987 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:11:02.707987 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:11:02.707987 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:11:02.707987 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:11:02.707987 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:11:02.707987 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:11:02.707987 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:11:02.707987 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:11:02.707987 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:11:02.707987 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:11:02.707987 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:11:02.707987 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:11:02.707987 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:11:02.708852 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:11:02.708852 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:11:02.708852 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:11:02.708852 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:11:02.708852 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:11:02.708852 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:11:02.708852 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:11:02.708852 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:11:02.708852 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:11:02.708852 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:11:02.708852 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 08:11:02.708852 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:11:02.708852 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 531/1059] 10.222.0.57 () {56 vars in 1120 bytes} [Sat Jun 4 08:11:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:11:02.714056 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b002935-2062-45e8-954f-06a0aee29eaa None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:02.715683 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a85e49-69b0-4b81-bb5b-190271dbe8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:02.716349 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a85e49-69b0-4b81-bb5b-190271dbe8c7 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:02.716635 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a85e49-69b0-4b81-bb5b-190271dbe8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:02.716902 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a85e49-69b0-4b81-bb5b-190271dbe8c7 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:02.717593 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a85e49-69b0-4b81-bb5b-190271dbe8c7 None admin] RBAC: Adding query filter params (name=image) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:02.717923 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a85e49-69b0-4b81-bb5b-190271dbe8c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:02.720132 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a85e49-69b0-4b81-bb5b-190271dbe8c7 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:02.725330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 529/1060] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:11:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:11:02.734093 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a85e49-69b0-4b81-bb5b-190271dbe8c7 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:02.760239 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:02.834543 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b002935-2062-45e8-954f-06a0aee29eaa None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:02.840832 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a85e49-69b0-4b81-bb5b-190271dbe8c7 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:02.869907 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a2626-093a-40a1-8069-d2eae0959ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:02.870586 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a2626-093a-40a1-8069-d2eae0959ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:02.870871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a2626-093a-40a1-8069-d2eae0959ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:02.871151 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a2626-093a-40a1-8069-d2eae0959ef1 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:02.871891 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a2626-093a-40a1-8069-d2eae0959ef1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:02.872203 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a2626-093a-40a1-8069-d2eae0959ef1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:02.873577 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a2626-093a-40a1-8069-d2eae0959ef1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:02.879285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6708e3c-3248-4e6a-b512-63e8f9aac99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:02.880518 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6708e3c-3248-4e6a-b512-63e8f9aac99c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:02.880990 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6708e3c-3248-4e6a-b512-63e8f9aac99c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:02.881442 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6708e3c-3248-4e6a-b512-63e8f9aac99c None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:02.882127 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 532/1061] 10.222.0.57 () {56 vars in 1115 bytes} [Sat Jun 4 08:11:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:11:02.882559 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6708e3c-3248-4e6a-b512-63e8f9aac99c None admin] RBAC: Adding query filter params (type=image) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:02.882879 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6708e3c-3248-4e6a-b512-63e8f9aac99c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:02.884263 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6708e3c-3248-4e6a-b512-63e8f9aac99c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:02.887726 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a2626-093a-40a1-8069-d2eae0959ef1 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:02.896060 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 530/1062] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:11:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:11:02.898368 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6708e3c-3248-4e6a-b512-63e8f9aac99c None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:02.928016 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:02.992395 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:03.000520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a2626-093a-40a1-8069-d2eae0959ef1 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:03.010056 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6708e3c-3248-4e6a-b512-63e8f9aac99c None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:03.040590 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06eca48-6d61-4431-bae1-6405491860fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:03.041393 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06eca48-6d61-4431-bae1-6405491860fd None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:03.041676 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06eca48-6d61-4431-bae1-6405491860fd None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:03.041996 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06eca48-6d61-4431-bae1-6405491860fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:03.048763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940755d-9433-4ad5-87fb-eb74937da076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:03.049649 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940755d-9433-4ad5-87fb-eb74937da076 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:03.050116 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940755d-9433-4ad5-87fb-eb74937da076 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:03.050624 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940755d-9433-4ad5-87fb-eb74937da076 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:03.051495 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940755d-9433-4ad5-87fb-eb74937da076 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:03.052608 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06eca48-6d61-4431-bae1-6405491860fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:03.053192 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940755d-9433-4ad5-87fb-eb74937da076 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:03.054359 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06eca48-6d61-4431-bae1-6405491860fd None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:03.071165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-e06eca48-6d61-4431-bae1-6405491860fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:11:03.071165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:11:03.071165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:11:03.071165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:11:03.071165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:11:03.071165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:11:03.071165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:11:03.071165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:11:03.071165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:11:03.071165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:11:03.071165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:11:03.071165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:11:03.071165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:11:03.071165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:11:03.071165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:11:03.072275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:11:03.072275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:11:03.072275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:11:03.072275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:11:03.072275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:11:03.072275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:11:03.072275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:11:03.072275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:11:03.072275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:11:03.072275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:11:03.072275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:11:03.072275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:11:03.072275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:11:03.072275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:11:03.072275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:11:03.072275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:11:03.072275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:11:03.073209 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:11:03.073209 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:11:03.073209 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:11:03.073209 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:11:03.073209 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 533/1063] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:11:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:11:03.077976 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06eca48-6d61-4431-bae1-6405491860fd None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:03.080199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 531/1064] 10.222.0.57 () {60 vars in 1144 bytes} [Sat Jun 4 08:11:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:11:03.199212 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06eca48-6d61-4431-bae1-6405491860fd None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:03.242858 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff02eca-c390-4e35-8d17-94f67b450e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:03.243530 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff02eca-c390-4e35-8d17-94f67b450e16 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:03.243811 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff02eca-c390-4e35-8d17-94f67b450e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:03.244085 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff02eca-c390-4e35-8d17-94f67b450e16 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:03.244809 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff02eca-c390-4e35-8d17-94f67b450e16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:03.245112 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff02eca-c390-4e35-8d17-94f67b450e16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:03.246528 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff02eca-c390-4e35-8d17-94f67b450e16 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:03.259549 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 534/1065] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:03.265217 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940755d-9433-4ad5-87fb-eb74937da076 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:03.353623 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:03.381990 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940755d-9433-4ad5-87fb-eb74937da076 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:03.418061 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7079a-b765-4f08-9eb6-c5d6eaf2310c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:03.418859 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7079a-b765-4f08-9eb6-c5d6eaf2310c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:03.419143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7079a-b765-4f08-9eb6-c5d6eaf2310c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:03.419421 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7079a-b765-4f08-9eb6-c5d6eaf2310c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:03.427680 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7079a-b765-4f08-9eb6-c5d6eaf2310c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:03.429377 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7079a-b765-4f08-9eb6-c5d6eaf2310c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:03.443293 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-07c7079a-b765-4f08-9eb6-c5d6eaf2310c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 08:11:03.443293 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:11:03.443293 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:11:03.443293 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:11:03.443293 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:11:03.443293 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:11:03.443293 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:11:03.443293 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:11:03.443293 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:11:03.443293 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:11:03.443293 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:11:03.443293 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:11:03.443293 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:11:03.443293 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:11:03.443293 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:11:03.443293 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:11:03.444254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:11:03.444254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:11:03.444254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:11:03.444254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:11:03.444254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:11:03.444254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:11:03.444254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:11:03.444254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:11:03.444254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:11:03.444254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:11:03.444254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:11:03.444254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:11:03.444254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:11:03.444254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:11:03.444254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:11:03.444254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:11:03.444254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:11:03.444254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:11:03.445234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:11:03.445234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:11:03.445234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:11:03.445234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:11:03.445234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:11:03.445234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:11:03.445234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:11:03.445234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:11:03.445234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 08:11:03.445234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:11:03.445234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 532/1066] 10.222.0.57 () {56 vars in 1093 bytes} [Sat Jun 4 08:11:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:11:03.450470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff02eca-c390-4e35-8d17-94f67b450e16 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:03.453297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:03.552082 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff02eca-c390-4e35-8d17-94f67b450e16 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:03.586376 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a86bb7-afef-421f-a3d0-d4c3ff170168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:03.587047 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a86bb7-afef-421f-a3d0-d4c3ff170168 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:03.587331 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a86bb7-afef-421f-a3d0-d4c3ff170168 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:03.587606 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a86bb7-afef-421f-a3d0-d4c3ff170168 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:03.588438 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a86bb7-afef-421f-a3d0-d4c3ff170168 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:03.588748 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a86bb7-afef-421f-a3d0-d4c3ff170168 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:03.590198 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a86bb7-afef-421f-a3d0-d4c3ff170168 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:03.612721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 535/1067] 10.222.0.57 () {56 vars in 1133 bytes} [Sat Jun 4 08:11:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:03.614013 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7079a-b765-4f08-9eb6-c5d6eaf2310c None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:03.720245 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7079a-b765-4f08-9eb6-c5d6eaf2310c None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:03.753549 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ca166-da68-40f1-af7b-1cb6f76206a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:03.754431 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ca166-da68-40f1-af7b-1cb6f76206a2 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:03.754716 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ca166-da68-40f1-af7b-1cb6f76206a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:03.754995 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ca166-da68-40f1-af7b-1cb6f76206a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:03.762885 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:03.768441 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ca166-da68-40f1-af7b-1cb6f76206a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:03.770421 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ca166-da68-40f1-af7b-1cb6f76206a2 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:03.789053 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-336ca166-da68-40f1-af7b-1cb6f76206a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:11:03.789053 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:11:03.789053 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:11:03.789053 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:11:03.789053 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:11:03.789053 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:11:03.789053 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:11:03.789053 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:11:03.789053 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:11:03.789053 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:11:03.789053 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:11:03.789053 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:11:03.789053 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:11:03.789053 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:11:03.789053 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:11:03.790047 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:11:03.790047 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:11:03.790047 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:11:03.790047 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:11:03.790047 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:11:03.790047 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:11:03.790047 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:11:03.790047 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:11:03.790047 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:11:03.790047 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:11:03.790047 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:11:03.790047 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:11:03.790047 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:11:03.790047 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:11:03.790047 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:11:03.790047 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:11:03.790047 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:11:03.790961 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:11:03.790961 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:11:03.790961 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:11:03.790961 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:11:03.791808 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 533/1068] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:11:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:11:03.796129 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a86bb7-afef-421f-a3d0-d4c3ff170168 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:03.857618 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:03.899732 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a86bb7-afef-421f-a3d0-d4c3ff170168 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:03.940461 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf898f4-3322-4fec-892e-62b7ae405783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:03.941493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf898f4-3322-4fec-892e-62b7ae405783 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:03.942021 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf898f4-3322-4fec-892e-62b7ae405783 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:03.942532 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf898f4-3322-4fec-892e-62b7ae405783 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:03.943453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf898f4-3322-4fec-892e-62b7ae405783 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:03.943977 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf898f4-3322-4fec-892e-62b7ae405783 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:03.945541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf898f4-3322-4fec-892e-62b7ae405783 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:03.962436 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 536/1069] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:11:03.964082 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ca166-da68-40f1-af7b-1cb6f76206a2 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:04.070614 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ca166-da68-40f1-af7b-1cb6f76206a2 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:04.103764 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afb7fd-d560-4d0a-a849-35f2ca65fe36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:04.104544 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afb7fd-d560-4d0a-a849-35f2ca65fe36 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:04.104822 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afb7fd-d560-4d0a-a849-35f2ca65fe36 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:04.105093 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afb7fd-d560-4d0a-a849-35f2ca65fe36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:04.111647 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afb7fd-d560-4d0a-a849-35f2ca65fe36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:04.113072 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afb7fd-d560-4d0a-a849-35f2ca65fe36 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:04.127306 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-46afb7fd-d560-4d0a-a849-35f2ca65fe36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:11:04.127306 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:11:04.127306 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:11:04.127306 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:11:04.127306 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:11:04.127306 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:11:04.127306 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:11:04.127306 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:11:04.127306 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:11:04.127306 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:11:04.127306 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:11:04.127306 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:11:04.127306 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:11:04.127306 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:11:04.127306 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:11:04.128224 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:11:04.128224 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:11:04.128224 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:11:04.128224 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:11:04.128224 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:11:04.128224 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:11:04.128224 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:11:04.128224 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:11:04.128224 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:11:04.128224 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:11:04.128224 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:11:04.128224 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:11:04.128224 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:11:04.128224 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:11:04.128224 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:11:04.128224 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:11:04.128224 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:11:04.129154 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:11:04.129154 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:11:04.129154 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:11:04.129154 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:11:04.129154 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:11:04.129154 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:11:04.129154 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:11:04.129154 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:11:04.129154 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 534/1070] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:11:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:11:04.135444 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf898f4-3322-4fec-892e-62b7ae405783 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:04.239111 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf898f4-3322-4fec-892e-62b7ae405783 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:04.259536 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:04.274406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450ea96-8492-41b5-a9aa-1680a2e11b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:04.275069 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450ea96-8492-41b5-a9aa-1680a2e11b03 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:04.275351 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450ea96-8492-41b5-a9aa-1680a2e11b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:04.275623 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450ea96-8492-41b5-a9aa-1680a2e11b03 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:04.276394 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a450ea96-8492-41b5-a9aa-1680a2e11b03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:04.276699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a450ea96-8492-41b5-a9aa-1680a2e11b03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:04.278157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a450ea96-8492-41b5-a9aa-1680a2e11b03 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:04.292119 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 537/1071] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:11:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:04.298363 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afb7fd-d560-4d0a-a849-35f2ca65fe36 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:04.320954 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e00b2-8863-4277-a5da-8502caff9567 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:04.321243 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e00b2-8863-4277-a5da-8502caff9567 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:04.321445 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e00b2-8863-4277-a5da-8502caff9567 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:04.323030 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 538/1072] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:11:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 08:11:04.331566 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1886b2-f2ff-4ad7-988a-d421f11201f8 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:04.331892 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1886b2-f2ff-4ad7-988a-d421f11201f8 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:04.332134 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1886b2-f2ff-4ad7-988a-d421f11201f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:04.350560 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6c1886b2-f2ff-4ad7-988a-d421f11201f8 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:11:04.351822 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6c1886b2-f2ff-4ad7-988a-d421f11201f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:11:04.354529 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:04.409857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afb7fd-d560-4d0a-a849-35f2ca65fe36 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:04.425862 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 539/1073] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:11:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:11:04.447043 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18de4d-928a-4128-909a-62cbaef4e66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:04.448079 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18de4d-928a-4128-909a-62cbaef4e66a None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:04.448365 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18de4d-928a-4128-909a-62cbaef4e66a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:04.448640 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18de4d-928a-4128-909a-62cbaef4e66a None admin] PATH_INFO: `/v3/projects/634c9a1745ef44c0ad66e02493d79af0/users/7e64d002241242928936dd0d991ecdc1/roles/725918a0815f44dca0cc6586938c7b2f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:04.448836 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1886b2-f2ff-4ad7-988a-d421f11201f8 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:04.450904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18de4d-928a-4128-909a-62cbaef4e66a None admin] RBAC: Authorizing `identity:create_grant(project_id=634c9a1745ef44c0ad66e02493d79af0, user_id=7e64d002241242928936dd0d991ecdc1, role_id=725918a0815f44dca0cc6586938c7b2f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:04.452344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18de4d-928a-4128-909a-62cbaef4e66a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:04.466058 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 535/1074] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jun 4 08:11:04 2022] PUT /identity/v3/projects/634c9a1745ef44c0ad66e02493d79af0/users/7e64d002241242928936dd0d991ecdc1/roles/725918a0815f44dca0cc6586938c7b2f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:11:04.560037 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1886b2-f2ff-4ad7-988a-d421f11201f8 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:04.571963 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:04.599301 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca1657-1cab-498b-bfa3-9bd3992321d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:04.600108 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca1657-1cab-498b-bfa3-9bd3992321d8 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:04.600390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca1657-1cab-498b-bfa3-9bd3992321d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:04.600665 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca1657-1cab-498b-bfa3-9bd3992321d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:04.611825 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca1657-1cab-498b-bfa3-9bd3992321d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:11:04.619680 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-78ca1657-1cab-498b-bfa3-9bd3992321d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:11:04.619680 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:11:04.619680 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:11:04.619680 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:11:04.619680 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:11:04.619680 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:11:04.619680 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:11:04.619680 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:11:04.619680 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:11:04.619680 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:11:04.619680 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:11:04.619680 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:11:04.619680 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:11:04.619680 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:11:04.619680 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:11:04.619680 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:11:04.620683 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:11:04.620683 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:11:04.620683 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:11:04.620683 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:11:04.620683 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:11:04.620683 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:11:04.620683 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:11:04.620683 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:11:04.620683 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:11:04.620683 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:11:04.620683 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:11:04.620683 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:11:04.620683 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:11:04.620683 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:11:04.620683 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:11:04.620683 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:11:04.622232 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:11:04.622232 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:11:04.622232 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:11:04.622232 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:11:04.622232 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:11:04.622232 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:11:04.622232 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:11:04.622232 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:11:04.622232 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:11:04.622232 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:11:04.622232 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:11:04.622232 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:11:04.622232 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 540/1075] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:11:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:11:04.627632 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18de4d-928a-4128-909a-62cbaef4e66a None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:04.741674 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18de4d-928a-4128-909a-62cbaef4e66a None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:04.753479 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:04.779768 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c005b-9333-4df6-9dc6-20a4f9c920ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:04.780436 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c005b-9333-4df6-9dc6-20a4f9c920ff None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:04.780715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c005b-9333-4df6-9dc6-20a4f9c920ff None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:04.780986 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c005b-9333-4df6-9dc6-20a4f9c920ff None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:04.781726 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c005b-9333-4df6-9dc6-20a4f9c920ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:04.782084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c005b-9333-4df6-9dc6-20a4f9c920ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:04.783571 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c005b-9333-4df6-9dc6-20a4f9c920ff None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:04.792500 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 536/1076] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:11:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:04.798848 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca1657-1cab-498b-bfa3-9bd3992321d8 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:04.902331 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca1657-1cab-498b-bfa3-9bd3992321d8 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:04.942852 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1d001-c7ae-48c4-995b-15225e3b6783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:04.943727 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1d001-c7ae-48c4-995b-15225e3b6783 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:04.944006 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1d001-c7ae-48c4-995b-15225e3b6783 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:04.944278 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1d001-c7ae-48c4-995b-15225e3b6783 None admin] PATH_INFO: `/v3/users/646dd7c8174a4084947e962288fb491b` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:04.945459 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb1d001-c7ae-48c4-995b-15225e3b6783 None admin] RBAC: Authorizing `identity:get_user(user_id=646dd7c8174a4084947e962288fb491b)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:04.946930 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb1d001-c7ae-48c4-995b-15225e3b6783 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:04.953144 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 541/1077] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:11:04 2022] GET /identity/v3/users/646dd7c8174a4084947e962288fb491b => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:04.955383 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c005b-9333-4df6-9dc6-20a4f9c920ff None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:05.064672 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c005b-9333-4df6-9dc6-20a4f9c920ff None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:05.099152 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ecdee-911f-4032-9019-9b7100ed2743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:05.100009 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ecdee-911f-4032-9019-9b7100ed2743 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:05.100283 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ecdee-911f-4032-9019-9b7100ed2743 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:05.100549 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ecdee-911f-4032-9019-9b7100ed2743 None admin] PATH_INFO: `/v3/projects/175b9b4ab6024c8fbe6dc9b2b9e261a6` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:05.101715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ecdee-911f-4032-9019-9b7100ed2743 None admin] RBAC: Authorizing `identity:get_project(project_id=175b9b4ab6024c8fbe6dc9b2b9e261a6)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:05.103241 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ecdee-911f-4032-9019-9b7100ed2743 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:05.109651 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 537/1078] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:11:04 2022] GET /identity/v3/projects/175b9b4ab6024c8fbe6dc9b2b9e261a6 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:11:05.111209 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1d001-c7ae-48c4-995b-15225e3b6783 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:05.151008 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:05.213316 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1d001-c7ae-48c4-995b-15225e3b6783 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:05.247038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5030c1-e5b0-4fda-8841-9da8326c1a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:05.247919 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5030c1-e5b0-4fda-8841-9da8326c1a47 None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:05.248197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5030c1-e5b0-4fda-8841-9da8326c1a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:05.248469 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5030c1-e5b0-4fda-8841-9da8326c1a47 None admin] PATH_INFO: `/v3/projects/175b9b4ab6024c8fbe6dc9b2b9e261a6/users/646dd7c8174a4084947e962288fb491b/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:05.250413 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5030c1-e5b0-4fda-8841-9da8326c1a47 None admin] RBAC: Authorizing `identity:create_grant(project_id=175b9b4ab6024c8fbe6dc9b2b9e261a6, user_id=646dd7c8174a4084947e962288fb491b, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:05.252467 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5030c1-e5b0-4fda-8841-9da8326c1a47 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:05.266937 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 542/1079] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jun 4 08:11:05 2022] PUT /identity/v3/projects/175b9b4ab6024c8fbe6dc9b2b9e261a6/users/646dd7c8174a4084947e962288fb491b/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:11:05.392550 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c6782-3e83-44cf-b7aa-934be20a2f44 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:05.392880 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c6782-3e83-44cf-b7aa-934be20a2f44 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:05.393112 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c6782-3e83-44cf-b7aa-934be20a2f44 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:05.394683 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 538/1080] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:11:05.400153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63360bba-be37-4e90-89ca-c811a6f77c85 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:05.400508 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63360bba-be37-4e90-89ca-c811a6f77c85 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:05.400713 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63360bba-be37-4e90-89ca-c811a6f77c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:05.418858 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-63360bba-be37-4e90-89ca-c811a6f77c85 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:11:05.420139 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-63360bba-be37-4e90-89ca-c811a6f77c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:11:05.494681 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 543/1081] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:11:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:11:05.516141 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c6782-3e83-44cf-b7aa-934be20a2f44 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:05.560239 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:05.621550 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c6782-3e83-44cf-b7aa-934be20a2f44 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:05.657579 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbba686-ef8b-49be-8b58-d8d86394b5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:05.658254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbba686-ef8b-49be-8b58-d8d86394b5df None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:05.658534 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbba686-ef8b-49be-8b58-d8d86394b5df None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:05.658802 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbba686-ef8b-49be-8b58-d8d86394b5df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:05.726794 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbba686-ef8b-49be-8b58-d8d86394b5df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:05.728236 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbba686-ef8b-49be-8b58-d8d86394b5df None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:05.769615 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:05.828584 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 539/1082] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:11:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 08:11:05.834452 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63360bba-be37-4e90-89ca-c811a6f77c85 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:05.861728 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:05.941881 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63360bba-be37-4e90-89ca-c811a6f77c85 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:05.974848 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30697d-cf54-42e4-a7ee-8775e782fb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:05.975636 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30697d-cf54-42e4-a7ee-8775e782fb27 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:05.975915 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30697d-cf54-42e4-a7ee-8775e782fb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:05.976187 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30697d-cf54-42e4-a7ee-8775e782fb27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:05.986609 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e30697d-cf54-42e4-a7ee-8775e782fb27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:05.988043 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e30697d-cf54-42e4-a7ee-8775e782fb27 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:06.005743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-9e30697d-cf54-42e4-a7ee-8775e782fb27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:11:06.005743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:11:06.005743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:11:06.005743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:11:06.005743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:11:06.005743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:11:06.005743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:11:06.005743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:11:06.005743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:11:06.005743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:11:06.005743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:11:06.005743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:11:06.005743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:11:06.005743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:11:06.005743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:11:06.006717 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:11:06.006717 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:11:06.006717 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:11:06.006717 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:11:06.006717 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:11:06.006717 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:11:06.006717 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:11:06.006717 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:11:06.006717 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:11:06.006717 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:11:06.006717 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:11:06.006717 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:11:06.006717 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:11:06.006717 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:11:06.006717 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:11:06.006717 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:11:06.006717 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:11:06.015834 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:11:06.015834 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:11:06.015834 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:11:06.015834 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:11:06.015834 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 544/1083] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:11:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:11:06.016220 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbba686-ef8b-49be-8b58-d8d86394b5df None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:06.117124 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbba686-ef8b-49be-8b58-d8d86394b5df None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:06.150184 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8414b-5ff8-4a93-bc70-0123cc864358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:06.150845 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8414b-5ff8-4a93-bc70-0123cc864358 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:06.151130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8414b-5ff8-4a93-bc70-0123cc864358 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:06.151409 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8414b-5ff8-4a93-bc70-0123cc864358 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:06.152120 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8414b-5ff8-4a93-bc70-0123cc864358 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:06.152428 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8414b-5ff8-4a93-bc70-0123cc864358 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:06.153799 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8414b-5ff8-4a93-bc70-0123cc864358 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:06.162640 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:06.174305 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 540/1084] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:06.760546 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ebdbc-ef2b-46b3-87d2-d2856ec4a76e None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:06.761186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ebdbc-ef2b-46b3-87d2-d2856ec4a76e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:06.761186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ebdbc-ef2b-46b3-87d2-d2856ec4a76e None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:06.762496 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 545/1085] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:11:06.768313 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6a0fb-49fa-4ced-bcc9-6bc74e7fee42 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:06.768596 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6a0fb-49fa-4ced-bcc9-6bc74e7fee42 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:06.768868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6a0fb-49fa-4ced-bcc9-6bc74e7fee42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:06.785735 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-f0d6a0fb-49fa-4ced-bcc9-6bc74e7fee42 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:11:06.786981 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f0d6a0fb-49fa-4ced-bcc9-6bc74e7fee42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:11:06.852217 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 541/1086] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:11:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:11:06.875665 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ebdbc-ef2b-46b3-87d2-d2856ec4a76e None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:06.957650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:06.977939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ebdbc-ef2b-46b3-87d2-d2856ec4a76e None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:07.011126 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee765e9e-bec1-4525-9437-4de10d747f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:07.011859 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee765e9e-bec1-4525-9437-4de10d747f3a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:07.012142 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee765e9e-bec1-4525-9437-4de10d747f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:07.012419 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee765e9e-bec1-4525-9437-4de10d747f3a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:07.022438 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee765e9e-bec1-4525-9437-4de10d747f3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:11:07.030573 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-ee765e9e-bec1-4525-9437-4de10d747f3a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 08:11:07.030573 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:11:07.030573 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:11:07.030573 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:11:07.030573 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:11:07.030573 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:11:07.030573 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:11:07.030573 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:11:07.030573 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:11:07.030573 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:11:07.030573 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:11:07.030573 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:11:07.030573 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:11:07.030573 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:11:07.030573 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:11:07.030573 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:11:07.031753 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:11:07.031753 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:11:07.031753 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:11:07.031753 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:11:07.031753 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:11:07.031753 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:11:07.031753 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:11:07.031753 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:11:07.031753 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:11:07.031753 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:11:07.031753 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:11:07.031753 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:11:07.031753 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:11:07.031753 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:11:07.031753 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:11:07.031753 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:11:07.033210 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:11:07.033210 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:11:07.033210 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:11:07.033210 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:11:07.033210 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:11:07.033210 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:11:07.033210 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:11:07.033210 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:11:07.033210 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:11:07.033210 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:11:07.033210 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 08:11:07.033210 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:11:07.033210 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 546/1087] 10.222.0.57 () {56 vars in 1120 bytes} [Sat Jun 4 08:11:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:11:07.038172 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6a0fb-49fa-4ced-bcc9-6bc74e7fee42 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:07.135689 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6a0fb-49fa-4ced-bcc9-6bc74e7fee42 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:07.163766 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:07.170448 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a978281-9d60-47ea-9307-5bc4e044ec39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:07.171138 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a978281-9d60-47ea-9307-5bc4e044ec39 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:07.171422 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a978281-9d60-47ea-9307-5bc4e044ec39 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:07.171699 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a978281-9d60-47ea-9307-5bc4e044ec39 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:07.172537 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a978281-9d60-47ea-9307-5bc4e044ec39 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:07.173363 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a978281-9d60-47ea-9307-5bc4e044ec39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:07.174824 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a978281-9d60-47ea-9307-5bc4e044ec39 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:07.184409 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 542/1088] 10.222.0.57 () {56 vars in 1115 bytes} [Sat Jun 4 08:11:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:07.190319 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee765e9e-bec1-4525-9437-4de10d747f3a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:07.289205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee765e9e-bec1-4525-9437-4de10d747f3a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:07.321552 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862e605-a47a-4e51-9cd7-a3900cc94667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:07.322360 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862e605-a47a-4e51-9cd7-a3900cc94667 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:07.322649 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862e605-a47a-4e51-9cd7-a3900cc94667 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:07.322922 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862e605-a47a-4e51-9cd7-a3900cc94667 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:07.331989 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:07.334493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862e605-a47a-4e51-9cd7-a3900cc94667 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:07.336351 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862e605-a47a-4e51-9cd7-a3900cc94667 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:07.354153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-d862e605-a47a-4e51-9cd7-a3900cc94667 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:11:07.354153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:11:07.354153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:11:07.354153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:11:07.354153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:11:07.354153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:11:07.354153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:11:07.354153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:11:07.354153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:11:07.354153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:11:07.354153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:11:07.354153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:11:07.354153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:11:07.354153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:11:07.354153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:11:07.355111 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:11:07.355111 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:11:07.355111 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:11:07.355111 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:11:07.355111 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:11:07.355111 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:11:07.355111 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:11:07.355111 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:11:07.355111 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:11:07.355111 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:11:07.355111 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:11:07.355111 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:11:07.355111 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:11:07.355111 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:11:07.355111 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:11:07.355111 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:11:07.355111 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:11:07.356061 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:11:07.356061 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:11:07.356061 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:11:07.356061 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:11:07.356061 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 547/1089] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:11:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:11:07.361065 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a978281-9d60-47ea-9307-5bc4e044ec39 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:07.460679 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a978281-9d60-47ea-9307-5bc4e044ec39 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:07.493312 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94424076-59c0-4ca6-a4d6-52e0976da93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:07.493997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94424076-59c0-4ca6-a4d6-52e0976da93e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:07.494281 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94424076-59c0-4ca6-a4d6-52e0976da93e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:07.494555 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94424076-59c0-4ca6-a4d6-52e0976da93e None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:07.495269 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94424076-59c0-4ca6-a4d6-52e0976da93e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:07.495576 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94424076-59c0-4ca6-a4d6-52e0976da93e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:07.496946 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94424076-59c0-4ca6-a4d6-52e0976da93e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:07.506925 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef7e3c-3ba1-4cdc-9206-21e25431d746 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:07.507213 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef7e3c-3ba1-4cdc-9206-21e25431d746 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:07.507494 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef7e3c-3ba1-4cdc-9206-21e25431d746 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:07.508866 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 548/1090] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 08:11:07.509294 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 543/1091] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:07.513730 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f6d60-76dc-4972-9137-2b0b859414c6 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:07.514044 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f6d60-76dc-4972-9137-2b0b859414c6 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:07.514319 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f6d60-76dc-4972-9137-2b0b859414c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:07.514987 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94424076-59c0-4ca6-a4d6-52e0976da93e None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:07.531039 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-7e3f6d60-76dc-4972-9137-2b0b859414c6 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:11:07.532815 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-7e3f6d60-76dc-4972-9137-2b0b859414c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:11:07.567115 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:07.598745 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 549/1092] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:11:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:11:07.614532 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94424076-59c0-4ca6-a4d6-52e0976da93e None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:07.621891 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f6d60-76dc-4972-9137-2b0b859414c6 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:07.649068 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd73cd-edff-40c1-be84-2cbbc1caf14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:07.649870 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd73cd-edff-40c1-be84-2cbbc1caf14b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:07.650152 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd73cd-edff-40c1-be84-2cbbc1caf14b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:07.650423 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd73cd-edff-40c1-be84-2cbbc1caf14b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:07.657612 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd73cd-edff-40c1-be84-2cbbc1caf14b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:07.659107 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd73cd-edff-40c1-be84-2cbbc1caf14b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:07.673105 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-3dcd73cd-edff-40c1-be84-2cbbc1caf14b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 08:11:07.673105 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:11:07.673105 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:11:07.673105 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:11:07.673105 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:11:07.673105 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:11:07.673105 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:11:07.673105 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:11:07.673105 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:11:07.673105 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:11:07.673105 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:11:07.673105 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:11:07.673105 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:11:07.673105 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:11:07.673105 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:11:07.673105 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:11:07.674424 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:11:07.674424 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:11:07.674424 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:11:07.674424 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:11:07.674424 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:11:07.674424 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:11:07.674424 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:11:07.674424 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:11:07.674424 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:11:07.674424 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:11:07.674424 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:11:07.674424 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:11:07.674424 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:11:07.674424 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:11:07.674424 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:11:07.674424 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:11:07.674424 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:11:07.674424 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:11:07.675451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:11:07.675451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:11:07.675451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:11:07.675451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:11:07.675451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:11:07.675451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:11:07.675451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:11:07.675451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:11:07.675451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 08:11:07.675451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:11:07.677968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 544/1093] 10.222.0.57 () {56 vars in 1093 bytes} [Sat Jun 4 08:11:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:11:07.680150 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd73cd-edff-40c1-be84-2cbbc1caf14b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:07.722069 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f6d60-76dc-4972-9137-2b0b859414c6 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:07.744071 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:07.757291 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2132d3-9d16-47ef-a187-436ac5ada7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:07.758106 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2132d3-9d16-47ef-a187-436ac5ada7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:07.758401 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2132d3-9d16-47ef-a187-436ac5ada7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:07.758666 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2132d3-9d16-47ef-a187-436ac5ada7e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:07.769586 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2132d3-9d16-47ef-a187-436ac5ada7e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:11:07.777148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-fd2132d3-9d16-47ef-a187-436ac5ada7e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:11:07.777148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:11:07.777148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:11:07.777148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:11:07.777148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:11:07.777148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:11:07.777148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:11:07.777148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:11:07.777148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:11:07.777148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:11:07.777148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:11:07.777148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:11:07.777148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:11:07.777148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:11:07.777148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:11:07.777148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:11:07.778155 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:11:07.778155 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:11:07.778155 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:11:07.778155 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:11:07.778155 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:11:07.778155 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:11:07.778155 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:11:07.778155 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:11:07.778155 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:11:07.778155 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:11:07.778155 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:11:07.778155 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:11:07.778155 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:11:07.778155 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:11:07.778155 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:11:07.778155 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:11:07.779080 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:11:07.779080 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:11:07.779080 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:11:07.779080 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:11:07.779080 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:11:07.779080 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:11:07.779080 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:11:07.779080 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:11:07.779080 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:11:07.779080 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:11:07.779080 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:11:07.779080 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:11:07.779080 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 550/1094] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:11:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:11:07.784162 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2132d3-9d16-47ef-a187-436ac5ada7e9 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:07.786822 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd73cd-edff-40c1-be84-2cbbc1caf14b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:07.800188 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:07.822272 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e1249-784d-438f-a100-501a6ca0614f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:07.822868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e1249-784d-438f-a100-501a6ca0614f None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:07.823143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e1249-784d-438f-a100-501a6ca0614f None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:07.823411 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e1249-784d-438f-a100-501a6ca0614f None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:07.824234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e1249-784d-438f-a100-501a6ca0614f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:07.824537 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e1249-784d-438f-a100-501a6ca0614f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:07.825977 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e1249-784d-438f-a100-501a6ca0614f None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:07.842813 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 545/1095] 10.222.0.57 () {56 vars in 1133 bytes} [Sat Jun 4 08:11:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:11:07.848441 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e1249-784d-438f-a100-501a6ca0614f None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:07.882742 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2132d3-9d16-47ef-a187-436ac5ada7e9 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:07.918985 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45142101-654e-413e-922e-3749fd7a4bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:07.919655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45142101-654e-413e-922e-3749fd7a4bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:07.919936 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45142101-654e-413e-922e-3749fd7a4bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:07.920208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45142101-654e-413e-922e-3749fd7a4bb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:07.920945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45142101-654e-413e-922e-3749fd7a4bb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:07.921535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45142101-654e-413e-922e-3749fd7a4bb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:07.923010 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45142101-654e-413e-922e-3749fd7a4bb6 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:07.931816 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 551/1096] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:11:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:11:07.937410 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45142101-654e-413e-922e-3749fd7a4bb6 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:07.948241 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e1249-784d-438f-a100-501a6ca0614f None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:07.982125 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b3e4f-6568-42d1-89b0-a9b538a8b907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:07.982275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:07.982765 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b3e4f-6568-42d1-89b0-a9b538a8b907 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:07.983057 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b3e4f-6568-42d1-89b0-a9b538a8b907 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:07.983423 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b3e4f-6568-42d1-89b0-a9b538a8b907 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:08.023181 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:08.037507 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45142101-654e-413e-922e-3749fd7a4bb6 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:08.059006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b3e4f-6568-42d1-89b0-a9b538a8b907 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:08.060475 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b3e4f-6568-42d1-89b0-a9b538a8b907 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:08.075434 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ff325-a9f6-43ae-ba9d-e107a12510dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:08.076237 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ff325-a9f6-43ae-ba9d-e107a12510dc None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:08.076519 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ff325-a9f6-43ae-ba9d-e107a12510dc None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:08.076792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ff325-a9f6-43ae-ba9d-e107a12510dc None admin] PATH_INFO: `/v3/users/646dd7c8174a4084947e962288fb491b` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:08.078015 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ff325-a9f6-43ae-ba9d-e107a12510dc None admin] RBAC: Authorizing `identity:get_user(user_id=646dd7c8174a4084947e962288fb491b)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:08.079486 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ff325-a9f6-43ae-ba9d-e107a12510dc None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:08.081126 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 552/1097] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:11:07 2022] GET /identity/v3/users/646dd7c8174a4084947e962288fb491b => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:08.086805 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ff325-a9f6-43ae-ba9d-e107a12510dc None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:08.164250 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 546/1098] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:11:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 04 08:11:08.169733 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b3e4f-6568-42d1-89b0-a9b538a8b907 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:08.183704 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ff325-a9f6-43ae-ba9d-e107a12510dc None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:08.197050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:08.218670 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e4539-2904-42a2-b301-d40526b79128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:08.219349 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e4539-2904-42a2-b301-d40526b79128 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:08.219618 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e4539-2904-42a2-b301-d40526b79128 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:08.219878 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e4539-2904-42a2-b301-d40526b79128 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:08.240936 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:08.272026 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b3e4f-6568-42d1-89b0-a9b538a8b907 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:08.286530 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e4539-2904-42a2-b301-d40526b79128 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:08.287969 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e4539-2904-42a2-b301-d40526b79128 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:08.305718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb7031-4863-48da-b76d-f6f028080368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:08.306531 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb7031-4863-48da-b76d-f6f028080368 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:08.306810 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb7031-4863-48da-b76d-f6f028080368 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:08.307081 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb7031-4863-48da-b76d-f6f028080368 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:08.317380 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb7031-4863-48da-b76d-f6f028080368 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:08.318845 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb7031-4863-48da-b76d-f6f028080368 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:08.336164 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-d0cb7031-4863-48da-b76d-f6f028080368 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:11:08.336164 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:11:08.336164 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:11:08.336164 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:11:08.336164 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:11:08.336164 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:11:08.336164 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:11:08.336164 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:11:08.336164 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:11:08.336164 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:11:08.336164 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:11:08.336164 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:11:08.336164 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:11:08.336164 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:11:08.336164 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:11:08.337051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:11:08.337051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:11:08.337051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:11:08.337051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:11:08.337051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:11:08.337051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:11:08.337051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:11:08.337051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:11:08.337051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:11:08.337051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:11:08.337051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:11:08.337051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:11:08.337051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:11:08.337051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:11:08.337051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:11:08.337051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:11:08.337051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:11:08.338189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:11:08.338189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:11:08.338189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:11:08.338189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:11:08.338189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 547/1099] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:11:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:11:08.342789 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb7031-4863-48da-b76d-f6f028080368 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:08.386426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 553/1100] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:11:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 04 08:11:08.392074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e4539-2904-42a2-b301-d40526b79128 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:08.406443 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:08.442178 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb7031-4863-48da-b76d-f6f028080368 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:08.464127 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:08.476052 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf0f1d-c5b9-4ad2-be3a-e593e0c0716a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:08.476703 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf0f1d-c5b9-4ad2-be3a-e593e0c0716a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:08.476980 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf0f1d-c5b9-4ad2-be3a-e593e0c0716a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:08.477248 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf0f1d-c5b9-4ad2-be3a-e593e0c0716a None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:08.477983 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf0f1d-c5b9-4ad2-be3a-e593e0c0716a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:08.478284 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf0f1d-c5b9-4ad2-be3a-e593e0c0716a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:08.479645 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf0f1d-c5b9-4ad2-be3a-e593e0c0716a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:08.491086 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 548/1101] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:11:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:11:08.496459 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf0f1d-c5b9-4ad2-be3a-e593e0c0716a None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:08.496653 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e4539-2904-42a2-b301-d40526b79128 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:08.530324 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796684f-9c05-4926-9ea0-9eb421c1d446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:08.531182 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796684f-9c05-4926-9ea0-9eb421c1d446 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:08.531464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796684f-9c05-4926-9ea0-9eb421c1d446 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:08.531734 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796684f-9c05-4926-9ea0-9eb421c1d446 None admin] PATH_INFO: `/v3/projects/175b9b4ab6024c8fbe6dc9b2b9e261a6` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:08.533440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796684f-9c05-4926-9ea0-9eb421c1d446 None admin] RBAC: Authorizing `identity:get_project(project_id=175b9b4ab6024c8fbe6dc9b2b9e261a6)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:08.534905 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796684f-9c05-4926-9ea0-9eb421c1d446 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:08.536803 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 554/1102] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:11:08 2022] GET /identity/v3/projects/175b9b4ab6024c8fbe6dc9b2b9e261a6 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:11:08.542591 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796684f-9c05-4926-9ea0-9eb421c1d446 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:08.597918 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf0f1d-c5b9-4ad2-be3a-e593e0c0716a None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:08.620532 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:08.632047 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98647e77-1288-428a-a157-7e36dc1143e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:08.632856 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98647e77-1288-428a-a157-7e36dc1143e5 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:08.633135 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98647e77-1288-428a-a157-7e36dc1143e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:08.633403 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98647e77-1288-428a-a157-7e36dc1143e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:08.639342 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796684f-9c05-4926-9ea0-9eb421c1d446 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:08.639959 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98647e77-1288-428a-a157-7e36dc1143e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:08.641385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98647e77-1288-428a-a157-7e36dc1143e5 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:08.655221 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-98647e77-1288-428a-a157-7e36dc1143e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:11:08.655221 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:11:08.655221 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:11:08.655221 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:11:08.655221 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:11:08.655221 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:11:08.655221 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:11:08.655221 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:11:08.655221 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:11:08.655221 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:11:08.655221 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:11:08.655221 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:11:08.655221 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:11:08.655221 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:11:08.655221 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:11:08.656229 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:11:08.656229 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:11:08.656229 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:11:08.656229 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:11:08.656229 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:11:08.656229 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:11:08.656229 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:11:08.656229 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:11:08.656229 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:11:08.656229 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:11:08.656229 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:11:08.656229 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:11:08.656229 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:11:08.656229 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:11:08.656229 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:11:08.656229 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:11:08.656229 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:11:08.657661 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:11:08.657661 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:11:08.657661 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:11:08.657661 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:11:08.657661 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:11:08.657661 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:11:08.657661 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:11:08.657661 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:11:08.657661 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 549/1103] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:11:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:11:08.662487 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98647e77-1288-428a-a157-7e36dc1143e5 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:08.676073 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b44f3-ef52-4395-8ad2-ac02fe9e1aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:08.676729 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b44f3-ef52-4395-8ad2-ac02fe9e1aef None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:08.677011 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b44f3-ef52-4395-8ad2-ac02fe9e1aef None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:08.677291 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b44f3-ef52-4395-8ad2-ac02fe9e1aef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:08.678155 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b44f3-ef52-4395-8ad2-ac02fe9e1aef None admin] RBAC: Adding query filter params (role.id=431cef539cfb476aad50d2470e763b5f, scope.project.id=175b9b4ab6024c8fbe6dc9b2b9e261a6, user.id=646dd7c8174a4084947e962288fb491b) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:08.678470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b44f3-ef52-4395-8ad2-ac02fe9e1aef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:08.680136 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b44f3-ef52-4395-8ad2-ac02fe9e1aef None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:08.693913 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 555/1104] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:11:08 2022] GET /identity/v3/role_assignments?user.id=646dd7c8174a4084947e962288fb491b&scope.project.id=175b9b4ab6024c8fbe6dc9b2b9e261a6&role.id=431cef539cfb476aad50d2470e763b5f => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:11:08.707904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:08.768669 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98647e77-1288-428a-a157-7e36dc1143e5 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:08.805032 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254f1f0-3508-4d6c-a738-b1f2a2ef0fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:08.805702 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254f1f0-3508-4d6c-a738-b1f2a2ef0fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:08.806015 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254f1f0-3508-4d6c-a738-b1f2a2ef0fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:08.806293 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254f1f0-3508-4d6c-a738-b1f2a2ef0fe0 None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:08.807083 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254f1f0-3508-4d6c-a738-b1f2a2ef0fe0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:08.807390 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254f1f0-3508-4d6c-a738-b1f2a2ef0fe0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:08.808850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254f1f0-3508-4d6c-a738-b1f2a2ef0fe0 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:08.821430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 550/1105] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:11:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:11:08.827741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b44f3-ef52-4395-8ad2-ac02fe9e1aef None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:08.930492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b44f3-ef52-4395-8ad2-ac02fe9e1aef None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:08.964662 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f70929-59be-413d-ad2f-b2188922287d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:08.965311 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f70929-59be-413d-ad2f-b2188922287d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:08.965588 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f70929-59be-413d-ad2f-b2188922287d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:08.965876 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f70929-59be-413d-ad2f-b2188922287d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:08.966691 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f70929-59be-413d-ad2f-b2188922287d None admin] RBAC: Adding query filter params (role.id=725918a0815f44dca0cc6586938c7b2f, scope.project.id=634c9a1745ef44c0ad66e02493d79af0, user.id=7e64d002241242928936dd0d991ecdc1) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:08.966996 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f70929-59be-413d-ad2f-b2188922287d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:08.968422 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f70929-59be-413d-ad2f-b2188922287d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:08.974620 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 556/1106] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:11:08 2022] GET /identity/v3/role_assignments?user.id=7e64d002241242928936dd0d991ecdc1&scope.project.id=634c9a1745ef44c0ad66e02493d79af0&role.id=725918a0815f44dca0cc6586938c7b2f => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:11:10.956146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231636c6-d813-44bd-846b-60a159558a31 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:10.956588 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231636c6-d813-44bd-846b-60a159558a31 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:10.956701 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231636c6-d813-44bd-846b-60a159558a31 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:10.958081 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 551/1107] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:11:10.963174 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08403c81-885b-4dcb-87fa-1103d38ee26d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:10.963612 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08403c81-885b-4dcb-87fa-1103d38ee26d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:10.963732 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08403c81-885b-4dcb-87fa-1103d38ee26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:10.980021 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-08403c81-885b-4dcb-87fa-1103d38ee26d None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:11:10.981194 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-08403c81-885b-4dcb-87fa-1103d38ee26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:11:10.983142 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:11.047155 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 557/1108] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:11:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:11:11.072731 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231636c6-d813-44bd-846b-60a159558a31 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:11.177673 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231636c6-d813-44bd-846b-60a159558a31 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:11.179391 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:11.212524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a32797-c17c-4dab-8a9c-5a44a4d40560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:11.213298 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a32797-c17c-4dab-8a9c-5a44a4d40560 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:11.213579 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a32797-c17c-4dab-8a9c-5a44a4d40560 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:11.213876 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a32797-c17c-4dab-8a9c-5a44a4d40560 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:11.215036 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a32797-c17c-4dab-8a9c-5a44a4d40560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:11.216459 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a32797-c17c-4dab-8a9c-5a44a4d40560 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:11.218169 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 552/1109] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:11:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:11.223908 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08403c81-885b-4dcb-87fa-1103d38ee26d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:11.319138 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08403c81-885b-4dcb-87fa-1103d38ee26d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:11.351222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0ee1a-7dc1-4769-bfc2-16ae6b4c5af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:11.351877 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0ee1a-7dc1-4769-bfc2-16ae6b4c5af7 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:11.352154 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0ee1a-7dc1-4769-bfc2-16ae6b4c5af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:11.352424 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0ee1a-7dc1-4769-bfc2-16ae6b4c5af7 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:11.353113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0ee1a-7dc1-4769-bfc2-16ae6b4c5af7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:11.354555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0ee1a-7dc1-4769-bfc2-16ae6b4c5af7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:11.363644 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:11.377033 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 558/1110] 10.222.0.57 () {60 vars in 1132 bytes} [Sat Jun 4 08:11:11 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:11:13.657468 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132103ad-0690-4017-a1df-34e5c07a1a7c None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:13.658054 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132103ad-0690-4017-a1df-34e5c07a1a7c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:13.658154 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132103ad-0690-4017-a1df-34e5c07a1a7c None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:13.659460 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 553/1111] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:11:13.664738 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39278cc0-29ab-4373-8030-c15d1612780f None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:13.665130 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39278cc0-29ab-4373-8030-c15d1612780f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:13.665295 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39278cc0-29ab-4373-8030-c15d1612780f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:13.681927 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-39278cc0-29ab-4373-8030-c15d1612780f None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:11:13.683098 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-39278cc0-29ab-4373-8030-c15d1612780f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:11:13.746114 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 559/1112] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:11:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:11:13.770297 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132103ad-0690-4017-a1df-34e5c07a1a7c None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:13.867013 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132103ad-0690-4017-a1df-34e5c07a1a7c None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:13.899851 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10198ce8-f04d-447b-90bd-2d26b2cd0ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:13.900671 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10198ce8-f04d-447b-90bd-2d26b2cd0ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:13.900946 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10198ce8-f04d-447b-90bd-2d26b2cd0ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:13.901213 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10198ce8-f04d-447b-90bd-2d26b2cd0ab3 None admin] PATH_INFO: `/v3/roles/b6177706a26446d5b4c540a3e97dee2e` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:13.902678 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10198ce8-f04d-447b-90bd-2d26b2cd0ab3 None admin] RBAC: Authorizing `identity:get_role(role_id=b6177706a26446d5b4c540a3e97dee2e)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:13.904031 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10198ce8-f04d-447b-90bd-2d26b2cd0ab3 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:13.905344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 554/1113] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:11:13 2022] GET /identity/v3/roles/b6177706a26446d5b4c540a3e97dee2e => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:13.910883 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39278cc0-29ab-4373-8030-c15d1612780f None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:14.006741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39278cc0-29ab-4373-8030-c15d1612780f None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:14.028849 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:14.039932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3cc3c-2dd6-4794-ad05-34432a6424d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:14.040787 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3cc3c-2dd6-4794-ad05-34432a6424d5 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:14.041070 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3cc3c-2dd6-4794-ad05-34432a6424d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:14.041349 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3cc3c-2dd6-4794-ad05-34432a6424d5 None admin] PATH_INFO: `/v3/users/016215982cce4e4cae67d9a7e9c67a0a` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:14.054872 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3cc3c-2dd6-4794-ad05-34432a6424d5 None admin] RBAC: Authorizing `identity:get_user(user_id=016215982cce4e4cae67d9a7e9c67a0a)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:14.056308 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3cc3c-2dd6-4794-ad05-34432a6424d5 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:14.057964 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 560/1114] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:11:13 2022] GET /identity/v3/users/016215982cce4e4cae67d9a7e9c67a0a => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:14.064271 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10198ce8-f04d-447b-90bd-2d26b2cd0ab3 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:14.102180 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:14.167136 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10198ce8-f04d-447b-90bd-2d26b2cd0ab3 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:14.200922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba56fe-b199-42d0-8b01-c05243da8459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:14.201556 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba56fe-b199-42d0-8b01-c05243da8459 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:14.201854 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba56fe-b199-42d0-8b01-c05243da8459 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:14.202131 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba56fe-b199-42d0-8b01-c05243da8459 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:14.266008 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba56fe-b199-42d0-8b01-c05243da8459 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:14.267435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba56fe-b199-42d0-8b01-c05243da8459 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:14.303457 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:14.361923 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 555/1115] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:11:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 08:11:14.367777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3cc3c-2dd6-4794-ad05-34432a6424d5 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:14.467492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3cc3c-2dd6-4794-ad05-34432a6424d5 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:14.501029 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5020d-378c-4d75-8565-3a56338cfbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:14.501909 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5020d-378c-4d75-8565-3a56338cfbe7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:14.502569 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5020d-378c-4d75-8565-3a56338cfbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:14.502850 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5020d-378c-4d75-8565-3a56338cfbe7 None admin] PATH_INFO: `/v3/projects/175b9b4ab6024c8fbe6dc9b2b9e261a6` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:14.504036 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5020d-378c-4d75-8565-3a56338cfbe7 None admin] RBAC: Authorizing `identity:get_project(project_id=175b9b4ab6024c8fbe6dc9b2b9e261a6)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:14.505485 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5020d-378c-4d75-8565-3a56338cfbe7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:14.507215 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 561/1116] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:11:14 2022] GET /identity/v3/projects/175b9b4ab6024c8fbe6dc9b2b9e261a6 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:14.513257 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba56fe-b199-42d0-8b01-c05243da8459 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:14.609187 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba56fe-b199-42d0-8b01-c05243da8459 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:14.647566 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6e817-fb14-4660-89bb-0dfbe494d6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:14.648202 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6e817-fb14-4660-89bb-0dfbe494d6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:14.648484 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6e817-fb14-4660-89bb-0dfbe494d6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:14.648756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6e817-fb14-4660-89bb-0dfbe494d6a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:14.649573 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6e817-fb14-4660-89bb-0dfbe494d6a2 None admin] RBAC: Adding query filter params (role.id=b6177706a26446d5b4c540a3e97dee2e, scope.project.id=175b9b4ab6024c8fbe6dc9b2b9e261a6, user.id=016215982cce4e4cae67d9a7e9c67a0a) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:14.649910 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6e817-fb14-4660-89bb-0dfbe494d6a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:14.651326 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6e817-fb14-4660-89bb-0dfbe494d6a2 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:14.657252 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 556/1117] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:11:14 2022] GET /identity/v3/role_assignments?user.id=016215982cce4e4cae67d9a7e9c67a0a&scope.project.id=175b9b4ab6024c8fbe6dc9b2b9e261a6&role.id=b6177706a26446d5b4c540a3e97dee2e => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:16.833450 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e091e-6e01-40c6-978d-7742821abfd0 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:16.834041 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e091e-6e01-40c6-978d-7742821abfd0 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:16.834041 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e091e-6e01-40c6-978d-7742821abfd0 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:16.835389 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 562/1118] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:11:16.840414 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94b28a-e644-4d1b-8556-92b9a0ac9d7c None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:16.840840 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94b28a-e644-4d1b-8556-92b9a0ac9d7c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:16.840967 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94b28a-e644-4d1b-8556-92b9a0ac9d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:16.846512 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:16.858919 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-8b94b28a-e644-4d1b-8556-92b9a0ac9d7c None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:11:16.860689 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8b94b28a-e644-4d1b-8556-92b9a0ac9d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:11:16.925067 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 557/1119] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:11:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:11:16.947225 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e091e-6e01-40c6-978d-7742821abfd0 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:16.997317 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:17.046141 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e091e-6e01-40c6-978d-7742821abfd0 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:17.078247 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fd370-0fae-4f3c-b917-2ee43bd6fc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:17.079623 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fd370-0fae-4f3c-b917-2ee43bd6fc1d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:17.079901 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fd370-0fae-4f3c-b917-2ee43bd6fc1d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:17.080170 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fd370-0fae-4f3c-b917-2ee43bd6fc1d None admin] PATH_INFO: `/v3/roles/b6177706a26446d5b4c540a3e97dee2e` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:17.081631 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fd370-0fae-4f3c-b917-2ee43bd6fc1d None admin] RBAC: Authorizing `identity:get_role(role_id=b6177706a26446d5b4c540a3e97dee2e)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:17.083020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fd370-0fae-4f3c-b917-2ee43bd6fc1d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:17.084401 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 563/1120] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:11:16 2022] GET /identity/v3/roles/b6177706a26446d5b4c540a3e97dee2e => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:17.089954 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94b28a-e644-4d1b-8556-92b9a0ac9d7c None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:17.186247 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94b28a-e644-4d1b-8556-92b9a0ac9d7c None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:17.214309 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:17.220236 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6aa55-b86c-4bb6-955d-85219232002d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:17.221092 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6aa55-b86c-4bb6-955d-85219232002d None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:17.221371 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6aa55-b86c-4bb6-955d-85219232002d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:17.221643 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6aa55-b86c-4bb6-955d-85219232002d None admin] PATH_INFO: `/v3/users/016215982cce4e4cae67d9a7e9c67a0a` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:17.223108 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e6aa55-b86c-4bb6-955d-85219232002d None admin] RBAC: Authorizing `identity:get_user(user_id=016215982cce4e4cae67d9a7e9c67a0a)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:17.224530 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e6aa55-b86c-4bb6-955d-85219232002d None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:17.226174 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 558/1121] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:11:17 2022] GET /identity/v3/users/016215982cce4e4cae67d9a7e9c67a0a => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:17.231817 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fd370-0fae-4f3c-b917-2ee43bd6fc1d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:17.327164 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fd370-0fae-4f3c-b917-2ee43bd6fc1d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:17.344593 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:17.361005 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda29e2-6608-4594-add2-67da88437758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:17.361855 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda29e2-6608-4594-add2-67da88437758 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:17.362141 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda29e2-6608-4594-add2-67da88437758 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:17.362414 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda29e2-6608-4594-add2-67da88437758 None admin] PATH_INFO: `/v3/projects/175b9b4ab6024c8fbe6dc9b2b9e261a6` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:17.363573 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda29e2-6608-4594-add2-67da88437758 None admin] RBAC: Authorizing `identity:get_project(project_id=175b9b4ab6024c8fbe6dc9b2b9e261a6)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:17.364989 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda29e2-6608-4594-add2-67da88437758 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:17.366683 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 564/1122] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:11:17 2022] GET /identity/v3/projects/175b9b4ab6024c8fbe6dc9b2b9e261a6 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:17.372391 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6aa55-b86c-4bb6-955d-85219232002d None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:17.475127 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6aa55-b86c-4bb6-955d-85219232002d None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:17.507977 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f8713-08f4-4204-beef-b2607accc953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:17.508851 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f8713-08f4-4204-beef-b2607accc953 None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:17.509134 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f8713-08f4-4204-beef-b2607accc953 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:17.509408 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f8713-08f4-4204-beef-b2607accc953 None admin] PATH_INFO: `/v3/projects/175b9b4ab6024c8fbe6dc9b2b9e261a6/users/016215982cce4e4cae67d9a7e9c67a0a/roles/b6177706a26446d5b4c540a3e97dee2e` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:17.511609 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f8713-08f4-4204-beef-b2607accc953 None admin] RBAC: Authorizing `identity:create_grant(project_id=175b9b4ab6024c8fbe6dc9b2b9e261a6, user_id=016215982cce4e4cae67d9a7e9c67a0a, role_id=b6177706a26446d5b4c540a3e97dee2e)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:17.513040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f8713-08f4-4204-beef-b2607accc953 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:17.527645 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 559/1123] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jun 4 08:11:17 2022] PUT /identity/v3/projects/175b9b4ab6024c8fbe6dc9b2b9e261a6/users/016215982cce4e4cae67d9a7e9c67a0a/roles/b6177706a26446d5b4c540a3e97dee2e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:11:19.744085 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b4e07-122a-4506-a53b-3f84cd0ba8c5 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:19.744678 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b4e07-122a-4506-a53b-3f84cd0ba8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:19.744678 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b4e07-122a-4506-a53b-3f84cd0ba8c5 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:19.746035 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 565/1124] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 08:11:19.752180 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113ff3b-68ea-4425-b863-75621070192c None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:19.752610 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113ff3b-68ea-4425-b863-75621070192c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:19.752928 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113ff3b-68ea-4425-b863-75621070192c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:19.770124 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-7113ff3b-68ea-4425-b863-75621070192c None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:11:19.771287 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-7113ff3b-68ea-4425-b863-75621070192c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:11:19.824175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:19.836343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 560/1125] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:11:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:11:19.858950 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b4e07-122a-4506-a53b-3f84cd0ba8c5 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:19.964980 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b4e07-122a-4506-a53b-3f84cd0ba8c5 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:19.997453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dba74f-36e6-459f-b5c5-eb79ce6ca9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:19.998325 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dba74f-36e6-459f-b5c5-eb79ce6ca9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:19.998610 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dba74f-36e6-459f-b5c5-eb79ce6ca9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:19.998893 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dba74f-36e6-459f-b5c5-eb79ce6ca9c1 None admin] PATH_INFO: `/v3/roles/b6177706a26446d5b4c540a3e97dee2e` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:20.000897 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dba74f-36e6-459f-b5c5-eb79ce6ca9c1 None admin] RBAC: Authorizing `identity:get_role(role_id=b6177706a26446d5b4c540a3e97dee2e)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:20.002297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dba74f-36e6-459f-b5c5-eb79ce6ca9c1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:20.003650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 566/1126] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:11:19 2022] GET /identity/v3/roles/b6177706a26446d5b4c540a3e97dee2e => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:20.009567 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113ff3b-68ea-4425-b863-75621070192c None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:20.111309 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113ff3b-68ea-4425-b863-75621070192c None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:20.144176 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf731d2-6b0d-4cfc-bb5c-5e12651922a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:20.145033 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf731d2-6b0d-4cfc-bb5c-5e12651922a4 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:20.145311 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf731d2-6b0d-4cfc-bb5c-5e12651922a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:20.145584 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf731d2-6b0d-4cfc-bb5c-5e12651922a4 None admin] PATH_INFO: `/v3/users/016215982cce4e4cae67d9a7e9c67a0a` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:20.146781 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf731d2-6b0d-4cfc-bb5c-5e12651922a4 None admin] RBAC: Authorizing `identity:get_user(user_id=016215982cce4e4cae67d9a7e9c67a0a)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:20.148237 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf731d2-6b0d-4cfc-bb5c-5e12651922a4 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:20.149871 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 561/1127] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:11:20 2022] GET /identity/v3/users/016215982cce4e4cae67d9a7e9c67a0a => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:20.155585 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dba74f-36e6-459f-b5c5-eb79ce6ca9c1 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:20.209437 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:20.253039 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dba74f-36e6-459f-b5c5-eb79ce6ca9c1 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:20.285276 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4534e-942e-4ee5-b3c6-cd2d5885022f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:20.285932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4534e-942e-4ee5-b3c6-cd2d5885022f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:20.286216 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4534e-942e-4ee5-b3c6-cd2d5885022f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:20.286487 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4534e-942e-4ee5-b3c6-cd2d5885022f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:20.350550 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4534e-942e-4ee5-b3c6-cd2d5885022f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:20.351980 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4534e-942e-4ee5-b3c6-cd2d5885022f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:20.402936 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:20.448392 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 567/1128] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:11:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 08:11:20.454296 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf731d2-6b0d-4cfc-bb5c-5e12651922a4 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:20.511026 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:20.551385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf731d2-6b0d-4cfc-bb5c-5e12651922a4 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:20.583616 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312b344-cf23-4380-a92b-ca0b6893d94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:20.584452 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312b344-cf23-4380-a92b-ca0b6893d94f None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:20.584731 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312b344-cf23-4380-a92b-ca0b6893d94f None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:20.585001 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312b344-cf23-4380-a92b-ca0b6893d94f None admin] PATH_INFO: `/v3/projects/175b9b4ab6024c8fbe6dc9b2b9e261a6` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:20.586189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312b344-cf23-4380-a92b-ca0b6893d94f None admin] RBAC: Authorizing `identity:get_project(project_id=175b9b4ab6024c8fbe6dc9b2b9e261a6)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:20.587609 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312b344-cf23-4380-a92b-ca0b6893d94f None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:20.589268 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 562/1129] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:11:20 2022] GET /identity/v3/projects/175b9b4ab6024c8fbe6dc9b2b9e261a6 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:20.595813 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4534e-942e-4ee5-b3c6-cd2d5885022f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:20.690445 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4534e-942e-4ee5-b3c6-cd2d5885022f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:20.723395 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb32ee-99b9-4404-9886-52d1c08ad2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:20.724026 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb32ee-99b9-4404-9886-52d1c08ad2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:20.724305 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb32ee-99b9-4404-9886-52d1c08ad2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:20.724572 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb32ee-99b9-4404-9886-52d1c08ad2d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:20.725381 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb32ee-99b9-4404-9886-52d1c08ad2d8 None admin] RBAC: Adding query filter params (role.id=b6177706a26446d5b4c540a3e97dee2e, scope.project.id=175b9b4ab6024c8fbe6dc9b2b9e261a6, user.id=016215982cce4e4cae67d9a7e9c67a0a) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:20.725684 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb32ee-99b9-4404-9886-52d1c08ad2d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:20.727158 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb32ee-99b9-4404-9886-52d1c08ad2d8 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:20.732722 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 568/1130] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:11:20 2022] GET /identity/v3/role_assignments?user.id=016215982cce4e4cae67d9a7e9c67a0a&scope.project.id=175b9b4ab6024c8fbe6dc9b2b9e261a6&role.id=b6177706a26446d5b4c540a3e97dee2e => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:22.994391 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1acd28-4b7a-4f95-a5c9-f24d7fea094e None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:22.994881 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1acd28-4b7a-4f95-a5c9-f24d7fea094e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:22.995068 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1acd28-4b7a-4f95-a5c9-f24d7fea094e None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:22.996304 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 563/1131] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:11:23.001446 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9b8a9-ca7f-427a-9ec2-665bb76c3b0e None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:23.001814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9b8a9-ca7f-427a-9ec2-665bb76c3b0e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:23.002056 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9b8a9-ca7f-427a-9ec2-665bb76c3b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:23.022368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6ac9b8a9-ca7f-427a-9ec2-665bb76c3b0e None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:11:23.023557 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6ac9b8a9-ca7f-427a-9ec2-665bb76c3b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:11:23.036911 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:23.088985 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 569/1132] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:11:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:11:23.112602 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1acd28-4b7a-4f95-a5c9-f24d7fea094e None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:23.211651 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1acd28-4b7a-4f95-a5c9-f24d7fea094e None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:23.236699 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:23.246052 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89acc1a-83dd-4a8f-b9d7-21a8f62c1a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:23.246834 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89acc1a-83dd-4a8f-b9d7-21a8f62c1a55 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:23.247119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89acc1a-83dd-4a8f-b9d7-21a8f62c1a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:23.247395 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89acc1a-83dd-4a8f-b9d7-21a8f62c1a55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:23.248577 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89acc1a-83dd-4a8f-b9d7-21a8f62c1a55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:23.250045 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89acc1a-83dd-4a8f-b9d7-21a8f62c1a55 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:23.252257 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 564/1133] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:11:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:23.257942 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9b8a9-ca7f-427a-9ec2-665bb76c3b0e None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:23.353482 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9b8a9-ca7f-427a-9ec2-665bb76c3b0e None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:23.386213 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0badb-5798-476d-8eba-2f49c2dc6dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:23.386857 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0badb-5798-476d-8eba-2f49c2dc6dc9 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:23.387139 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0badb-5798-476d-8eba-2f49c2dc6dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:23.387412 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0badb-5798-476d-8eba-2f49c2dc6dc9 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:23.388117 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b0badb-5798-476d-8eba-2f49c2dc6dc9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:23.389529 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b0badb-5798-476d-8eba-2f49c2dc6dc9 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:23.409420 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:23.416540 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 570/1134] 10.222.0.57 () {60 vars in 1141 bytes} [Sat Jun 4 08:11:23 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:11:25.660068 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0265c86-a307-48f9-a259-a1589414837e None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:25.660633 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0265c86-a307-48f9-a259-a1589414837e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:25.660633 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0265c86-a307-48f9-a259-a1589414837e None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:25.662000 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 565/1135] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:11:25.667205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa955bdb-9fb3-4d0f-ac09-cfcfb44bf1b6 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:25.667584 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa955bdb-9fb3-4d0f-ac09-cfcfb44bf1b6 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:25.667759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa955bdb-9fb3-4d0f-ac09-cfcfb44bf1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:25.684819 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-fa955bdb-9fb3-4d0f-ac09-cfcfb44bf1b6 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:11:25.686019 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-fa955bdb-9fb3-4d0f-ac09-cfcfb44bf1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:11:25.749716 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 571/1136] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:11:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:11:25.774607 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0265c86-a307-48f9-a259-a1589414837e None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:25.873882 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0265c86-a307-48f9-a259-a1589414837e None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:25.906802 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b69935-b0b9-40f4-8983-ae4742055ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:25.907578 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b69935-b0b9-40f4-8983-ae4742055ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:25.907859 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b69935-b0b9-40f4-8983-ae4742055ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:25.908407 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b69935-b0b9-40f4-8983-ae4742055ee5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:25.909570 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b69935-b0b9-40f4-8983-ae4742055ee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:25.911118 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b69935-b0b9-40f4-8983-ae4742055ee5 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:25.912660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 566/1137] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:11:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:25.918287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa955bdb-9fb3-4d0f-ac09-cfcfb44bf1b6 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:26.014607 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa955bdb-9fb3-4d0f-ac09-cfcfb44bf1b6 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:26.042172 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:26.048752 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69ae00-4a74-4b83-8904-ec16c449e7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:26.049405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69ae00-4a74-4b83-8904-ec16c449e7a7 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:26.049690 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69ae00-4a74-4b83-8904-ec16c449e7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:26.049998 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69ae00-4a74-4b83-8904-ec16c449e7a7 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:26.050710 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69ae00-4a74-4b83-8904-ec16c449e7a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:26.052132 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69ae00-4a74-4b83-8904-ec16c449e7a7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:26.071090 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 572/1138] 10.222.0.57 () {60 vars in 1132 bytes} [Sat Jun 4 08:11:25 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:11:28.318059 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94915534-4e82-4f49-ab66-292ec22e55d4 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:28.318581 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94915534-4e82-4f49-ab66-292ec22e55d4 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:28.318689 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94915534-4e82-4f49-ab66-292ec22e55d4 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:28.319968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 567/1139] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:11:28.325218 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c8f7d-fd2b-4b32-84fe-72f65d239a61 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:28.325629 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c8f7d-fd2b-4b32-84fe-72f65d239a61 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:28.325771 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c8f7d-fd2b-4b32-84fe-72f65d239a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:28.342628 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-5b6c8f7d-fd2b-4b32-84fe-72f65d239a61 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:11:28.343794 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-5b6c8f7d-fd2b-4b32-84fe-72f65d239a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:11:28.407007 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 573/1140] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:11:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:11:28.430148 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94915534-4e82-4f49-ab66-292ec22e55d4 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:28.490581 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:28.529471 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94915534-4e82-4f49-ab66-292ec22e55d4 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:28.561622 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d615a-f065-42df-82e0-af7802213718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:28.562421 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d615a-f065-42df-82e0-af7802213718 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:28.562703 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d615a-f065-42df-82e0-af7802213718 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:28.563500 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d615a-f065-42df-82e0-af7802213718 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:28.573309 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d615a-f065-42df-82e0-af7802213718 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:11:28.581479 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-790d615a-f065-42df-82e0-af7802213718 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:11:28.581479 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:11:28.581479 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:11:28.581479 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:11:28.581479 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:11:28.581479 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:11:28.581479 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:11:28.581479 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:11:28.581479 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:11:28.581479 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:11:28.581479 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:11:28.581479 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:11:28.581479 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:11:28.581479 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:11:28.581479 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:11:28.581479 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:11:28.582637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:11:28.582637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:11:28.582637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:11:28.582637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:11:28.582637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:11:28.582637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:11:28.582637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:11:28.582637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:11:28.582637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:11:28.582637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:11:28.582637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:11:28.582637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:11:28.582637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:11:28.582637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:11:28.582637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:11:28.582637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:11:28.583723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:11:28.583723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:11:28.583723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:11:28.583723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:11:28.583723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:11:28.583723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:11:28.583723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:11:28.583723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:11:28.583723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:11:28.583723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:11:28.583723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:11:28.583723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:11:28.583723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 568/1141] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:11:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:11:28.588519 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c8f7d-fd2b-4b32-84fe-72f65d239a61 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:28.682553 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c8f7d-fd2b-4b32-84fe-72f65d239a61 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:28.699529 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:28.717237 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682cc78-be53-45ad-a593-55bf0be24fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:28.717925 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682cc78-be53-45ad-a593-55bf0be24fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:28.718212 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682cc78-be53-45ad-a593-55bf0be24fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:28.718487 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682cc78-be53-45ad-a593-55bf0be24fb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:28.719253 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682cc78-be53-45ad-a593-55bf0be24fb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:28.719558 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682cc78-be53-45ad-a593-55bf0be24fb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:28.720939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682cc78-be53-45ad-a593-55bf0be24fb1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:28.728750 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 574/1142] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:11:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:28.734459 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d615a-f065-42df-82e0-af7802213718 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:28.831569 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d615a-f065-42df-82e0-af7802213718 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:28.852458 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:28.864615 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e87261-0055-49f4-b23a-fbc66c5f84e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:28.865468 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e87261-0055-49f4-b23a-fbc66c5f84e9 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:28.865749 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e87261-0055-49f4-b23a-fbc66c5f84e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:28.866052 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e87261-0055-49f4-b23a-fbc66c5f84e9 None admin] PATH_INFO: `/v3/users/f31c7108369b432c88fd8b3f0f3d50dd` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:28.879315 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e87261-0055-49f4-b23a-fbc66c5f84e9 None admin] RBAC: Authorizing `identity:get_user(user_id=f31c7108369b432c88fd8b3f0f3d50dd)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:28.880757 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e87261-0055-49f4-b23a-fbc66c5f84e9 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:28.882402 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 569/1143] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:11:28 2022] GET /identity/v3/users/f31c7108369b432c88fd8b3f0f3d50dd => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:28.888013 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682cc78-be53-45ad-a593-55bf0be24fb1 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:28.985444 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682cc78-be53-45ad-a593-55bf0be24fb1 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:29.018202 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d31761-b4f7-4bdf-8701-50d06bc2b0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:29.018844 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d31761-b4f7-4bdf-8701-50d06bc2b0a6 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:29.019128 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d31761-b4f7-4bdf-8701-50d06bc2b0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:29.019405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d31761-b4f7-4bdf-8701-50d06bc2b0a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:29.063983 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:29.085409 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d31761-b4f7-4bdf-8701-50d06bc2b0a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:29.086831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d31761-b4f7-4bdf-8701-50d06bc2b0a6 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:29.182015 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 575/1144] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:11:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 08:11:29.187768 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e87261-0055-49f4-b23a-fbc66c5f84e9 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:29.284546 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e87261-0055-49f4-b23a-fbc66c5f84e9 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:29.320400 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81680b7-1732-42d2-845b-1df2222ee041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:29.321255 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81680b7-1732-42d2-845b-1df2222ee041 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:29.321536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81680b7-1732-42d2-845b-1df2222ee041 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:29.321809 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81680b7-1732-42d2-845b-1df2222ee041 None admin] PATH_INFO: `/v3/projects/0a16ca687a814170a85a7e6e081c93a4` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:29.323024 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81680b7-1732-42d2-845b-1df2222ee041 None admin] RBAC: Authorizing `identity:get_project(project_id=0a16ca687a814170a85a7e6e081c93a4)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:29.324460 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81680b7-1732-42d2-845b-1df2222ee041 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:29.326230 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 570/1145] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:11:29 2022] GET /identity/v3/projects/0a16ca687a814170a85a7e6e081c93a4 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:29.332189 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d31761-b4f7-4bdf-8701-50d06bc2b0a6 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:29.406237 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:29.427206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d31761-b4f7-4bdf-8701-50d06bc2b0a6 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:29.462477 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68423b78-7ec2-44e4-abf7-2f226b9b3094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:29.463125 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68423b78-7ec2-44e4-abf7-2f226b9b3094 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:29.463406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68423b78-7ec2-44e4-abf7-2f226b9b3094 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:29.463676 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68423b78-7ec2-44e4-abf7-2f226b9b3094 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:29.464500 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68423b78-7ec2-44e4-abf7-2f226b9b3094 None admin] RBAC: Adding query filter params (role.id=431cef539cfb476aad50d2470e763b5f, scope.project.id=0a16ca687a814170a85a7e6e081c93a4, user.id=f31c7108369b432c88fd8b3f0f3d50dd) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:29.464810 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68423b78-7ec2-44e4-abf7-2f226b9b3094 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:29.466257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68423b78-7ec2-44e4-abf7-2f226b9b3094 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:29.472322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 576/1146] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:11:29 2022] GET /identity/v3/role_assignments?user.id=f31c7108369b432c88fd8b3f0f3d50dd&scope.project.id=0a16ca687a814170a85a7e6e081c93a4&role.id=431cef539cfb476aad50d2470e763b5f => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:31.684342 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d1d8d-b92c-4a87-ab27-cb033d0f12a2 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:31.684874 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d1d8d-b92c-4a87-ab27-cb033d0f12a2 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:31.684874 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d1d8d-b92c-4a87-ab27-cb033d0f12a2 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:31.686290 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 571/1147] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:11:31.692107 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3759a-760f-489c-bf94-13d4dfb6ab50 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:31.692548 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3759a-760f-489c-bf94-13d4dfb6ab50 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:31.692655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3759a-760f-489c-bf94-13d4dfb6ab50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:31.709113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-9ef3759a-760f-489c-bf94-13d4dfb6ab50 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:11:31.710337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9ef3759a-760f-489c-bf94-13d4dfb6ab50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:11:31.774380 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 577/1148] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:11:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:11:31.796497 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d1d8d-b92c-4a87-ab27-cb033d0f12a2 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:31.847463 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:31.901011 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d1d8d-b92c-4a87-ab27-cb033d0f12a2 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:31.935288 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587692d-62fd-4bd5-9e3f-e4e710492eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:31.936016 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587692d-62fd-4bd5-9e3f-e4e710492eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:31.936298 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587692d-62fd-4bd5-9e3f-e4e710492eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:31.936577 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587692d-62fd-4bd5-9e3f-e4e710492eb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:31.947066 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587692d-62fd-4bd5-9e3f-e4e710492eb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:11:31.954682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-a587692d-62fd-4bd5-9e3f-e4e710492eb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:11:31.954682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:11:31.954682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:11:31.954682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:11:31.954682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:11:31.954682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:11:31.954682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:11:31.954682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:11:31.954682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:11:31.954682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:11:31.954682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:11:31.954682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:11:31.954682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:11:31.954682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:11:31.954682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:11:31.954682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:11:31.955783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:11:31.955783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:11:31.955783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:11:31.955783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:11:31.955783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:11:31.955783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:11:31.955783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:11:31.955783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:11:31.955783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:11:31.955783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:11:31.955783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:11:31.955783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:11:31.955783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:11:31.955783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:11:31.955783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:11:31.955783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:11:31.956868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:11:31.956868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:11:31.956868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:11:31.956868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:11:31.956868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:11:31.956868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:11:31.956868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:11:31.956868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:11:31.956868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:11:31.956868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:11:31.956868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:11:31.956868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:11:31.956868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 572/1149] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:11:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:11:31.961738 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3759a-760f-489c-bf94-13d4dfb6ab50 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:32.030134 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:32.060052 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3759a-760f-489c-bf94-13d4dfb6ab50 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:32.092564 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc628b8-0257-4e39-a1b9-4b4571faf0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:32.093169 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc628b8-0257-4e39-a1b9-4b4571faf0dd None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:32.093454 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc628b8-0257-4e39-a1b9-4b4571faf0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:32.093733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc628b8-0257-4e39-a1b9-4b4571faf0dd None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:32.095033 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc628b8-0257-4e39-a1b9-4b4571faf0dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:32.095340 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc628b8-0257-4e39-a1b9-4b4571faf0dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:32.096709 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc628b8-0257-4e39-a1b9-4b4571faf0dd None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:32.104529 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 578/1150] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:11:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:32.110930 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587692d-62fd-4bd5-9e3f-e4e710492eb2 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:32.207345 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587692d-62fd-4bd5-9e3f-e4e710492eb2 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:32.215668 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:32.240421 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e10339-b2ad-4336-b680-88ce54c7d136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:32.241257 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e10339-b2ad-4336-b680-88ce54c7d136 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:32.241534 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e10339-b2ad-4336-b680-88ce54c7d136 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:32.241800 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e10339-b2ad-4336-b680-88ce54c7d136 None admin] PATH_INFO: `/v3/users/f31c7108369b432c88fd8b3f0f3d50dd` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:32.242987 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e10339-b2ad-4336-b680-88ce54c7d136 None admin] RBAC: Authorizing `identity:get_user(user_id=f31c7108369b432c88fd8b3f0f3d50dd)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:32.244398 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e10339-b2ad-4336-b680-88ce54c7d136 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:32.245995 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 573/1151] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:11:32 2022] GET /identity/v3/users/f31c7108369b432c88fd8b3f0f3d50dd => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:32.251548 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc628b8-0257-4e39-a1b9-4b4571faf0dd None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:32.350420 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc628b8-0257-4e39-a1b9-4b4571faf0dd None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:32.382976 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668224f-cb4c-4110-825c-02bac5c8432e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:32.383827 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668224f-cb4c-4110-825c-02bac5c8432e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:32.384109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668224f-cb4c-4110-825c-02bac5c8432e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:32.384383 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668224f-cb4c-4110-825c-02bac5c8432e None admin] PATH_INFO: `/v3/projects/0a16ca687a814170a85a7e6e081c93a4` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:32.385543 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668224f-cb4c-4110-825c-02bac5c8432e None admin] RBAC: Authorizing `identity:get_project(project_id=0a16ca687a814170a85a7e6e081c93a4)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:32.387001 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668224f-cb4c-4110-825c-02bac5c8432e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:32.388674 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 579/1152] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:11:32 2022] GET /identity/v3/projects/0a16ca687a814170a85a7e6e081c93a4 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:32.394874 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e10339-b2ad-4336-b680-88ce54c7d136 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:32.491906 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e10339-b2ad-4336-b680-88ce54c7d136 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:32.523698 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f102d-59cf-4e73-851e-5fd719d6a268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:32.524554 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f102d-59cf-4e73-851e-5fd719d6a268 None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:32.524831 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f102d-59cf-4e73-851e-5fd719d6a268 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:32.525101 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f102d-59cf-4e73-851e-5fd719d6a268 None admin] PATH_INFO: `/v3/projects/0a16ca687a814170a85a7e6e081c93a4/users/f31c7108369b432c88fd8b3f0f3d50dd/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:32.527018 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f102d-59cf-4e73-851e-5fd719d6a268 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a16ca687a814170a85a7e6e081c93a4, user_id=f31c7108369b432c88fd8b3f0f3d50dd, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:32.528428 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f102d-59cf-4e73-851e-5fd719d6a268 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:32.541556 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 574/1153] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jun 4 08:11:32 2022] PUT /identity/v3/projects/0a16ca687a814170a85a7e6e081c93a4/users/f31c7108369b432c88fd8b3f0f3d50dd/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:11:34.748192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee58281-873a-458f-ab9d-5c3175fa7622 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:34.748750 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee58281-873a-458f-ab9d-5c3175fa7622 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:34.748750 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee58281-873a-458f-ab9d-5c3175fa7622 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:34.750130 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 580/1154] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:11:34.755354 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ab1dc-4e44-4021-902b-6341105293e7 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:34.755766 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ab1dc-4e44-4021-902b-6341105293e7 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:34.755907 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ab1dc-4e44-4021-902b-6341105293e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:34.772227 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-0d0ab1dc-4e44-4021-902b-6341105293e7 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:11:34.773396 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0d0ab1dc-4e44-4021-902b-6341105293e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:11:34.802260 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:34.840020 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 575/1155] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:11:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:11:34.863819 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee58281-873a-458f-ab9d-5c3175fa7622 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:34.866719 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:34.963852 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee58281-873a-458f-ab9d-5c3175fa7622 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:34.995957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee50d98-b990-4403-ac04-d9805e592ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:34.996733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee50d98-b990-4403-ac04-d9805e592ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:34.997012 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee50d98-b990-4403-ac04-d9805e592ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:34.997296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee50d98-b990-4403-ac04-d9805e592ee6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:35.007490 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee50d98-b990-4403-ac04-d9805e592ee6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:11:35.014931 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-cee50d98-b990-4403-ac04-d9805e592ee6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:11:35.014931 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:11:35.014931 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:11:35.014931 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:11:35.014931 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:11:35.014931 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:11:35.014931 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:11:35.014931 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:11:35.014931 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:11:35.014931 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:11:35.014931 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:11:35.014931 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:11:35.014931 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:11:35.014931 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:11:35.014931 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:11:35.014931 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:11:35.016541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:11:35.016541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:11:35.016541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:11:35.016541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:11:35.016541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:11:35.016541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:11:35.016541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:11:35.016541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:11:35.016541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:11:35.016541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:11:35.016541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:11:35.016541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:11:35.016541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:11:35.016541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:11:35.016541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:11:35.016541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:11:35.017622 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:11:35.017622 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:11:35.017622 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:11:35.017622 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:11:35.017622 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:11:35.017622 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:11:35.017622 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:11:35.017622 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:11:35.017622 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:11:35.017622 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:11:35.017622 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:11:35.017622 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:11:35.017622 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 581/1156] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:11:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:11:35.022529 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ab1dc-4e44-4021-902b-6341105293e7 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:35.117164 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ab1dc-4e44-4021-902b-6341105293e7 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:35.149343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27345e5b-7617-4eda-a042-1a44ff9dba6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:35.150020 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27345e5b-7617-4eda-a042-1a44ff9dba6a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:35.150301 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27345e5b-7617-4eda-a042-1a44ff9dba6a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:35.150573 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27345e5b-7617-4eda-a042-1a44ff9dba6a None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:35.151299 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27345e5b-7617-4eda-a042-1a44ff9dba6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:35.151600 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27345e5b-7617-4eda-a042-1a44ff9dba6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:35.152948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27345e5b-7617-4eda-a042-1a44ff9dba6a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:35.161307 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 576/1157] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:11:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:35.168117 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee50d98-b990-4403-ac04-d9805e592ee6 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:35.229118 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:35.268537 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee50d98-b990-4403-ac04-d9805e592ee6 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:35.301421 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81cd868-9207-4fd2-a9aa-75587ee9e1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:35.302312 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81cd868-9207-4fd2-a9aa-75587ee9e1eb None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:35.302594 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81cd868-9207-4fd2-a9aa-75587ee9e1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:35.302867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81cd868-9207-4fd2-a9aa-75587ee9e1eb None admin] PATH_INFO: `/v3/users/f31c7108369b432c88fd8b3f0f3d50dd` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:35.304300 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81cd868-9207-4fd2-a9aa-75587ee9e1eb None admin] RBAC: Authorizing `identity:get_user(user_id=f31c7108369b432c88fd8b3f0f3d50dd)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:35.305727 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81cd868-9207-4fd2-a9aa-75587ee9e1eb None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:35.307363 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 582/1158] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:11:35 2022] GET /identity/v3/users/f31c7108369b432c88fd8b3f0f3d50dd => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:35.313913 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27345e5b-7617-4eda-a042-1a44ff9dba6a None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:35.341671 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:35.411187 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27345e5b-7617-4eda-a042-1a44ff9dba6a None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:35.444005 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e93d2-93b7-49e8-98d1-0d758dd90b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:35.444634 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e93d2-93b7-49e8-98d1-0d758dd90b0b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:35.444914 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e93d2-93b7-49e8-98d1-0d758dd90b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:35.445185 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e93d2-93b7-49e8-98d1-0d758dd90b0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:35.511421 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e93d2-93b7-49e8-98d1-0d758dd90b0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:35.512859 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e93d2-93b7-49e8-98d1-0d758dd90b0b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:35.554133 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:35.623469 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 577/1159] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:11:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 08:11:35.629286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81cd868-9207-4fd2-a9aa-75587ee9e1eb None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:35.725157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81cd868-9207-4fd2-a9aa-75587ee9e1eb None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:35.752726 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:35.758689 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5524a-665f-4b04-ae32-9ce85810c074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:35.759543 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5524a-665f-4b04-ae32-9ce85810c074 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:35.759831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5524a-665f-4b04-ae32-9ce85810c074 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:35.760105 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5524a-665f-4b04-ae32-9ce85810c074 None admin] PATH_INFO: `/v3/projects/0a16ca687a814170a85a7e6e081c93a4` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:35.761274 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5524a-665f-4b04-ae32-9ce85810c074 None admin] RBAC: Authorizing `identity:get_project(project_id=0a16ca687a814170a85a7e6e081c93a4)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:35.762729 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5524a-665f-4b04-ae32-9ce85810c074 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:35.764418 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 583/1160] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:11:35 2022] GET /identity/v3/projects/0a16ca687a814170a85a7e6e081c93a4 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:35.770991 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e93d2-93b7-49e8-98d1-0d758dd90b0b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:35.868842 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e93d2-93b7-49e8-98d1-0d758dd90b0b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:35.894213 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:35.902221 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c405b2-104a-4c98-976a-ddcc7fd98c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:35.902863 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c405b2-104a-4c98-976a-ddcc7fd98c5a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:35.903146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c405b2-104a-4c98-976a-ddcc7fd98c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:35.903420 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c405b2-104a-4c98-976a-ddcc7fd98c5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:35.904230 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c405b2-104a-4c98-976a-ddcc7fd98c5a None admin] RBAC: Adding query filter params (role.id=431cef539cfb476aad50d2470e763b5f, scope.project.id=0a16ca687a814170a85a7e6e081c93a4, user.id=f31c7108369b432c88fd8b3f0f3d50dd) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:35.904538 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c405b2-104a-4c98-976a-ddcc7fd98c5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:35.905992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c405b2-104a-4c98-976a-ddcc7fd98c5a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:35.912399 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 578/1161] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:11:35 2022] GET /identity/v3/role_assignments?user.id=f31c7108369b432c88fd8b3f0f3d50dd&scope.project.id=0a16ca687a814170a85a7e6e081c93a4&role.id=431cef539cfb476aad50d2470e763b5f => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:38.143508 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c0b87-b3af-474b-9aae-5e9e8c81eab7 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:38.144095 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c0b87-b3af-474b-9aae-5e9e8c81eab7 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:38.144095 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c0b87-b3af-474b-9aae-5e9e8c81eab7 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:38.145428 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 584/1162] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:11:38.150519 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982818a-2a43-4db6-a7d6-4c24a41e3ced None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:38.150916 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982818a-2a43-4db6-a7d6-4c24a41e3ced None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:38.151067 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982818a-2a43-4db6-a7d6-4c24a41e3ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:38.167294 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-3982818a-2a43-4db6-a7d6-4c24a41e3ced None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:11:38.168390 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-3982818a-2a43-4db6-a7d6-4c24a41e3ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:11:38.232234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 579/1163] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:11:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:11:38.254830 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c0b87-b3af-474b-9aae-5e9e8c81eab7 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:38.352914 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c0b87-b3af-474b-9aae-5e9e8c81eab7 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:38.386138 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f25f77-abcb-46c1-b2e8-2fcaaf66e104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:38.386773 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f25f77-abcb-46c1-b2e8-2fcaaf66e104 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:38.387058 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f25f77-abcb-46c1-b2e8-2fcaaf66e104 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:38.387338 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f25f77-abcb-46c1-b2e8-2fcaaf66e104 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:38.449669 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:38.452750 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f25f77-abcb-46c1-b2e8-2fcaaf66e104 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:38.454631 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f25f77-abcb-46c1-b2e8-2fcaaf66e104 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:38.554451 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 585/1164] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:11:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 08:11:38.560550 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982818a-2a43-4db6-a7d6-4c24a41e3ced None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:38.656072 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982818a-2a43-4db6-a7d6-4c24a41e3ced None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:38.689973 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:38.701874 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eff173-8358-430e-aa3d-e2b6f6707b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:38.702623 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eff173-8358-430e-aa3d-e2b6f6707b8e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:38.702902 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eff173-8358-430e-aa3d-e2b6f6707b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:38.703174 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eff173-8358-430e-aa3d-e2b6f6707b8e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:38.709805 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eff173-8358-430e-aa3d-e2b6f6707b8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:38.711259 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eff173-8358-430e-aa3d-e2b6f6707b8e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:38.725806 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-89eff173-8358-430e-aa3d-e2b6f6707b8e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 04 08:11:38.725806 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:11:38.725806 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 04 08:11:38.725806 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 04 08:11:38.725806 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:11:38.725806 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:11:38.725806 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:11:38.725806 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:11:38.725806 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 04 08:11:38.725806 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:11:38.725806 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 08:11:38.725806 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:11:38.725806 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:11:38.725806 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:11:38.725806 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:11:38.725806 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:11:38.725806 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:11:38.727070 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:11:38.727070 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:11:38.727070 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:11:38.727070 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:11:38.727070 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:11:38.727070 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:11:38.727070 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:11:38.727070 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:11:38.727070 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:11:38.727070 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:11:38.727070 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:11:38.727070 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:11:38.727070 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:11:38.727070 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:11:38.727070 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:11:38.727070 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:11:38.728007 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:11:38.728007 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:11:38.728007 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:11:38.728007 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:11:38.728007 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:11:38.728007 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:11:38.728007 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:11:38.728007 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:11:38.728007 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:11:38.728007 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:11:38.728007 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 04 08:11:38.728007 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:11:38.728007 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 04 08:11:38.728007 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:11:38.728007 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 580/1165] 10.222.0.57 () {56 vars in 1117 bytes} [Sat Jun 4 08:11:38 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:11:38.732894 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f25f77-abcb-46c1-b2e8-2fcaaf66e104 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:38.825165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:38.829707 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f25f77-abcb-46c1-b2e8-2fcaaf66e104 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:38.866427 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2fcf0b-41eb-4f4f-9204-d8eef3920060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:38.867084 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fcf0b-41eb-4f4f-9204-d8eef3920060 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:38.867365 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fcf0b-41eb-4f4f-9204-d8eef3920060 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:38.867640 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fcf0b-41eb-4f4f-9204-d8eef3920060 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:38.868355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2fcf0b-41eb-4f4f-9204-d8eef3920060 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:38.868660 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2fcf0b-41eb-4f4f-9204-d8eef3920060 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:38.870062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2fcf0b-41eb-4f4f-9204-d8eef3920060 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:38.877717 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 586/1166] 10.222.0.57 () {56 vars in 1115 bytes} [Sat Jun 4 08:11:38 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:41.078785 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375b9d2-c8ee-4ec9-8fd7-6ef6a86696b8 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:41.079333 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375b9d2-c8ee-4ec9-8fd7-6ef6a86696b8 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:41.079333 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375b9d2-c8ee-4ec9-8fd7-6ef6a86696b8 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:41.080711 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 581/1167] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:11:41.085791 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb482050-ccf3-4908-a6ab-4a408650d6d4 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:41.086227 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb482050-ccf3-4908-a6ab-4a408650d6d4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:41.086388 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb482050-ccf3-4908-a6ab-4a408650d6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:41.102694 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-bb482050-ccf3-4908-a6ab-4a408650d6d4 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:11:41.103881 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-bb482050-ccf3-4908-a6ab-4a408650d6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:11:41.168375 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 587/1168] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:11:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:11:41.192120 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375b9d2-c8ee-4ec9-8fd7-6ef6a86696b8 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:41.290850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375b9d2-c8ee-4ec9-8fd7-6ef6a86696b8 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:41.324371 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd3d81-ddf1-46dd-b5dc-75523f02cbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:41.325007 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd3d81-ddf1-46dd-b5dc-75523f02cbd4 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:41.325291 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd3d81-ddf1-46dd-b5dc-75523f02cbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:41.325567 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd3d81-ddf1-46dd-b5dc-75523f02cbd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:41.326344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd3d81-ddf1-46dd-b5dc-75523f02cbd4 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:41.327699 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd3d81-ddf1-46dd-b5dc-75523f02cbd4 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:41.341797 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 582/1169] 10.222.0.57 () {60 vars in 1138 bytes} [Sat Jun 4 08:11:41 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:11:43.583325 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2179e79-456e-4a14-ab77-dfc59f159eb1 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:43.583891 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2179e79-456e-4a14-ab77-dfc59f159eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:43.583891 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2179e79-456e-4a14-ab77-dfc59f159eb1 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:43.585259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 588/1170] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:11:43.590778 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db93855-2b2a-4a53-b879-c8aab5e14c7a None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:43.591155 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db93855-2b2a-4a53-b879-c8aab5e14c7a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:43.591346 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db93855-2b2a-4a53-b879-c8aab5e14c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:43.607696 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-0db93855-2b2a-4a53-b879-c8aab5e14c7a None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:11:43.608909 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0db93855-2b2a-4a53-b879-c8aab5e14c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:11:43.643480 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:43.674572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 583/1171] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:11:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:11:43.698461 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2179e79-456e-4a14-ab77-dfc59f159eb1 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:43.787249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:43.796746 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2179e79-456e-4a14-ab77-dfc59f159eb1 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:43.830286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e82ecb-715f-493c-8f4f-0263c5f79a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:43.831130 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e82ecb-715f-493c-8f4f-0263c5f79a23 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:43.831415 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e82ecb-715f-493c-8f4f-0263c5f79a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:43.831691 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e82ecb-715f-493c-8f4f-0263c5f79a23 None admin] PATH_INFO: `/v3/domains/58018368f93e4ee7af270f231553c53b` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:43.841856 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e82ecb-715f-493c-8f4f-0263c5f79a23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=58018368f93e4ee7af270f231553c53b)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:43.843262 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e82ecb-715f-493c-8f4f-0263c5f79a23 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:43.844941 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 589/1172] 10.222.0.57 () {56 vars in 1183 bytes} [Sat Jun 4 08:11:43 2022] GET /identity/v3/domains/58018368f93e4ee7af270f231553c53b => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:43.850845 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db93855-2b2a-4a53-b879-c8aab5e14c7a None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:43.949219 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db93855-2b2a-4a53-b879-c8aab5e14c7a None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:43.982167 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38933ded-a640-4a51-9704-3e4355baf763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:43.982818 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38933ded-a640-4a51-9704-3e4355baf763 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:43.983103 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38933ded-a640-4a51-9704-3e4355baf763 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:43.983379 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38933ded-a640-4a51-9704-3e4355baf763 None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:43.984133 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38933ded-a640-4a51-9704-3e4355baf763 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:43.986097 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38933ded-a640-4a51-9704-3e4355baf763 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:44.010526 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 584/1173] 10.222.0.57 () {60 vars in 1141 bytes} [Sat Jun 4 08:11:43 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:11:46.233014 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2731beb-7993-4a46-a208-8c680b3eb9a0 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:46.233529 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2731beb-7993-4a46-a208-8c680b3eb9a0 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:46.233529 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2731beb-7993-4a46-a208-8c680b3eb9a0 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:46.234894 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 590/1174] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:11:46.240088 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c8dc0-507e-47cc-aa6d-caeb3f4650a3 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:46.240505 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c8dc0-507e-47cc-aa6d-caeb3f4650a3 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:46.240636 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c8dc0-507e-47cc-aa6d-caeb3f4650a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:46.257442 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-ce2c8dc0-507e-47cc-aa6d-caeb3f4650a3 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:11:46.258651 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ce2c8dc0-507e-47cc-aa6d-caeb3f4650a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:11:46.275873 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:46.324626 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 585/1175] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:11:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:11:46.348738 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2731beb-7993-4a46-a208-8c680b3eb9a0 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:46.447838 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2731beb-7993-4a46-a208-8c680b3eb9a0 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:46.479564 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea4480-42d5-406f-ac8b-acb7ba40c376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:46.480412 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea4480-42d5-406f-ac8b-acb7ba40c376 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:46.480697 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea4480-42d5-406f-ac8b-acb7ba40c376 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:46.480973 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea4480-42d5-406f-ac8b-acb7ba40c376 None admin] PATH_INFO: `/v3/domains/58018368f93e4ee7af270f231553c53b` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:46.482179 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea4480-42d5-406f-ac8b-acb7ba40c376 None admin] RBAC: Authorizing `identity:get_domain(domain_id=58018368f93e4ee7af270f231553c53b)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:46.483656 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea4480-42d5-406f-ac8b-acb7ba40c376 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:46.486470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 591/1176] 10.222.0.57 () {56 vars in 1183 bytes} [Sat Jun 4 08:11:46 2022] GET /identity/v3/domains/58018368f93e4ee7af270f231553c53b => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:46.492001 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c8dc0-507e-47cc-aa6d-caeb3f4650a3 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:46.588922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c8dc0-507e-47cc-aa6d-caeb3f4650a3 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:46.621817 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc80cb9-ec43-46ac-9c76-b6e9589d88b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:46.622492 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc80cb9-ec43-46ac-9c76-b6e9589d88b9 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:46.622774 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc80cb9-ec43-46ac-9c76-b6e9589d88b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:46.623047 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc80cb9-ec43-46ac-9c76-b6e9589d88b9 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:46.623757 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc80cb9-ec43-46ac-9c76-b6e9589d88b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:46.625773 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc80cb9-ec43-46ac-9c76-b6e9589d88b9 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:46.644373 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 586/1177] 10.222.0.57 () {60 vars in 1132 bytes} [Sat Jun 4 08:11:46 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:11:48.887715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad723007-6be9-40f4-823e-6a48b1ee5f81 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:48.888276 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad723007-6be9-40f4-823e-6a48b1ee5f81 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:48.888276 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad723007-6be9-40f4-823e-6a48b1ee5f81 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:48.889607 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 592/1178] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:11:48.895522 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca18402-0009-4e35-8317-731bb2cb0b20 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:48.897197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca18402-0009-4e35-8317-731bb2cb0b20 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:48.897488 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca18402-0009-4e35-8317-731bb2cb0b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:48.919928 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-1ca18402-0009-4e35-8317-731bb2cb0b20 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:11:48.921120 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1ca18402-0009-4e35-8317-731bb2cb0b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:11:48.924586 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:48.989056 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 587/1179] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:11:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:11:49.012696 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad723007-6be9-40f4-823e-6a48b1ee5f81 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:49.034178 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:49.111844 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad723007-6be9-40f4-823e-6a48b1ee5f81 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:49.144734 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31029fc-d2cf-451a-8a5c-5a44e6711322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:49.145444 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31029fc-d2cf-451a-8a5c-5a44e6711322 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:49.145720 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31029fc-d2cf-451a-8a5c-5a44e6711322 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:49.146015 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31029fc-d2cf-451a-8a5c-5a44e6711322 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:49.156884 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31029fc-d2cf-451a-8a5c-5a44e6711322 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:11:49.164423 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-a31029fc-d2cf-451a-8a5c-5a44e6711322 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:11:49.164423 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:11:49.164423 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:11:49.164423 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:11:49.164423 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:11:49.164423 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:11:49.164423 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:11:49.164423 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:11:49.164423 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:11:49.164423 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:11:49.164423 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:11:49.164423 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:11:49.164423 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:11:49.164423 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:11:49.164423 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:11:49.164423 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:11:49.165557 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:11:49.165557 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:11:49.165557 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:11:49.165557 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:11:49.165557 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:11:49.165557 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:11:49.165557 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:11:49.165557 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:11:49.165557 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:11:49.165557 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:11:49.165557 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:11:49.165557 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:11:49.165557 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:11:49.165557 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:11:49.165557 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:11:49.165557 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:11:49.166824 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:11:49.166824 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:11:49.166824 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:11:49.166824 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:11:49.166824 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:11:49.166824 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:11:49.166824 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:11:49.166824 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:11:49.166824 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:11:49.166824 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:11:49.166824 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:11:49.166824 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:11:49.166824 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 593/1180] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:11:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:11:49.171475 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca18402-0009-4e35-8317-731bb2cb0b20 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:49.269978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca18402-0009-4e35-8317-731bb2cb0b20 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:49.302997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b48fd-c8eb-4d6d-96d2-ac206c6e9f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:49.303904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b48fd-c8eb-4d6d-96d2-ac206c6e9f36 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:49.304186 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b48fd-c8eb-4d6d-96d2-ac206c6e9f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:49.304460 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b48fd-c8eb-4d6d-96d2-ac206c6e9f36 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:49.305194 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b48fd-c8eb-4d6d-96d2-ac206c6e9f36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:49.305497 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b48fd-c8eb-4d6d-96d2-ac206c6e9f36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:49.306895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b48fd-c8eb-4d6d-96d2-ac206c6e9f36 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:49.315315 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 588/1181] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:11:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:49.321042 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31029fc-d2cf-451a-8a5c-5a44e6711322 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:49.397782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:49.416861 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31029fc-d2cf-451a-8a5c-5a44e6711322 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:49.449667 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338b028-18fb-4225-9a08-bc0a63dddbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:49.450550 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338b028-18fb-4225-9a08-bc0a63dddbd0 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:49.450837 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338b028-18fb-4225-9a08-bc0a63dddbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:49.451112 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338b028-18fb-4225-9a08-bc0a63dddbd0 None admin] PATH_INFO: `/v3/users/c4fef2a85d4f425eb7596346295145ff` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:49.463664 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338b028-18fb-4225-9a08-bc0a63dddbd0 None admin] RBAC: Authorizing `identity:get_user(user_id=c4fef2a85d4f425eb7596346295145ff)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:49.465096 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338b028-18fb-4225-9a08-bc0a63dddbd0 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:49.466750 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 594/1182] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:11:49 2022] GET /identity/v3/users/c4fef2a85d4f425eb7596346295145ff => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:49.472847 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b48fd-c8eb-4d6d-96d2-ac206c6e9f36 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:49.475704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:49.576109 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b48fd-c8eb-4d6d-96d2-ac206c6e9f36 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:49.608466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69c336-1ca0-4cd6-845a-f9226c7b4801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:49.609112 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69c336-1ca0-4cd6-845a-f9226c7b4801 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:49.609960 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69c336-1ca0-4cd6-845a-f9226c7b4801 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:49.610241 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69c336-1ca0-4cd6-845a-f9226c7b4801 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:49.674544 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69c336-1ca0-4cd6-845a-f9226c7b4801 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:49.675922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69c336-1ca0-4cd6-845a-f9226c7b4801 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:49.677674 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:49.772171 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 589/1183] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:11:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 08:11:49.778043 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338b028-18fb-4225-9a08-bc0a63dddbd0 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:49.873687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338b028-18fb-4225-9a08-bc0a63dddbd0 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:49.906903 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b7fcf-a208-4211-b804-ffbf79448d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:49.907747 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b7fcf-a208-4211-b804-ffbf79448d3e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:49.908027 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b7fcf-a208-4211-b804-ffbf79448d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:49.908299 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b7fcf-a208-4211-b804-ffbf79448d3e None admin] PATH_INFO: `/v3/projects/aaa6ad78b41b43b8ae5d8e665159e060` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:49.909470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b7fcf-a208-4211-b804-ffbf79448d3e None admin] RBAC: Authorizing `identity:get_project(project_id=aaa6ad78b41b43b8ae5d8e665159e060)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:49.910942 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b7fcf-a208-4211-b804-ffbf79448d3e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:49.912651 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 595/1184] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:11:49 2022] GET /identity/v3/projects/aaa6ad78b41b43b8ae5d8e665159e060 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:49.918775 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69c336-1ca0-4cd6-845a-f9226c7b4801 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:50.015121 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69c336-1ca0-4cd6-845a-f9226c7b4801 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:50.017229 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:50.049356 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b4ca8-5cac-4fad-947c-1df9613ae660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:50.050012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b4ca8-5cac-4fad-947c-1df9613ae660 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:50.050300 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b4ca8-5cac-4fad-947c-1df9613ae660 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:50.050557 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b4ca8-5cac-4fad-947c-1df9613ae660 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:50.051361 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b4ca8-5cac-4fad-947c-1df9613ae660 None admin] RBAC: Adding query filter params (role.id=431cef539cfb476aad50d2470e763b5f, scope.project.id=aaa6ad78b41b43b8ae5d8e665159e060, user.id=c4fef2a85d4f425eb7596346295145ff) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:50.051662 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b4ca8-5cac-4fad-947c-1df9613ae660 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:50.053069 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b4ca8-5cac-4fad-947c-1df9613ae660 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:50.058573 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 590/1185] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:11:49 2022] GET /identity/v3/role_assignments?user.id=c4fef2a85d4f425eb7596346295145ff&scope.project.id=aaa6ad78b41b43b8ae5d8e665159e060&role.id=431cef539cfb476aad50d2470e763b5f => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:52.270498 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20af7f2-c217-4967-b493-dd44a62b7fee None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:52.271037 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20af7f2-c217-4967-b493-dd44a62b7fee None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:52.271037 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20af7f2-c217-4967-b493-dd44a62b7fee None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:52.272406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 596/1186] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:11:52.277557 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74967533-ef30-49b4-9c26-bb90bb49e2c1 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:52.277977 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74967533-ef30-49b4-9c26-bb90bb49e2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:52.278137 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74967533-ef30-49b4-9c26-bb90bb49e2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:52.294982 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-74967533-ef30-49b4-9c26-bb90bb49e2c1 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:11:52.296135 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-74967533-ef30-49b4-9c26-bb90bb49e2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:11:52.360097 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 591/1187] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:11:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:11:52.382564 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20af7f2-c217-4967-b493-dd44a62b7fee None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:52.391909 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:52.482135 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20af7f2-c217-4967-b493-dd44a62b7fee None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:52.514653 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160265b7-44e7-41a9-9a1b-aebe34fccc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:52.516022 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160265b7-44e7-41a9-9a1b-aebe34fccc4f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:52.516306 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160265b7-44e7-41a9-9a1b-aebe34fccc4f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:52.516582 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160265b7-44e7-41a9-9a1b-aebe34fccc4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:52.526679 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160265b7-44e7-41a9-9a1b-aebe34fccc4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:11:52.534257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-160265b7-44e7-41a9-9a1b-aebe34fccc4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:11:52.534257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:11:52.534257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:11:52.534257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:11:52.534257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:11:52.534257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:11:52.534257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:11:52.534257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:11:52.534257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:11:52.534257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:11:52.534257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:11:52.534257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:11:52.534257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:11:52.534257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:11:52.534257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:11:52.534257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:11:52.535332 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:11:52.535332 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:11:52.535332 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:11:52.535332 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:11:52.535332 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:11:52.535332 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:11:52.535332 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:11:52.535332 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:11:52.535332 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:11:52.535332 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:11:52.535332 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:11:52.535332 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:11:52.535332 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:11:52.535332 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:11:52.535332 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:11:52.535332 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:11:52.540939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:11:52.540939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:11:52.540939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:11:52.540939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:11:52.540939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:11:52.540939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:11:52.540939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:11:52.540939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:11:52.540939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:11:52.540939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:11:52.540939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:11:52.540939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:11:52.540939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 597/1188] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:11:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:11:52.541814 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74967533-ef30-49b4-9c26-bb90bb49e2c1 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:52.631321 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:52.637387 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74967533-ef30-49b4-9c26-bb90bb49e2c1 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:52.670647 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb61735-e743-4316-ad5a-1fac09cfe5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:52.671307 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb61735-e743-4316-ad5a-1fac09cfe5cf None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:52.672120 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb61735-e743-4316-ad5a-1fac09cfe5cf None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:52.672396 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb61735-e743-4316-ad5a-1fac09cfe5cf None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:52.673129 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb61735-e743-4316-ad5a-1fac09cfe5cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:52.673434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb61735-e743-4316-ad5a-1fac09cfe5cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:52.674823 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb61735-e743-4316-ad5a-1fac09cfe5cf None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:52.683117 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 592/1189] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:11:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:11:52.689541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160265b7-44e7-41a9-9a1b-aebe34fccc4f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:52.755640 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:52.789490 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160265b7-44e7-41a9-9a1b-aebe34fccc4f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:52.822222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be01ac-bcb3-418a-a011-c14b99eb58df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:52.823077 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be01ac-bcb3-418a-a011-c14b99eb58df None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:52.823357 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be01ac-bcb3-418a-a011-c14b99eb58df None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:52.823628 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be01ac-bcb3-418a-a011-c14b99eb58df None admin] PATH_INFO: `/v3/users/c4fef2a85d4f425eb7596346295145ff` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:52.824796 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be01ac-bcb3-418a-a011-c14b99eb58df None admin] RBAC: Authorizing `identity:get_user(user_id=c4fef2a85d4f425eb7596346295145ff)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:52.826249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be01ac-bcb3-418a-a011-c14b99eb58df None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:52.827873 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 598/1190] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:11:52 2022] GET /identity/v3/users/c4fef2a85d4f425eb7596346295145ff => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:52.833652 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb61735-e743-4316-ad5a-1fac09cfe5cf None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:52.934792 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb61735-e743-4316-ad5a-1fac09cfe5cf None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:52.967401 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e5aa7-f5fc-49f3-be39-d3c90c9e2a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:52.968254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e5aa7-f5fc-49f3-be39-d3c90c9e2a48 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:52.968536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e5aa7-f5fc-49f3-be39-d3c90c9e2a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:52.968814 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e5aa7-f5fc-49f3-be39-d3c90c9e2a48 None admin] PATH_INFO: `/v3/projects/aaa6ad78b41b43b8ae5d8e665159e060` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:52.970020 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e5aa7-f5fc-49f3-be39-d3c90c9e2a48 None admin] RBAC: Authorizing `identity:get_project(project_id=aaa6ad78b41b43b8ae5d8e665159e060)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:52.971454 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e5aa7-f5fc-49f3-be39-d3c90c9e2a48 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:52.973137 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 593/1191] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:11:52 2022] GET /identity/v3/projects/aaa6ad78b41b43b8ae5d8e665159e060 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:52.978956 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be01ac-bcb3-418a-a011-c14b99eb58df None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:53.075301 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be01ac-bcb3-418a-a011-c14b99eb58df None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:53.107258 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27eccd-c896-4427-84e6-d1ca299bb83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:53.108130 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27eccd-c896-4427-84e6-d1ca299bb83e None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:53.108408 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27eccd-c896-4427-84e6-d1ca299bb83e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:53.108678 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27eccd-c896-4427-84e6-d1ca299bb83e None admin] PATH_INFO: `/v3/projects/aaa6ad78b41b43b8ae5d8e665159e060/users/c4fef2a85d4f425eb7596346295145ff/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:53.111211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27eccd-c896-4427-84e6-d1ca299bb83e None admin] RBAC: Authorizing `identity:create_grant(project_id=aaa6ad78b41b43b8ae5d8e665159e060, user_id=c4fef2a85d4f425eb7596346295145ff, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:53.112626 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27eccd-c896-4427-84e6-d1ca299bb83e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:53.114753 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:53.125409 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 599/1192] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jun 4 08:11:52 2022] PUT /identity/v3/projects/aaa6ad78b41b43b8ae5d8e665159e060/users/c4fef2a85d4f425eb7596346295145ff/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:11:55.346150 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08818d1-f3f0-43cf-a9e7-94bd600474b7 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:55.346675 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08818d1-f3f0-43cf-a9e7-94bd600474b7 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:55.346762 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08818d1-f3f0-43cf-a9e7-94bd600474b7 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:55.348066 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 594/1193] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:11:55.353392 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8835fab-3436-423b-bedf-cbb108242f88 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:55.353807 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8835fab-3436-423b-bedf-cbb108242f88 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:55.353997 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8835fab-3436-423b-bedf-cbb108242f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:55.371638 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-a8835fab-3436-423b-bedf-cbb108242f88 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:11:55.372811 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a8835fab-3436-423b-bedf-cbb108242f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:11:55.437197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 600/1194] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:11:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:11:55.460446 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08818d1-f3f0-43cf-a9e7-94bd600474b7 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:55.488505 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:55.565043 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08818d1-f3f0-43cf-a9e7-94bd600474b7 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:55.598307 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e2dc4-2664-4e77-9e06-6bf6b8d4cb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:55.599025 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e2dc4-2664-4e77-9e06-6bf6b8d4cb69 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:55.599305 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e2dc4-2664-4e77-9e06-6bf6b8d4cb69 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:55.599571 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e2dc4-2664-4e77-9e06-6bf6b8d4cb69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:55.609304 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e2dc4-2664-4e77-9e06-6bf6b8d4cb69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:11:55.617439 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-826e2dc4-2664-4e77-9e06-6bf6b8d4cb69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:11:55.617439 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:11:55.617439 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:11:55.617439 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:11:55.617439 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:11:55.617439 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:11:55.617439 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:11:55.617439 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:11:55.617439 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:11:55.617439 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:11:55.617439 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:11:55.617439 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:11:55.617439 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:11:55.617439 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:11:55.617439 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:11:55.617439 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:11:55.618587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:11:55.618587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:11:55.618587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:11:55.618587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:11:55.618587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:11:55.618587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:11:55.618587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:11:55.618587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:11:55.618587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:11:55.618587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:11:55.618587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:11:55.618587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:11:55.618587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:11:55.618587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:11:55.618587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:11:55.618587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:11:55.619494 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:11:55.619494 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:11:55.619494 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:11:55.619494 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:11:55.619494 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:11:55.619494 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:11:55.619494 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:11:55.619494 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:11:55.619494 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:11:55.619494 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:11:55.619494 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:11:55.619494 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:11:55.619494 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 595/1195] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:11:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:11:55.624685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8835fab-3436-423b-bedf-cbb108242f88 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:55.720642 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8835fab-3436-423b-bedf-cbb108242f88 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:55.742603 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:55.753524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447f322-d8b4-4870-afba-16f54a209c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:55.754209 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447f322-d8b4-4870-afba-16f54a209c02 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:55.754492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447f322-d8b4-4870-afba-16f54a209c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:55.754763 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447f322-d8b4-4870-afba-16f54a209c02 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:55.755487 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447f322-d8b4-4870-afba-16f54a209c02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:55.755784 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447f322-d8b4-4870-afba-16f54a209c02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:55.757132 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447f322-d8b4-4870-afba-16f54a209c02 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:55.764826 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 601/1196] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:11:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:55.770945 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e2dc4-2664-4e77-9e06-6bf6b8d4cb69 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:55.853352 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:55.867950 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e2dc4-2664-4e77-9e06-6bf6b8d4cb69 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:55.900122 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7795e96-7cb0-42c8-903c-5e715986a182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:55.900967 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7795e96-7cb0-42c8-903c-5e715986a182 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:55.901249 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7795e96-7cb0-42c8-903c-5e715986a182 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:55.901522 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7795e96-7cb0-42c8-903c-5e715986a182 None admin] PATH_INFO: `/v3/users/c4fef2a85d4f425eb7596346295145ff` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:55.902720 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7795e96-7cb0-42c8-903c-5e715986a182 None admin] RBAC: Authorizing `identity:get_user(user_id=c4fef2a85d4f425eb7596346295145ff)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:55.904144 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7795e96-7cb0-42c8-903c-5e715986a182 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:55.905725 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 596/1197] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jun 4 08:11:55 2022] GET /identity/v3/users/c4fef2a85d4f425eb7596346295145ff => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:55.911994 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447f322-d8b4-4870-afba-16f54a209c02 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:56.009047 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447f322-d8b4-4870-afba-16f54a209c02 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:56.041408 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500cb844-8eec-41eb-b7e7-6d10815e0bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:56.042078 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cb844-8eec-41eb-b7e7-6d10815e0bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:56.042364 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cb844-8eec-41eb-b7e7-6d10815e0bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:56.042647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cb844-8eec-41eb-b7e7-6d10815e0bf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:56.095109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:56.108388 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500cb844-8eec-41eb-b7e7-6d10815e0bf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:56.109769 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500cb844-8eec-41eb-b7e7-6d10815e0bf1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:56.203345 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 602/1198] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:11:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 04 08:11:56.209728 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7795e96-7cb0-42c8-903c-5e715986a182 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:56.305500 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7795e96-7cb0-42c8-903c-5e715986a182 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:56.338564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e779d-3e82-4508-b511-a519e1a5e3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:56.339404 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e779d-3e82-4508-b511-a519e1a5e3fb None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:56.339686 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e779d-3e82-4508-b511-a519e1a5e3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:56.339962 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e779d-3e82-4508-b511-a519e1a5e3fb None admin] PATH_INFO: `/v3/projects/aaa6ad78b41b43b8ae5d8e665159e060` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:56.341118 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e779d-3e82-4508-b511-a519e1a5e3fb None admin] RBAC: Authorizing `identity:get_project(project_id=aaa6ad78b41b43b8ae5d8e665159e060)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:56.342570 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e779d-3e82-4508-b511-a519e1a5e3fb None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:56.344211 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 597/1199] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jun 4 08:11:56 2022] GET /identity/v3/projects/aaa6ad78b41b43b8ae5d8e665159e060 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:11:56.350156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500cb844-8eec-41eb-b7e7-6d10815e0bf1 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:11:56.434834 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:11:56.449939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500cb844-8eec-41eb-b7e7-6d10815e0bf1 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:11:56.482297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfc0fb-ee1b-41a4-9739-ee926abd02bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:11:56.482940 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfc0fb-ee1b-41a4-9739-ee926abd02bd None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:11:56.483223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfc0fb-ee1b-41a4-9739-ee926abd02bd None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:11:56.483499 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfc0fb-ee1b-41a4-9739-ee926abd02bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:11:56.484321 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfc0fb-ee1b-41a4-9739-ee926abd02bd None admin] RBAC: Adding query filter params (role.id=431cef539cfb476aad50d2470e763b5f, scope.project.id=aaa6ad78b41b43b8ae5d8e665159e060, user.id=c4fef2a85d4f425eb7596346295145ff) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:11:56.484632 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfc0fb-ee1b-41a4-9739-ee926abd02bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:11:56.487350 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfc0fb-ee1b-41a4-9739-ee926abd02bd None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:11:56.493057 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 603/1200] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:11:56 2022] GET /identity/v3/role_assignments?user.id=c4fef2a85d4f425eb7596346295145ff&scope.project.id=aaa6ad78b41b43b8ae5d8e665159e060&role.id=431cef539cfb476aad50d2470e763b5f => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:12:06.334483 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:12:06.490452 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=25 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:12:56.832573 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ede6ce-929e-4b53-b9b5-15b395bb271e None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:12:56.833263 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ede6ce-929e-4b53-b9b5-15b395bb271e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:12:56.833263 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ede6ce-929e-4b53-b9b5-15b395bb271e None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:12:56.834559 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 598/1201] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:12:56.840052 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92870d-40c5-4c60-a480-22788ac16e45 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:12:56.840546 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92870d-40c5-4c60-a480-22788ac16e45 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:12:56.840632 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92870d-40c5-4c60-a480-22788ac16e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:12:56.861868 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-0a92870d-40c5-4c60-a480-22788ac16e45 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:12:56.861868 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0a92870d-40c5-4c60-a480-22788ac16e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:12:56.943297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 604/1202] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:12:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:12:56.967098 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ede6ce-929e-4b53-b9b5-15b395bb271e None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:12:57.100384 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ede6ce-929e-4b53-b9b5-15b395bb271e None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:12:57.153689 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f671f-778a-4a77-aee3-8ea8354fcec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:12:57.160156 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f671f-778a-4a77-aee3-8ea8354fcec2 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:12:57.160156 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f671f-778a-4a77-aee3-8ea8354fcec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:12:57.160156 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f671f-778a-4a77-aee3-8ea8354fcec2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:12:57.172659 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f671f-778a-4a77-aee3-8ea8354fcec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:12:57.174832 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f671f-778a-4a77-aee3-8ea8354fcec2 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:12:57.203715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-d33f671f-778a-4a77-aee3-8ea8354fcec2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:12:57.203715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:12:57.203715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:12:57.203715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:12:57.203715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:12:57.203715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:12:57.203715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:12:57.203715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:12:57.203715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:12:57.203715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:12:57.203715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:12:57.203715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:12:57.203715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:12:57.203715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:12:57.203715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:12:57.205710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:12:57.205710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:12:57.205710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:12:57.205710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:12:57.205710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:12:57.205710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:12:57.205710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:12:57.205710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:12:57.205710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:12:57.205710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:12:57.205710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:12:57.205710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:12:57.205710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:12:57.205710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:12:57.205710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:12:57.205710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:12:57.205710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:12:57.207887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:12:57.207887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:12:57.207887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:12:57.207887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:12:57.211283 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 599/1203] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:12:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:12:57.217171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92870d-40c5-4c60-a480-22788ac16e45 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:12:57.348565 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92870d-40c5-4c60-a480-22788ac16e45 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:12:57.388761 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:12:57.395310 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cdf240-aa8d-486a-9fea-68bc331d3910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:12:57.396133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdf240-aa8d-486a-9fea-68bc331d3910 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:12:57.396533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdf240-aa8d-486a-9fea-68bc331d3910 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:12:57.396810 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdf240-aa8d-486a-9fea-68bc331d3910 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:12:57.397614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cdf240-aa8d-486a-9fea-68bc331d3910 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:12:57.397952 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cdf240-aa8d-486a-9fea-68bc331d3910 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:12:57.399507 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cdf240-aa8d-486a-9fea-68bc331d3910 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:12:57.414826 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 605/1204] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:12:57.421338 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f671f-778a-4a77-aee3-8ea8354fcec2 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:12:57.493655 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:12:57.555315 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f671f-778a-4a77-aee3-8ea8354fcec2 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:12:57.599102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b3541-6e82-486e-a209-f2b8f3595cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:12:57.599779 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b3541-6e82-486e-a209-f2b8f3595cb3 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:12:57.600061 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b3541-6e82-486e-a209-f2b8f3595cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:12:57.600338 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b3541-6e82-486e-a209-f2b8f3595cb3 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:12:57.601059 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b3541-6e82-486e-a209-f2b8f3595cb3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:12:57.602542 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b3541-6e82-486e-a209-f2b8f3595cb3 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:12:57.626737 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 600/1205] 10.222.0.57 () {60 vars in 1132 bytes} [Sat Jun 4 08:12:57 2022] POST /identity/v3/users => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:13:00.003918 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84446a-cf41-450d-bcbf-07d149a9ae55 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:00.004799 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84446a-cf41-450d-bcbf-07d149a9ae55 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:00.004799 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84446a-cf41-450d-bcbf-07d149a9ae55 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:00.006385 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 606/1206] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:13:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:13:00.012458 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a6b8a-6826-468c-8979-a01da88d8a97 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:00.013150 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a6b8a-6826-468c-8979-a01da88d8a97 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:00.013385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a6b8a-6826-468c-8979-a01da88d8a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:00.035381 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-f91a6b8a-6826-468c-8979-a01da88d8a97 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:13:00.036696 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f91a6b8a-6826-468c-8979-a01da88d8a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:13:00.116529 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 601/1207] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:13:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:13:00.140696 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84446a-cf41-450d-bcbf-07d149a9ae55 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:00.262524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84446a-cf41-450d-bcbf-07d149a9ae55 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:00.303954 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e777c-f74a-4dc9-b15e-a12809bc0759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:00.304926 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e777c-f74a-4dc9-b15e-a12809bc0759 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:00.305262 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e777c-f74a-4dc9-b15e-a12809bc0759 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:00.305544 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e777c-f74a-4dc9-b15e-a12809bc0759 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:00.320048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e777c-f74a-4dc9-b15e-a12809bc0759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:13:00.329604 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-ae1e777c-f74a-4dc9-b15e-a12809bc0759 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:13:00.329604 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:00.329604 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:00.329604 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:00.329604 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:00.329604 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:00.329604 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:00.329604 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:00.329604 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:00.329604 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:00.329604 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:00.329604 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:00.329604 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:13:00.329604 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:13:00.329604 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:13:00.329604 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:13:00.330727 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:13:00.330727 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:13:00.330727 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:13:00.330727 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:13:00.330727 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:00.330727 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:00.330727 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:00.330727 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:00.330727 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:00.330727 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:00.330727 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:00.330727 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:00.330727 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:00.330727 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:00.330727 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:00.330727 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:00.331634 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:00.331634 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:00.331634 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:00.331634 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:00.331634 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:13:00.331634 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:13:00.331634 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:13:00.331634 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:13:00.331634 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:13:00.331634 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:13:00.331634 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:13:00.331634 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:13:00.331634 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 607/1208] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jun 4 08:13:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:13:00.337049 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a6b8a-6826-468c-8979-a01da88d8a97 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:00.383655 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:00.460801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a6b8a-6826-468c-8979-a01da88d8a97 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:00.506666 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d5b15-8432-4ac7-a9ed-9bcc4c9708c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:00.507573 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d5b15-8432-4ac7-a9ed-9bcc4c9708c3 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:00.507872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d5b15-8432-4ac7-a9ed-9bcc4c9708c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:00.508195 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d5b15-8432-4ac7-a9ed-9bcc4c9708c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:00.509032 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d5b15-8432-4ac7-a9ed-9bcc4c9708c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:00.509412 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d5b15-8432-4ac7-a9ed-9bcc4c9708c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:00.511182 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d5b15-8432-4ac7-a9ed-9bcc4c9708c3 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:00.525368 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 602/1209] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jun 4 08:13:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:13:00.526721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e777c-f74a-4dc9-b15e-a12809bc0759 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:00.591251 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:00.654147 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e777c-f74a-4dc9-b15e-a12809bc0759 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:00.697372 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ead9d-6d42-49c5-b75b-1d64c8ae6bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:00.698568 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ead9d-6d42-49c5-b75b-1d64c8ae6bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:00.699146 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ead9d-6d42-49c5-b75b-1d64c8ae6bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:00.699594 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ead9d-6d42-49c5-b75b-1d64c8ae6bb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:00.710359 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ead9d-6d42-49c5-b75b-1d64c8ae6bb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:00.712207 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ead9d-6d42-49c5-b75b-1d64c8ae6bb4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:00.731966 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-8a7ead9d-6d42-49c5-b75b-1d64c8ae6bb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:13:00.731966 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:00.731966 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:00.731966 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:00.731966 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:00.731966 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:00.731966 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:00.731966 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:00.731966 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:00.731966 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:00.731966 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:00.731966 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:00.731966 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:13:00.731966 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:13:00.731966 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:13:00.733050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:13:00.733050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:00.733050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:00.733050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:00.733050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:00.733050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:00.733050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:00.733050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:00.733050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:00.733050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:00.733050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:00.733050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:00.733050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:00.733050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:00.733050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:00.733050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:00.733050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:00.734192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:13:00.734192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:13:00.734192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:13:00.734192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:13:00.734192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 608/1210] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:13:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:13:00.739531 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d5b15-8432-4ac7-a9ed-9bcc4c9708c3 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:00.856299 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:00.859210 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d5b15-8432-4ac7-a9ed-9bcc4c9708c3 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:00.895956 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33feaab2-e9f1-4084-b4f9-0e905d2a693f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:00.896627 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33feaab2-e9f1-4084-b4f9-0e905d2a693f None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:00.896909 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33feaab2-e9f1-4084-b4f9-0e905d2a693f None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:00.897180 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33feaab2-e9f1-4084-b4f9-0e905d2a693f None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:00.897917 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33feaab2-e9f1-4084-b4f9-0e905d2a693f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:00.898225 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33feaab2-e9f1-4084-b4f9-0e905d2a693f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:00.899681 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33feaab2-e9f1-4084-b4f9-0e905d2a693f None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:00.916972 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 603/1211] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:00.918693 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ead9d-6d42-49c5-b75b-1d64c8ae6bb4 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:01.027146 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ead9d-6d42-49c5-b75b-1d64c8ae6bb4 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:01.028869 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:01.066574 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6a654-3819-40de-86f5-e55637a9b281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:01.067384 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6a654-3819-40de-86f5-e55637a9b281 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:01.067673 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6a654-3819-40de-86f5-e55637a9b281 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:01.067985 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6a654-3819-40de-86f5-e55637a9b281 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:01.076429 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6a654-3819-40de-86f5-e55637a9b281 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:01.078557 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6a654-3819-40de-86f5-e55637a9b281 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:01.092818 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-eaa6a654-3819-40de-86f5-e55637a9b281 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 04 08:13:01.092818 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:01.092818 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:01.092818 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:01.092818 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:01.092818 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:01.092818 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:01.092818 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:01.092818 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:01.092818 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:01.092818 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:01.092818 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:01.092818 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:13:01.092818 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:13:01.092818 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:13:01.092818 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:13:01.096464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:01.096464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:01.096464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:13:01.096464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:13:01.096464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:13:01.096464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:13:01.096464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:01.096464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:01.096464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:01.096464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:01.096464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:01.096464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:01.096464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:01.096464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:01.096464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:01.096464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:01.096464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:01.096464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:01.097534 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:01.097534 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:01.097534 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:13:01.097534 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:13:01.097534 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:13:01.097534 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:13:01.097534 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:13:01.097534 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:13:01.097534 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 04 08:13:01.097534 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:13:01.097534 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 609/1212] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:13:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:13:01.100523 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33feaab2-e9f1-4084-b4f9-0e905d2a693f None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:01.212126 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33feaab2-e9f1-4084-b4f9-0e905d2a693f None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:01.248002 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc254a9-f30a-40b0-9ce0-e845c5f5bfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:01.248680 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc254a9-f30a-40b0-9ce0-e845c5f5bfa7 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:01.248965 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc254a9-f30a-40b0-9ce0-e845c5f5bfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:01.249251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc254a9-f30a-40b0-9ce0-e845c5f5bfa7 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:01.250164 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc254a9-f30a-40b0-9ce0-e845c5f5bfa7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:01.251077 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc254a9-f30a-40b0-9ce0-e845c5f5bfa7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:01.251890 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc254a9-f30a-40b0-9ce0-e845c5f5bfa7 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:01.277344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 604/1213] 10.222.0.57 () {56 vars in 1143 bytes} [Sat Jun 4 08:13:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:13:01.279222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6a654-3819-40de-86f5-e55637a9b281 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:01.392549 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6a654-3819-40de-86f5-e55637a9b281 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:01.436721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db48b0-2707-4b07-a695-eb8d5736bade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:01.437524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db48b0-2707-4b07-a695-eb8d5736bade None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:01.437776 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db48b0-2707-4b07-a695-eb8d5736bade None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:01.438074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db48b0-2707-4b07-a695-eb8d5736bade None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:01.470175 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:01.512547 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db48b0-2707-4b07-a695-eb8d5736bade None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:01.514030 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db48b0-2707-4b07-a695-eb8d5736bade None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:01.630946 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 610/1214] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:13:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 08:13:01.636772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc254a9-f30a-40b0-9ce0-e845c5f5bfa7 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:01.661195 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:01.768237 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc254a9-f30a-40b0-9ce0-e845c5f5bfa7 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:01.805869 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87633bb4-a6fd-4bcc-a3fe-f13bcf11741e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:01.806727 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87633bb4-a6fd-4bcc-a3fe-f13bcf11741e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:01.806952 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87633bb4-a6fd-4bcc-a3fe-f13bcf11741e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:01.807221 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87633bb4-a6fd-4bcc-a3fe-f13bcf11741e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:01.817996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87633bb4-a6fd-4bcc-a3fe-f13bcf11741e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:01.819451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87633bb4-a6fd-4bcc-a3fe-f13bcf11741e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:01.838167 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-87633bb4-a6fd-4bcc-a3fe-f13bcf11741e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:13:01.838167 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:01.838167 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:01.838167 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:01.838167 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:01.838167 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:01.838167 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:01.838167 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:01.838167 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:01.838167 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:01.838167 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:01.838167 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:01.838167 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:13:01.838167 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:13:01.838167 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:13:01.839353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:13:01.839353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:01.839353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:01.839353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:01.839353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:01.839353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:01.839353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:01.839353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:01.839353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:01.839353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:01.839353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:01.839353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:01.839353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:01.839353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:01.839353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:01.839353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:01.839353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:01.840320 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:13:01.840320 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:13:01.840320 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:13:01.840320 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:13:01.840320 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 605/1215] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:13:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:13:01.845909 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db48b0-2707-4b07-a695-eb8d5736bade None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:01.919221 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:01.955769 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db48b0-2707-4b07-a695-eb8d5736bade None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:01.992693 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421379cd-9998-4639-880b-2d0c68b09d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:01.993449 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421379cd-9998-4639-880b-2d0c68b09d39 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:01.993887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421379cd-9998-4639-880b-2d0c68b09d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:01.994173 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421379cd-9998-4639-880b-2d0c68b09d39 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:01.994973 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421379cd-9998-4639-880b-2d0c68b09d39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:01.995318 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421379cd-9998-4639-880b-2d0c68b09d39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:01.996652 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421379cd-9998-4639-880b-2d0c68b09d39 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:02.008803 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 611/1216] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:02.014344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87633bb4-a6fd-4bcc-a3fe-f13bcf11741e None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:02.090669 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:02.128023 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87633bb4-a6fd-4bcc-a3fe-f13bcf11741e None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:02.168204 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3a455-ecd4-48e1-a04b-96d2fa5c2207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:02.168995 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3a455-ecd4-48e1-a04b-96d2fa5c2207 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:02.169321 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3a455-ecd4-48e1-a04b-96d2fa5c2207 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:02.169602 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3a455-ecd4-48e1-a04b-96d2fa5c2207 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:02.177022 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3a455-ecd4-48e1-a04b-96d2fa5c2207 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:02.178804 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3a455-ecd4-48e1-a04b-96d2fa5c2207 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:02.197849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-47d3a455-ecd4-48e1-a04b-96d2fa5c2207 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:13:02.197849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:02.197849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:02.197849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:02.197849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:02.197849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:02.197849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:02.197849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:02.197849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:02.197849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:02.197849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:02.197849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:02.197849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:13:02.197849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:13:02.197849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:13:02.198920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:13:02.198920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:02.198920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:02.198920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:02.198920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:02.198920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:02.198920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:02.198920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:02.198920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:02.198920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:02.198920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:02.198920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:02.198920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:02.198920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:02.198920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:02.198920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:02.198920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:02.199844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:13:02.199844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:13:02.199844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:13:02.199844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:13:02.199844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:13:02.199844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:13:02.199844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:13:02.199844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:13:02.199844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 606/1217] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:13:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:13:02.201879 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421379cd-9998-4639-880b-2d0c68b09d39 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:02.312398 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421379cd-9998-4639-880b-2d0c68b09d39 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:02.335805 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:02.350279 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6d3e9-5e0d-4ed0-8338-fac91561f7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:02.351028 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6d3e9-5e0d-4ed0-8338-fac91561f7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:02.351426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6d3e9-5e0d-4ed0-8338-fac91561f7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:02.351867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6d3e9-5e0d-4ed0-8338-fac91561f7f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:02.352763 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6d3e9-5e0d-4ed0-8338-fac91561f7f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:02.353151 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6d3e9-5e0d-4ed0-8338-fac91561f7f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:02.355994 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6d3e9-5e0d-4ed0-8338-fac91561f7f2 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:02.370992 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 612/1218] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:13:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:02.377523 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3a455-ecd4-48e1-a04b-96d2fa5c2207 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:02.496648 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3a455-ecd4-48e1-a04b-96d2fa5c2207 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:02.528558 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:02.536784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972be740-04a5-4514-b7a1-e6362624a2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:02.537526 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972be740-04a5-4514-b7a1-e6362624a2d9 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:02.537899 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972be740-04a5-4514-b7a1-e6362624a2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:02.538249 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972be740-04a5-4514-b7a1-e6362624a2d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:02.539135 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972be740-04a5-4514-b7a1-e6362624a2d9 None admin] RBAC: Adding query filter params (role.id=c9ec7276464a4d87ab2b6fc52a3bfeae, scope.project.id=634c9a1745ef44c0ad66e02493d79af0, user.id=6fb6720f0d0141fea795cecfbf6f2538) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:02.539524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972be740-04a5-4514-b7a1-e6362624a2d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:02.541019 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972be740-04a5-4514-b7a1-e6362624a2d9 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:02.547574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 607/1219] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:13:02 2022] GET /identity/v3/role_assignments?user.id=6fb6720f0d0141fea795cecfbf6f2538&scope.project.id=634c9a1745ef44c0ad66e02493d79af0&role.id=c9ec7276464a4d87ab2b6fc52a3bfeae => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:04.883934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2924f-8a16-4946-b9c6-8de8298abc05 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:04.884496 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2924f-8a16-4946-b9c6-8de8298abc05 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:04.884496 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2924f-8a16-4946-b9c6-8de8298abc05 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:04.885866 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 613/1220] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:13:04.891752 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1f318-19d2-4450-b2a3-b82d1971445d None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:04.892163 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1f318-19d2-4450-b2a3-b82d1971445d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:04.892311 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1f318-19d2-4450-b2a3-b82d1971445d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:04.911071 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-7ff1f318-19d2-4450-b2a3-b82d1971445d None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:13:04.912324 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-7ff1f318-19d2-4450-b2a3-b82d1971445d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:13:04.987183 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 608/1221] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:13:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:13:05.011217 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2924f-8a16-4946-b9c6-8de8298abc05 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:05.123168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2924f-8a16-4946-b9c6-8de8298abc05 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:05.165556 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45887e5-5170-4f24-8066-6aa932166502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:05.166948 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45887e5-5170-4f24-8066-6aa932166502 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:05.167530 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45887e5-5170-4f24-8066-6aa932166502 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:05.168104 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45887e5-5170-4f24-8066-6aa932166502 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:05.185247 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45887e5-5170-4f24-8066-6aa932166502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:13:05.200581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-c45887e5-5170-4f24-8066-6aa932166502 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:13:05.200581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:05.200581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:05.200581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:05.200581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:05.200581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:05.200581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:05.200581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:05.200581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:05.200581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:05.200581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:05.200581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:05.200581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:13:05.200581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:13:05.200581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:13:05.200581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:13:05.201743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:13:05.201743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:13:05.201743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:13:05.201743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:13:05.201743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:05.201743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:05.201743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:05.201743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:05.201743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:05.201743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:05.201743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:05.201743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:05.201743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:05.201743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:05.201743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:05.201743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:05.203391 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:05.203391 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:05.203391 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:05.203391 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:05.203391 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:13:05.203391 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:13:05.203391 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:13:05.203391 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:13:05.203391 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:13:05.203391 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:13:05.203391 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:13:05.203391 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:13:05.209872 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 614/1222] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jun 4 08:13:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:13:05.212242 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1f318-19d2-4450-b2a3-b82d1971445d None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:05.324191 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1f318-19d2-4450-b2a3-b82d1971445d None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:05.349748 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:05.363321 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6b650-4997-4199-af23-97d2ec86a95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:05.364006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6b650-4997-4199-af23-97d2ec86a95f None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:05.364353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6b650-4997-4199-af23-97d2ec86a95f None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:05.364632 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6b650-4997-4199-af23-97d2ec86a95f None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:05.365386 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6b650-4997-4199-af23-97d2ec86a95f None admin] RBAC: Adding query filter params (name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:05.365779 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6b650-4997-4199-af23-97d2ec86a95f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:05.367185 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6b650-4997-4199-af23-97d2ec86a95f None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:05.380725 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 609/1223] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jun 4 08:13:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:05.382151 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45887e5-5170-4f24-8066-6aa932166502 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:05.431116 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:05.495593 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45887e5-5170-4f24-8066-6aa932166502 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:05.533629 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c33ad-802d-4975-b0af-6740d2d214f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:05.534417 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c33ad-802d-4975-b0af-6740d2d214f1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:05.534705 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c33ad-802d-4975-b0af-6740d2d214f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:05.535078 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c33ad-802d-4975-b0af-6740d2d214f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:05.547826 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c33ad-802d-4975-b0af-6740d2d214f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:05.549366 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c33ad-802d-4975-b0af-6740d2d214f1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:05.570290 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-e50c33ad-802d-4975-b0af-6740d2d214f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:13:05.570290 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:05.570290 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:05.570290 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:05.570290 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:05.570290 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:05.570290 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:05.570290 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:05.570290 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:05.570290 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:05.570290 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:05.570290 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:05.570290 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:13:05.570290 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:13:05.570290 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:13:05.571302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:13:05.571302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:05.571302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:05.571302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:05.571302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:05.571302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:05.571302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:05.571302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:05.571302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:05.571302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:05.571302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:05.571302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:05.571302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:05.571302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:05.571302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:05.571302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:05.571302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:05.577463 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:13:05.577463 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:13:05.577463 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:13:05.577463 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:13:05.577463 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 615/1224] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:13:05.578920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6b650-4997-4199-af23-97d2ec86a95f None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:05.701041 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6b650-4997-4199-af23-97d2ec86a95f None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:05.742145 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2188c7-8d80-4262-921e-86a7d57eb010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:05.742930 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2188c7-8d80-4262-921e-86a7d57eb010 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:05.743215 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2188c7-8d80-4262-921e-86a7d57eb010 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:05.743661 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2188c7-8d80-4262-921e-86a7d57eb010 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:05.744327 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2188c7-8d80-4262-921e-86a7d57eb010 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:05.744647 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2188c7-8d80-4262-921e-86a7d57eb010 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:05.746175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2188c7-8d80-4262-921e-86a7d57eb010 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:05.764353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 610/1225] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:05.765914 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c33ad-802d-4975-b0af-6740d2d214f1 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:05.873020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:05.881631 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c33ad-802d-4975-b0af-6740d2d214f1 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:05.920381 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf27480-2dbc-48cf-b2ce-b6cfb136b343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:05.921206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf27480-2dbc-48cf-b2ce-b6cfb136b343 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:05.922180 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf27480-2dbc-48cf-b2ce-b6cfb136b343 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:05.922507 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf27480-2dbc-48cf-b2ce-b6cfb136b343 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:05.931213 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf27480-2dbc-48cf-b2ce-b6cfb136b343 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:05.932762 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf27480-2dbc-48cf-b2ce-b6cfb136b343 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:05.950715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-abf27480-2dbc-48cf-b2ce-b6cfb136b343 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 04 08:13:05.950715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:05.950715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:05.950715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:05.950715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:05.950715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:05.950715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:05.950715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:05.950715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:05.950715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:05.950715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:05.950715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:05.950715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:13:05.950715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:13:05.950715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:13:05.950715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:13:05.951812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:05.951812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:05.951812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:13:05.951812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:13:05.951812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:13:05.951812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:13:05.951812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:05.951812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:05.951812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:05.951812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:05.951812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:05.951812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:05.951812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:05.951812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:05.951812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:05.951812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:05.951812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:05.951812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:05.953440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:05.953440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:05.953440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:13:05.953440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:13:05.953440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:13:05.953440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:13:05.953440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:13:05.953440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:13:05.953440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 04 08:13:05.953440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:13:05.953440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 616/1226] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:13:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:13:05.958449 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2188c7-8d80-4262-921e-86a7d57eb010 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:06.011284 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:06.076989 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2188c7-8d80-4262-921e-86a7d57eb010 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:06.117503 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb7eae-437e-4e52-bb7f-a824f9283326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:06.118374 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb7eae-437e-4e52-bb7f-a824f9283326 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:06.118777 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb7eae-437e-4e52-bb7f-a824f9283326 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:06.119136 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb7eae-437e-4e52-bb7f-a824f9283326 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:06.120082 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb7eae-437e-4e52-bb7f-a824f9283326 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:06.120504 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb7eae-437e-4e52-bb7f-a824f9283326 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:06.122096 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb7eae-437e-4e52-bb7f-a824f9283326 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:06.149169 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 611/1227] 10.222.0.57 () {56 vars in 1143 bytes} [Sat Jun 4 08:13:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:06.155458 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf27480-2dbc-48cf-b2ce-b6cfb136b343 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:06.269639 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf27480-2dbc-48cf-b2ce-b6cfb136b343 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:06.305207 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a640e26-14e9-4b63-be60-1211de4887d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:06.306020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a640e26-14e9-4b63-be60-1211de4887d0 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:06.306299 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a640e26-14e9-4b63-be60-1211de4887d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:06.306568 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a640e26-14e9-4b63-be60-1211de4887d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:06.319757 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a640e26-14e9-4b63-be60-1211de4887d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:06.321518 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a640e26-14e9-4b63-be60-1211de4887d0 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:06.340484 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-0a640e26-14e9-4b63-be60-1211de4887d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:13:06.340484 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:06.340484 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:06.340484 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:06.340484 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:06.340484 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:06.340484 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:06.340484 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:06.340484 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:06.340484 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:06.340484 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:06.340484 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:06.340484 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:13:06.340484 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:13:06.340484 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:13:06.341592 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:13:06.341592 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:06.341592 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:06.341592 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:06.341592 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:06.341592 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:06.341592 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:06.341592 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:06.341592 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:06.341592 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:06.341592 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:06.341592 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:06.341592 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:06.341592 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:06.341592 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:06.341592 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:06.341592 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:06.342760 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:13:06.342760 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:13:06.342760 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:13:06.342760 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:13:06.342760 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 617/1228] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:13:06.349357 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb7eae-437e-4e52-bb7f-a824f9283326 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:06.459270 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb7eae-437e-4e52-bb7f-a824f9283326 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:06.461684 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:06.495802 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412c03c-5203-4d05-8456-16f2427e9717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:06.496466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412c03c-5203-4d05-8456-16f2427e9717 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:06.496754 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412c03c-5203-4d05-8456-16f2427e9717 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:06.497060 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412c03c-5203-4d05-8456-16f2427e9717 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:06.497747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412c03c-5203-4d05-8456-16f2427e9717 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:06.498085 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412c03c-5203-4d05-8456-16f2427e9717 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:06.500004 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412c03c-5203-4d05-8456-16f2427e9717 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:06.512197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 612/1229] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:06.520140 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a640e26-14e9-4b63-be60-1211de4887d0 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:06.529726 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:06.628136 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a640e26-14e9-4b63-be60-1211de4887d0 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:06.664414 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e96b2-ef83-49bc-8e16-030b9a4a20bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:06.665300 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e96b2-ef83-49bc-8e16-030b9a4a20bb None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:06.665632 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e96b2-ef83-49bc-8e16-030b9a4a20bb None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:06.665995 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e96b2-ef83-49bc-8e16-030b9a4a20bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:06.674100 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e96b2-ef83-49bc-8e16-030b9a4a20bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:06.675644 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e96b2-ef83-49bc-8e16-030b9a4a20bb None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:06.690538 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-af2e96b2-ef83-49bc-8e16-030b9a4a20bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:13:06.690538 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:06.690538 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:06.690538 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:06.690538 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:06.690538 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:06.690538 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:06.690538 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:06.690538 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:06.690538 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:06.690538 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:06.690538 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:06.690538 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:13:06.690538 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:13:06.690538 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:13:06.691512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:13:06.691512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:06.691512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:06.691512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:06.691512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:06.691512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:06.691512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:06.691512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:06.691512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:06.691512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:06.691512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:06.691512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:06.691512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:06.691512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:06.691512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:06.691512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:06.691512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:06.692463 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:13:06.692463 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:13:06.692463 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:13:06.692463 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:13:06.692463 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:13:06.692463 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:13:06.692463 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:13:06.692463 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:13:06.692463 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 618/1230] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:13:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:13:06.697933 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412c03c-5203-4d05-8456-16f2427e9717 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:06.813165 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412c03c-5203-4d05-8456-16f2427e9717 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:06.848979 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40737fb9-c92f-4686-a659-cccecce62551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:06.849636 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40737fb9-c92f-4686-a659-cccecce62551 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:06.849964 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40737fb9-c92f-4686-a659-cccecce62551 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:06.850247 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40737fb9-c92f-4686-a659-cccecce62551 None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:06.851027 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40737fb9-c92f-4686-a659-cccecce62551 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:06.851340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40737fb9-c92f-4686-a659-cccecce62551 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:06.852777 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40737fb9-c92f-4686-a659-cccecce62551 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:06.866259 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 613/1231] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:13:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:06.872360 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e96b2-ef83-49bc-8e16-030b9a4a20bb None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:06.946226 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:06.984589 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e96b2-ef83-49bc-8e16-030b9a4a20bb None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:07.019834 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b4840-8c64-439f-a26a-620077be696f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:07.020731 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b4840-8c64-439f-a26a-620077be696f None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:07.021016 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b4840-8c64-439f-a26a-620077be696f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:07.021292 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b4840-8c64-439f-a26a-620077be696f None admin] PATH_INFO: `/v3/projects/634c9a1745ef44c0ad66e02493d79af0/users/6fb6720f0d0141fea795cecfbf6f2538/roles/c9ec7276464a4d87ab2b6fc52a3bfeae` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:07.036385 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b4840-8c64-439f-a26a-620077be696f None admin] RBAC: Authorizing `identity:create_grant(project_id=634c9a1745ef44c0ad66e02493d79af0, user_id=6fb6720f0d0141fea795cecfbf6f2538, role_id=c9ec7276464a4d87ab2b6fc52a3bfeae)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:07.037849 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b4840-8c64-439f-a26a-620077be696f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:07.050803 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 619/1232] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jun 4 08:13:06 2022] PUT /identity/v3/projects/634c9a1745ef44c0ad66e02493d79af0/users/6fb6720f0d0141fea795cecfbf6f2538/roles/c9ec7276464a4d87ab2b6fc52a3bfeae => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:13:09.431759 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9daab76-91fa-4cd6-9e76-e1f552ed92ae None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:09.432477 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9daab76-91fa-4cd6-9e76-e1f552ed92ae None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:09.432477 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9daab76-91fa-4cd6-9e76-e1f552ed92ae None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:09.433836 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 614/1233] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:13:09.439889 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18cfed-c6b5-4553-a986-6409000acdc2 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:09.440493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18cfed-c6b5-4553-a986-6409000acdc2 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:09.440493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18cfed-c6b5-4553-a986-6409000acdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:09.456962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6d18cfed-c6b5-4553-a986-6409000acdc2 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:13:09.458181 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6d18cfed-c6b5-4553-a986-6409000acdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:13:09.525865 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 620/1234] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:13:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:13:09.550231 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9daab76-91fa-4cd6-9e76-e1f552ed92ae None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:09.575534 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:09.655408 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9daab76-91fa-4cd6-9e76-e1f552ed92ae None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:09.694198 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077cf3a2-1580-41a7-a53d-66f05c2b0da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:09.694924 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cf3a2-1580-41a7-a53d-66f05c2b0da8 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:09.695208 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cf3a2-1580-41a7-a53d-66f05c2b0da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:09.695484 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cf3a2-1580-41a7-a53d-66f05c2b0da8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:09.709849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077cf3a2-1580-41a7-a53d-66f05c2b0da8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:13:09.715175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-077cf3a2-1580-41a7-a53d-66f05c2b0da8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:13:09.715175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:09.715175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:09.715175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:09.715175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:09.715175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:09.715175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:09.715175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:09.715175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:09.715175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:09.715175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:09.715175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:09.715175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:13:09.715175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:13:09.715175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:13:09.715175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:13:09.716747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:13:09.716747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:13:09.716747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:13:09.716747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:13:09.716747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:09.716747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:09.716747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:09.716747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:09.716747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:09.716747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:09.716747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:09.716747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:09.716747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:09.716747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:09.716747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:09.716747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:09.717732 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:09.717732 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:09.717732 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:09.717732 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:09.717732 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:13:09.717732 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:13:09.717732 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:13:09.717732 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:13:09.717732 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:13:09.717732 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:13:09.717732 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 08:13:09.717732 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:13:09.717732 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 615/1235] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jun 4 08:13:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:13:09.723138 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18cfed-c6b5-4553-a986-6409000acdc2 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:09.774389 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:09.834794 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18cfed-c6b5-4553-a986-6409000acdc2 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:09.869530 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38a5d6-7f81-4cc6-9300-749a418a728d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:09.870295 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38a5d6-7f81-4cc6-9300-749a418a728d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:09.870622 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38a5d6-7f81-4cc6-9300-749a418a728d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:09.870902 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38a5d6-7f81-4cc6-9300-749a418a728d None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:09.871714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38a5d6-7f81-4cc6-9300-749a418a728d None admin] RBAC: Adding query filter params (name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:09.872043 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38a5d6-7f81-4cc6-9300-749a418a728d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:09.873431 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38a5d6-7f81-4cc6-9300-749a418a728d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:09.882862 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 621/1236] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jun 4 08:13:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:09.888774 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077cf3a2-1580-41a7-a53d-66f05c2b0da8 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:09.990135 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:10.009382 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077cf3a2-1580-41a7-a53d-66f05c2b0da8 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:10.046858 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e0a77-8df3-4b11-be21-7a9540b299a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:10.047857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e0a77-8df3-4b11-be21-7a9540b299a8 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:10.048300 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e0a77-8df3-4b11-be21-7a9540b299a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:10.048670 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e0a77-8df3-4b11-be21-7a9540b299a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:10.060177 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e0a77-8df3-4b11-be21-7a9540b299a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:10.061833 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e0a77-8df3-4b11-be21-7a9540b299a8 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:10.079892 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-5a8e0a77-8df3-4b11-be21-7a9540b299a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:13:10.079892 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:10.079892 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:10.079892 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:10.079892 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:10.079892 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:10.079892 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:10.079892 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:10.079892 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:10.079892 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:10.079892 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:10.079892 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:10.079892 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:13:10.079892 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:13:10.079892 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:13:10.081091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:13:10.081091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:10.081091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:10.081091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:10.081091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:10.081091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:10.081091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:10.081091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:10.081091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:10.081091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:10.081091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:10.081091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:10.081091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:10.081091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:10.081091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:10.081091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:10.081091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:10.086992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:13:10.086992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:13:10.086992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:13:10.086992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:13:10.086992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 616/1237] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:13:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:13:10.087373 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38a5d6-7f81-4cc6-9300-749a418a728d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:10.194954 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38a5d6-7f81-4cc6-9300-749a418a728d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:10.206321 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:10.234694 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7bb46-ae3d-46fb-9608-5076a4bc9527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:10.235497 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7bb46-ae3d-46fb-9608-5076a4bc9527 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:10.235787 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7bb46-ae3d-46fb-9608-5076a4bc9527 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:10.236062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7bb46-ae3d-46fb-9608-5076a4bc9527 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:10.236850 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7bb46-ae3d-46fb-9608-5076a4bc9527 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:10.237275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7bb46-ae3d-46fb-9608-5076a4bc9527 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:10.238947 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7bb46-ae3d-46fb-9608-5076a4bc9527 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:10.257008 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 622/1238] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:10.258355 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e0a77-8df3-4b11-be21-7a9540b299a8 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:10.373215 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e0a77-8df3-4b11-be21-7a9540b299a8 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:10.408939 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9b110-fc92-498c-97cd-661b3f3d05b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:10.409733 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9b110-fc92-498c-97cd-661b3f3d05b0 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:10.410042 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9b110-fc92-498c-97cd-661b3f3d05b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:10.410316 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9b110-fc92-498c-97cd-661b3f3d05b0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:10.412965 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:10.420049 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9b110-fc92-498c-97cd-661b3f3d05b0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:10.421605 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9b110-fc92-498c-97cd-661b3f3d05b0 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:10.438514 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-94c9b110-fc92-498c-97cd-661b3f3d05b0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 04 08:13:10.438514 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:10.438514 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:10.438514 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:10.438514 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:10.438514 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:10.438514 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:10.438514 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:10.438514 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:10.438514 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:10.438514 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:10.438514 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:10.438514 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:13:10.438514 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:13:10.438514 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:13:10.438514 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:13:10.440307 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:10.440307 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:10.440307 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:13:10.440307 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:13:10.440307 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:13:10.440307 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:13:10.440307 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:10.440307 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:10.440307 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:10.440307 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:10.440307 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:10.440307 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:10.440307 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:10.440307 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:10.440307 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:10.440307 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:10.440307 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:10.440307 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:10.441496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:10.441496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:10.441496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:13:10.441496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:13:10.441496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:13:10.441496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:13:10.441496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:13:10.441496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:13:10.441496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 04 08:13:10.441496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:13:10.445849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 617/1239] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:13:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:13:10.445980 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7bb46-ae3d-46fb-9608-5076a4bc9527 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:10.561439 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7bb46-ae3d-46fb-9608-5076a4bc9527 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:10.597744 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68fa9b-9089-48b1-a43d-c716eb2057d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:10.598521 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68fa9b-9089-48b1-a43d-c716eb2057d4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:10.598808 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68fa9b-9089-48b1-a43d-c716eb2057d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:10.599118 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68fa9b-9089-48b1-a43d-c716eb2057d4 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:10.599998 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c68fa9b-9089-48b1-a43d-c716eb2057d4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:10.600315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c68fa9b-9089-48b1-a43d-c716eb2057d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:10.601954 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c68fa9b-9089-48b1-a43d-c716eb2057d4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:10.620908 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 623/1240] 10.222.0.57 () {56 vars in 1143 bytes} [Sat Jun 4 08:13:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:10.627419 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9b110-fc92-498c-97cd-661b3f3d05b0 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:10.740446 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9b110-fc92-498c-97cd-661b3f3d05b0 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:10.779865 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ba0c1-f34b-4dab-9519-e61bac58421e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:10.780523 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ba0c1-f34b-4dab-9519-e61bac58421e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:10.780816 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ba0c1-f34b-4dab-9519-e61bac58421e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:10.781092 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ba0c1-f34b-4dab-9519-e61bac58421e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:10.855721 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:10.863818 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ba0c1-f34b-4dab-9519-e61bac58421e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:10.865553 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ba0c1-f34b-4dab-9519-e61bac58421e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:10.977740 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 618/1241] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:13:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 08:13:10.983333 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68fa9b-9089-48b1-a43d-c716eb2057d4 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:11.015343 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:11.114980 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68fa9b-9089-48b1-a43d-c716eb2057d4 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:11.153697 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499db743-b070-41d2-b7a5-8eb45257876d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:11.154530 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499db743-b070-41d2-b7a5-8eb45257876d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:11.154812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499db743-b070-41d2-b7a5-8eb45257876d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:11.155081 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499db743-b070-41d2-b7a5-8eb45257876d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:11.169295 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499db743-b070-41d2-b7a5-8eb45257876d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:11.170841 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499db743-b070-41d2-b7a5-8eb45257876d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:11.189906 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-499db743-b070-41d2-b7a5-8eb45257876d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:13:11.189906 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:11.189906 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:11.189906 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:11.189906 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:11.189906 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:11.189906 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:11.189906 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:11.189906 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:11.189906 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:11.189906 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:11.189906 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:11.189906 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:13:11.189906 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:13:11.189906 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:13:11.190952 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:13:11.190952 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:11.190952 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:11.190952 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:11.190952 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:11.190952 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:11.190952 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:11.190952 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:11.190952 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:11.190952 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:11.190952 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:11.190952 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:11.190952 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:11.190952 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:11.190952 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:11.190952 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:11.190952 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:11.191939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:13:11.191939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:13:11.191939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:13:11.191939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:13:11.191939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 624/1242] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:13:11.196819 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ba0c1-f34b-4dab-9519-e61bac58421e None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:11.301326 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:11.308154 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ba0c1-f34b-4dab-9519-e61bac58421e None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:11.347111 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f5197-9b60-4ab5-8bae-48898b5b2f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:11.347956 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f5197-9b60-4ab5-8bae-48898b5b2f7f None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:11.348402 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f5197-9b60-4ab5-8bae-48898b5b2f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:11.348871 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f5197-9b60-4ab5-8bae-48898b5b2f7f None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:11.349641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f5197-9b60-4ab5-8bae-48898b5b2f7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:11.349953 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f5197-9b60-4ab5-8bae-48898b5b2f7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:11.351387 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f5197-9b60-4ab5-8bae-48898b5b2f7f None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:11.364802 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 619/1243] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:11.370611 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499db743-b070-41d2-b7a5-8eb45257876d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:11.457871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:11.482662 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499db743-b070-41d2-b7a5-8eb45257876d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:11.520276 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ecc69-9731-489d-a5a1-eff37f95573b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:11.521087 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ecc69-9731-489d-a5a1-eff37f95573b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:11.521368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ecc69-9731-489d-a5a1-eff37f95573b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:11.521642 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ecc69-9731-489d-a5a1-eff37f95573b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:11.528833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ecc69-9731-489d-a5a1-eff37f95573b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:11.530321 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ecc69-9731-489d-a5a1-eff37f95573b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:11.544935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-406ecc69-9731-489d-a5a1-eff37f95573b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:13:11.544935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:11.544935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:11.544935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:11.544935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:11.544935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:11.544935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:11.544935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:11.544935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:11.544935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:11.544935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:11.544935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:11.544935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:13:11.544935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:13:11.544935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:13:11.546211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:13:11.546211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:11.546211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:11.546211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:11.546211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:11.546211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:11.546211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:11.546211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:11.546211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:11.546211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:11.546211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:11.546211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:11.546211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:11.546211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:11.546211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:11.546211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:11.546211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:11.552060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:13:11.552060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:13:11.552060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:13:11.552060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:13:11.552060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:13:11.552060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:13:11.552060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:13:11.552060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:13:11.552060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 625/1244] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:13:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:13:11.552701 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f5197-9b60-4ab5-8bae-48898b5b2f7f None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:11.661681 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f5197-9b60-4ab5-8bae-48898b5b2f7f None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:11.697604 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac84eb2-f27c-4b15-8258-981fa1a8a2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:11.698472 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac84eb2-f27c-4b15-8258-981fa1a8a2b3 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:11.698758 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac84eb2-f27c-4b15-8258-981fa1a8a2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:11.699035 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac84eb2-f27c-4b15-8258-981fa1a8a2b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:11.699943 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac84eb2-f27c-4b15-8258-981fa1a8a2b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:11.700275 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac84eb2-f27c-4b15-8258-981fa1a8a2b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:11.701872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac84eb2-f27c-4b15-8258-981fa1a8a2b3 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:11.721284 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 620/1245] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:13:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:11.722925 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ecc69-9731-489d-a5a1-eff37f95573b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:11.839050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ecc69-9731-489d-a5a1-eff37f95573b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:11.875548 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37871a51-32ff-4e86-a150-98f04d479dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:11.876178 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37871a51-32ff-4e86-a150-98f04d479dcc None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:11.876460 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37871a51-32ff-4e86-a150-98f04d479dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:11.876730 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37871a51-32ff-4e86-a150-98f04d479dcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:11.877649 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37871a51-32ff-4e86-a150-98f04d479dcc None admin] RBAC: Adding query filter params (role.id=c9ec7276464a4d87ab2b6fc52a3bfeae, scope.project.id=634c9a1745ef44c0ad66e02493d79af0, user.id=6fb6720f0d0141fea795cecfbf6f2538) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:11.878011 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37871a51-32ff-4e86-a150-98f04d479dcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:11.879565 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37871a51-32ff-4e86-a150-98f04d479dcc None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:11.886305 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 626/1246] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:13:11 2022] GET /identity/v3/role_assignments?user.id=6fb6720f0d0141fea795cecfbf6f2538&scope.project.id=634c9a1745ef44c0ad66e02493d79af0&role.id=c9ec7276464a4d87ab2b6fc52a3bfeae => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:14.207330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b281148-e1aa-4630-8457-a0dc735bf38d None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:14.207844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b281148-e1aa-4630-8457-a0dc735bf38d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:14.207844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b281148-e1aa-4630-8457-a0dc735bf38d None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:14.209168 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 621/1247] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:13:14.214876 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609592a3-fd67-49ca-9cb7-67c9107cedf4 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:14.215399 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609592a3-fd67-49ca-9cb7-67c9107cedf4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:14.215523 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609592a3-fd67-49ca-9cb7-67c9107cedf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:14.221468 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:14.235334 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-609592a3-fd67-49ca-9cb7-67c9107cedf4 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:13:14.236689 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-609592a3-fd67-49ca-9cb7-67c9107cedf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:13:14.313697 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 627/1248] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:13:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:13:14.339083 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b281148-e1aa-4630-8457-a0dc735bf38d None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:14.359930 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:14.458894 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b281148-e1aa-4630-8457-a0dc735bf38d None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:14.496127 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c10f3-ec65-4b26-bc78-5cb42cb7e96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:14.496922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c10f3-ec65-4b26-bc78-5cb42cb7e96d None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:14.497202 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c10f3-ec65-4b26-bc78-5cb42cb7e96d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:14.497474 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c10f3-ec65-4b26-bc78-5cb42cb7e96d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:14.508845 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c10f3-ec65-4b26-bc78-5cb42cb7e96d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:13:14.517260 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-a49c10f3-ec65-4b26-bc78-5cb42cb7e96d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:13:14.517260 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:14.517260 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:14.517260 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:14.517260 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:14.517260 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:14.517260 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:14.517260 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:14.517260 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:14.517260 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:14.517260 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:14.517260 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:14.517260 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:13:14.517260 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:13:14.517260 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:13:14.517260 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:13:14.518491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:13:14.518491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:13:14.518491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:13:14.518491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:13:14.518491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:14.518491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:14.518491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:14.518491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:14.518491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:14.518491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:14.518491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:14.518491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:14.518491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:14.518491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:14.518491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:14.518491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:14.519744 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:14.519744 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:14.519744 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:14.519744 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:14.519744 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:13:14.519744 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:13:14.519744 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:13:14.519744 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:13:14.519744 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:13:14.519744 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:13:14.519744 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:13:14.519744 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:13:14.519744 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 622/1249] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:13:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:13:14.524955 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609592a3-fd67-49ca-9cb7-67c9107cedf4 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:14.630305 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609592a3-fd67-49ca-9cb7-67c9107cedf4 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:14.661384 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:14.667052 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa397e1-23a0-47a2-8b8c-08e5279ccfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:14.667767 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa397e1-23a0-47a2-8b8c-08e5279ccfea None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:14.668098 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa397e1-23a0-47a2-8b8c-08e5279ccfea None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:14.668509 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa397e1-23a0-47a2-8b8c-08e5279ccfea None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:14.669322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa397e1-23a0-47a2-8b8c-08e5279ccfea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:14.669629 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa397e1-23a0-47a2-8b8c-08e5279ccfea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:14.671205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa397e1-23a0-47a2-8b8c-08e5279ccfea None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:14.681636 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 628/1250] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:13:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:14.687549 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c10f3-ec65-4b26-bc78-5cb42cb7e96d None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:14.772061 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:14.798154 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c10f3-ec65-4b26-bc78-5cb42cb7e96d None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:14.834038 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06028347-25fe-4ea6-a990-405c8f088786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:14.834824 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06028347-25fe-4ea6-a990-405c8f088786 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:14.835101 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06028347-25fe-4ea6-a990-405c8f088786 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:14.835369 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06028347-25fe-4ea6-a990-405c8f088786 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:14.846255 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06028347-25fe-4ea6-a990-405c8f088786 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:14.847689 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06028347-25fe-4ea6-a990-405c8f088786 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:14.865114 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-06028347-25fe-4ea6-a990-405c8f088786 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:13:14.865114 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:14.865114 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:14.865114 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:14.865114 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:14.865114 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:14.865114 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:14.865114 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:14.865114 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:14.865114 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:14.865114 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:14.865114 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:14.865114 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:13:14.865114 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:13:14.865114 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:13:14.866340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:13:14.866340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:14.866340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:14.866340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:14.866340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:14.866340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:14.866340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:14.866340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:14.866340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:14.866340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:14.866340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:14.866340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:14.866340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:14.866340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:14.866340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:14.866340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:14.866340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:14.867354 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:13:14.867354 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:13:14.867354 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:13:14.867354 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:13:14.867354 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 623/1251] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:13:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:13:14.872235 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa397e1-23a0-47a2-8b8c-08e5279ccfea None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:14.993167 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa397e1-23a0-47a2-8b8c-08e5279ccfea None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:15.028642 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97154e87-d0a8-47bc-9a16-439cdae8beb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:15.029534 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97154e87-d0a8-47bc-9a16-439cdae8beb0 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:15.029812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97154e87-d0a8-47bc-9a16-439cdae8beb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:15.030112 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97154e87-d0a8-47bc-9a16-439cdae8beb0 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:15.031398 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97154e87-d0a8-47bc-9a16-439cdae8beb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:15.031773 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97154e87-d0a8-47bc-9a16-439cdae8beb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:15.033312 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97154e87-d0a8-47bc-9a16-439cdae8beb0 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:15.051911 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 629/1252] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:15.053663 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06028347-25fe-4ea6-a990-405c8f088786 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:15.163720 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06028347-25fe-4ea6-a990-405c8f088786 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:15.195409 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:15.205213 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194be3a-461e-464b-b460-dde51804f68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:15.206167 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194be3a-461e-464b-b460-dde51804f68f None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:15.206455 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194be3a-461e-464b-b460-dde51804f68f None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:15.206845 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194be3a-461e-464b-b460-dde51804f68f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:15.215077 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194be3a-461e-464b-b460-dde51804f68f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:15.216730 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194be3a-461e-464b-b460-dde51804f68f None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:15.233447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-8194be3a-461e-464b-b460-dde51804f68f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 04 08:13:15.233447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:15.233447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:15.233447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:15.233447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:15.233447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:15.233447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:15.233447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:15.233447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:15.233447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:15.233447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:15.233447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:15.233447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:13:15.233447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:13:15.233447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:13:15.233447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:13:15.241089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:15.241089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:15.241089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:13:15.241089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:13:15.241089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:13:15.241089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:13:15.241089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:15.241089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:15.241089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:15.241089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:15.241089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:15.241089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:15.241089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:15.241089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:15.241089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:15.241089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:15.241089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:15.241089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:15.243143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:15.243143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:15.243143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:13:15.243143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:13:15.243143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:13:15.243143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:13:15.243143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:13:15.243143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:13:15.243143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 04 08:13:15.243143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:13:15.243143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 624/1253] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:13:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:13:15.244792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97154e87-d0a8-47bc-9a16-439cdae8beb0 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:15.309159 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:15.355285 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97154e87-d0a8-47bc-9a16-439cdae8beb0 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:15.390667 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50cb2f-5cfd-4d23-a00e-bb66aa8b937a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:15.391337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50cb2f-5cfd-4d23-a00e-bb66aa8b937a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:15.391620 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50cb2f-5cfd-4d23-a00e-bb66aa8b937a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:15.391893 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50cb2f-5cfd-4d23-a00e-bb66aa8b937a None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:15.392728 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50cb2f-5cfd-4d23-a00e-bb66aa8b937a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:15.393035 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50cb2f-5cfd-4d23-a00e-bb66aa8b937a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:15.394498 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50cb2f-5cfd-4d23-a00e-bb66aa8b937a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:15.411670 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 630/1254] 10.222.0.57 () {56 vars in 1143 bytes} [Sat Jun 4 08:13:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:15.417403 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194be3a-461e-464b-b460-dde51804f68f None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:15.527670 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194be3a-461e-464b-b460-dde51804f68f None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:15.566975 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ffce4-53f9-456e-b7b4-d95f3c5c5a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:15.567654 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ffce4-53f9-456e-b7b4-d95f3c5c5a31 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:15.567932 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ffce4-53f9-456e-b7b4-d95f3c5c5a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:15.568199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ffce4-53f9-456e-b7b4-d95f3c5c5a31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:15.626255 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:15.638978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ffce4-53f9-456e-b7b4-d95f3c5c5a31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:15.640505 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ffce4-53f9-456e-b7b4-d95f3c5c5a31 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:15.749435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 625/1255] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:13:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 08:13:15.755595 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50cb2f-5cfd-4d23-a00e-bb66aa8b937a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:15.865999 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50cb2f-5cfd-4d23-a00e-bb66aa8b937a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:15.880935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:15.905221 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6105a-2e44-4d75-9dd9-dce5ffeffbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:15.906676 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6105a-2e44-4d75-9dd9-dce5ffeffbcc None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:15.906951 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6105a-2e44-4d75-9dd9-dce5ffeffbcc None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:15.907218 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6105a-2e44-4d75-9dd9-dce5ffeffbcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:15.922917 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6105a-2e44-4d75-9dd9-dce5ffeffbcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:15.924669 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6105a-2e44-4d75-9dd9-dce5ffeffbcc None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:15.946199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-06d6105a-2e44-4d75-9dd9-dce5ffeffbcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:13:15.946199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:15.946199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:15.946199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:15.946199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:15.946199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:15.946199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:15.946199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:15.946199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:15.946199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:15.946199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:15.946199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:15.946199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:13:15.946199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:13:15.946199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:13:15.947448 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:13:15.947448 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:15.947448 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:15.947448 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:15.947448 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:15.947448 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:15.947448 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:15.947448 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:15.947448 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:15.947448 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:15.947448 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:15.947448 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:15.947448 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:15.947448 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:15.947448 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:15.947448 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:15.947448 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:15.948559 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:13:15.948559 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:13:15.948559 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:13:15.948559 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:13:15.948559 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 631/1256] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:13:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:13:15.954859 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ffce4-53f9-456e-b7b4-d95f3c5c5a31 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:16.048878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:16.063173 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ffce4-53f9-456e-b7b4-d95f3c5c5a31 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:16.102017 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3a5b2-e51d-406f-b118-0e5b918d6b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:16.102754 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3a5b2-e51d-406f-b118-0e5b918d6b9e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:16.103046 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3a5b2-e51d-406f-b118-0e5b918d6b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:16.103379 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3a5b2-e51d-406f-b118-0e5b918d6b9e None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:16.104173 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f3a5b2-e51d-406f-b118-0e5b918d6b9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:16.104509 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f3a5b2-e51d-406f-b118-0e5b918d6b9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:16.105978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f3a5b2-e51d-406f-b118-0e5b918d6b9e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:16.118661 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 626/1257] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:16.123921 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6105a-2e44-4d75-9dd9-dce5ffeffbcc None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:16.230183 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6105a-2e44-4d75-9dd9-dce5ffeffbcc None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:16.267434 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91ba5c-a351-4363-bdcf-e9a4c4a97f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:16.268250 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91ba5c-a351-4363-bdcf-e9a4c4a97f12 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:16.268529 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91ba5c-a351-4363-bdcf-e9a4c4a97f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:16.268800 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91ba5c-a351-4363-bdcf-e9a4c4a97f12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:16.276474 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91ba5c-a351-4363-bdcf-e9a4c4a97f12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:16.277990 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91ba5c-a351-4363-bdcf-e9a4c4a97f12 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:16.292520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-ad91ba5c-a351-4363-bdcf-e9a4c4a97f12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:13:16.292520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:16.292520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:16.292520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:16.292520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:16.292520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:16.292520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:16.292520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:16.292520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:16.292520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:16.292520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:16.292520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:16.292520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:13:16.292520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:13:16.292520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:13:16.293652 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:13:16.293652 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:16.293652 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:16.293652 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:16.293652 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:16.293652 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:16.293652 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:16.293652 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:16.293652 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:16.293652 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:16.293652 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:16.293652 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:16.293652 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:16.293652 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:16.293652 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:16.293652 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:16.293652 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:16.294782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:13:16.294782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:13:16.294782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:13:16.294782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:13:16.294782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:13:16.294782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:13:16.294782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:13:16.294782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:13:16.298023 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 632/1258] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:13:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:13:16.299935 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3a5b2-e51d-406f-b118-0e5b918d6b9e None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:16.403995 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3a5b2-e51d-406f-b118-0e5b918d6b9e None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:16.439791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7fa8ef-e4b4-4b1d-a161-b335fa2e7970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:16.440460 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7fa8ef-e4b4-4b1d-a161-b335fa2e7970 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:16.440749 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7fa8ef-e4b4-4b1d-a161-b335fa2e7970 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:16.441024 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7fa8ef-e4b4-4b1d-a161-b335fa2e7970 None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:16.441807 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7fa8ef-e4b4-4b1d-a161-b335fa2e7970 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:16.442143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7fa8ef-e4b4-4b1d-a161-b335fa2e7970 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:16.443589 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7fa8ef-e4b4-4b1d-a161-b335fa2e7970 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:16.457116 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 627/1259] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:13:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:16.463771 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91ba5c-a351-4363-bdcf-e9a4c4a97f12 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:16.490531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:16.571321 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91ba5c-a351-4363-bdcf-e9a4c4a97f12 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:16.605353 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df301c99-4bbc-4906-9d06-d7d4ca19034d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:16.606051 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df301c99-4bbc-4906-9d06-d7d4ca19034d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:16.606344 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df301c99-4bbc-4906-9d06-d7d4ca19034d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:16.606619 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df301c99-4bbc-4906-9d06-d7d4ca19034d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:16.607445 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df301c99-4bbc-4906-9d06-d7d4ca19034d None admin] RBAC: Adding query filter params (role.id=431cef539cfb476aad50d2470e763b5f, scope.project.id=634c9a1745ef44c0ad66e02493d79af0, user.id=6fb6720f0d0141fea795cecfbf6f2538) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:16.607754 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df301c99-4bbc-4906-9d06-d7d4ca19034d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:16.609700 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df301c99-4bbc-4906-9d06-d7d4ca19034d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:16.615718 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 633/1260] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:13:16 2022] GET /identity/v3/role_assignments?user.id=6fb6720f0d0141fea795cecfbf6f2538&scope.project.id=634c9a1745ef44c0ad66e02493d79af0&role.id=431cef539cfb476aad50d2470e763b5f => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:18.833776 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a39f3-02e5-464a-9d76-b816bdd9f221 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:18.834330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a39f3-02e5-464a-9d76-b816bdd9f221 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:18.834330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a39f3-02e5-464a-9d76-b816bdd9f221 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:18.835699 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 628/1261] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:13:18.840745 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d120996-8683-417d-a1c9-397250cd8a15 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:18.841141 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d120996-8683-417d-a1c9-397250cd8a15 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:18.841301 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d120996-8683-417d-a1c9-397250cd8a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:18.859603 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-0d120996-8683-417d-a1c9-397250cd8a15 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:13:18.860780 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0d120996-8683-417d-a1c9-397250cd8a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:13:18.925264 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 634/1262] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:13:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:13:18.947719 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a39f3-02e5-464a-9d76-b816bdd9f221 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:18.958934 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:19.048453 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a39f3-02e5-464a-9d76-b816bdd9f221 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:19.081759 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fbc52-a60c-4765-ac88-8a771fbbae46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:19.082561 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fbc52-a60c-4765-ac88-8a771fbbae46 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:19.082837 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fbc52-a60c-4765-ac88-8a771fbbae46 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:19.083107 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fbc52-a60c-4765-ac88-8a771fbbae46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:19.093549 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99fbc52-a60c-4765-ac88-8a771fbbae46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:13:19.101033 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-d99fbc52-a60c-4765-ac88-8a771fbbae46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:13:19.101033 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:19.101033 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:19.101033 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:19.101033 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:19.101033 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:19.101033 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:19.101033 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:19.101033 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:19.101033 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:19.101033 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:19.101033 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:19.101033 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:13:19.101033 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:13:19.101033 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:13:19.101033 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:13:19.102189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:13:19.102189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:13:19.102189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:13:19.102189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:13:19.102189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:19.102189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:19.102189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:19.102189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:19.102189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:19.102189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:19.102189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:19.102189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:19.102189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:19.102189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:19.102189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:19.102189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:19.103255 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:19.103255 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:19.103255 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:19.103255 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:19.103255 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:13:19.103255 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:13:19.103255 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:13:19.103255 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:13:19.103255 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:13:19.103255 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:13:19.103255 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:13:19.103255 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:13:19.103255 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 629/1263] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:13:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:13:19.108128 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d120996-8683-417d-a1c9-397250cd8a15 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:19.125799 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:19.203341 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d120996-8683-417d-a1c9-397250cd8a15 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:19.235891 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b3bb4-9fe8-44ed-991b-63e588ba6cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:19.236544 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b3bb4-9fe8-44ed-991b-63e588ba6cbf None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:19.236825 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b3bb4-9fe8-44ed-991b-63e588ba6cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:19.237098 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b3bb4-9fe8-44ed-991b-63e588ba6cbf None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:19.237857 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b3bb4-9fe8-44ed-991b-63e588ba6cbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:19.238166 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b3bb4-9fe8-44ed-991b-63e588ba6cbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:19.239529 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b3bb4-9fe8-44ed-991b-63e588ba6cbf None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:19.247317 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 635/1264] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:13:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:19.253400 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fbc52-a60c-4765-ac88-8a771fbbae46 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:19.318720 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:19.352645 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fbc52-a60c-4765-ac88-8a771fbbae46 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:19.385232 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b6c42-b547-4211-badf-90e8a4a1501b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:19.386043 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b6c42-b547-4211-badf-90e8a4a1501b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:19.386330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b6c42-b547-4211-badf-90e8a4a1501b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:19.386604 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b6c42-b547-4211-badf-90e8a4a1501b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:19.397363 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b6c42-b547-4211-badf-90e8a4a1501b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:19.398898 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b6c42-b547-4211-badf-90e8a4a1501b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:19.415569 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-2e5b6c42-b547-4211-badf-90e8a4a1501b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:13:19.415569 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:19.415569 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:19.415569 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:19.415569 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:19.415569 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:19.415569 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:19.415569 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:19.415569 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:19.415569 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:19.415569 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:19.415569 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:19.415569 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:13:19.415569 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:13:19.415569 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:13:19.416657 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:13:19.416657 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:19.416657 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:19.416657 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:19.416657 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:19.416657 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:19.416657 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:19.416657 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:19.416657 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:19.416657 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:19.416657 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:19.416657 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:19.416657 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:19.416657 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:19.416657 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:19.416657 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:19.416657 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:19.417660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:13:19.417660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:13:19.417660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:13:19.417660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:13:19.417660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 630/1265] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:13:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:13:19.422381 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b3bb4-9fe8-44ed-991b-63e588ba6cbf None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:19.500329 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:19.518986 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b3bb4-9fe8-44ed-991b-63e588ba6cbf None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:19.550420 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2f90b-fc44-4f62-a100-844471b51176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:19.551066 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2f90b-fc44-4f62-a100-844471b51176 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:19.551351 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2f90b-fc44-4f62-a100-844471b51176 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:19.551628 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2f90b-fc44-4f62-a100-844471b51176 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:19.552336 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2f90b-fc44-4f62-a100-844471b51176 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:19.552641 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2f90b-fc44-4f62-a100-844471b51176 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:19.554304 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2f90b-fc44-4f62-a100-844471b51176 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:19.566149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 636/1266] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:19.571656 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b6c42-b547-4211-badf-90e8a4a1501b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:19.669078 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b6c42-b547-4211-badf-90e8a4a1501b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:19.689264 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:19.703166 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3d9af-5cfd-4daf-bb7e-546267a9e2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:19.704159 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3d9af-5cfd-4daf-bb7e-546267a9e2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:19.704448 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3d9af-5cfd-4daf-bb7e-546267a9e2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:19.704800 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3d9af-5cfd-4daf-bb7e-546267a9e2d4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:19.713058 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3d9af-5cfd-4daf-bb7e-546267a9e2d4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:19.714690 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3d9af-5cfd-4daf-bb7e-546267a9e2d4 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:19.730756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-13d3d9af-5cfd-4daf-bb7e-546267a9e2d4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 04 08:13:19.730756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:19.730756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:19.730756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:19.730756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:19.730756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:19.730756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:19.730756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:19.730756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:19.730756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:19.730756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:19.730756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:19.730756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:13:19.730756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:13:19.730756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:13:19.730756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:13:19.731915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:19.731915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:19.731915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:13:19.731915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:13:19.731915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:13:19.731915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:13:19.731915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:19.731915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:19.731915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:19.731915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:19.731915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:19.731915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:19.731915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:19.731915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:19.731915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:19.731915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:19.731915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:19.731915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:19.732898 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:19.732898 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:19.732898 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:13:19.732898 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:13:19.732898 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:13:19.732898 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:13:19.732898 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:13:19.732898 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:13:19.732898 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 04 08:13:19.732898 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:13:19.732898 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 631/1267] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:13:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:13:19.738499 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2f90b-fc44-4f62-a100-844471b51176 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:19.840075 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2f90b-fc44-4f62-a100-844471b51176 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:19.872629 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247897cb-2c03-455f-bb91-6a39d3aa3416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:19.873290 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247897cb-2c03-455f-bb91-6a39d3aa3416 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:19.873573 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247897cb-2c03-455f-bb91-6a39d3aa3416 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:19.873872 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247897cb-2c03-455f-bb91-6a39d3aa3416 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:19.875268 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247897cb-2c03-455f-bb91-6a39d3aa3416 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:19.875577 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247897cb-2c03-455f-bb91-6a39d3aa3416 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:19.876994 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247897cb-2c03-455f-bb91-6a39d3aa3416 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:19.885284 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:19.893549 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 637/1268] 10.222.0.57 () {56 vars in 1143 bytes} [Sat Jun 4 08:13:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:13:19.899152 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3d9af-5cfd-4daf-bb7e-546267a9e2d4 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:19.999156 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3d9af-5cfd-4daf-bb7e-546267a9e2d4 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:20.031306 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211eea5-cb56-4cc4-bb4a-10fa96ddd42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:20.032080 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211eea5-cb56-4cc4-bb4a-10fa96ddd42a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:20.032360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211eea5-cb56-4cc4-bb4a-10fa96ddd42a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:20.032629 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211eea5-cb56-4cc4-bb4a-10fa96ddd42a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:20.042763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211eea5-cb56-4cc4-bb4a-10fa96ddd42a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:20.044190 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211eea5-cb56-4cc4-bb4a-10fa96ddd42a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:20.061470 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-e211eea5-cb56-4cc4-bb4a-10fa96ddd42a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:13:20.061470 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:20.061470 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:20.061470 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:20.061470 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:20.061470 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:20.061470 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:20.061470 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:20.061470 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:20.061470 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:20.061470 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:20.061470 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:20.061470 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:13:20.061470 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:13:20.061470 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:13:20.062544 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:13:20.062544 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:20.062544 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:20.062544 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:20.062544 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:20.062544 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:20.062544 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:20.062544 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:20.062544 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:20.062544 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:20.062544 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:20.062544 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:20.062544 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:20.062544 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:20.062544 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:20.062544 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:20.062544 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:20.063898 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:13:20.063898 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:13:20.063898 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:13:20.063898 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:13:20.063898 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 632/1269] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:13:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 08:13:20.068246 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247897cb-2c03-455f-bb91-6a39d3aa3416 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:20.166864 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247897cb-2c03-455f-bb91-6a39d3aa3416 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:20.200196 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45c761-f986-40f5-9dbb-0a4938815ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:20.200846 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45c761-f986-40f5-9dbb-0a4938815ecd None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:20.201132 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45c761-f986-40f5-9dbb-0a4938815ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:20.201415 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45c761-f986-40f5-9dbb-0a4938815ecd None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:20.202229 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45c761-f986-40f5-9dbb-0a4938815ecd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:20.202540 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45c761-f986-40f5-9dbb-0a4938815ecd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:20.203907 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45c761-f986-40f5-9dbb-0a4938815ecd None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:20.214803 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 638/1270] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:20.220772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211eea5-cb56-4cc4-bb4a-10fa96ddd42a None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:20.251696 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:20.318222 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211eea5-cb56-4cc4-bb4a-10fa96ddd42a None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:20.350662 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092f35b-1e3d-46dd-ac78-e200c1227112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:20.351432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092f35b-1e3d-46dd-ac78-e200c1227112 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:20.351715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092f35b-1e3d-46dd-ac78-e200c1227112 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:20.351990 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092f35b-1e3d-46dd-ac78-e200c1227112 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:20.359069 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092f35b-1e3d-46dd-ac78-e200c1227112 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:20.360495 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092f35b-1e3d-46dd-ac78-e200c1227112 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:20.374285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-f092f35b-1e3d-46dd-ac78-e200c1227112 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:13:20.374285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:20.374285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:20.374285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:20.374285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:20.374285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:20.374285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:20.374285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:20.374285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:20.374285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:20.374285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:20.374285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:20.374285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:13:20.374285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:13:20.374285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:13:20.375331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:13:20.375331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:20.375331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:20.375331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:20.375331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:20.375331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:20.375331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:20.375331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:20.375331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:20.375331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:20.375331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:20.375331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:20.375331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:20.375331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:20.375331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:20.375331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:20.375331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:20.376451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:13:20.376451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:13:20.376451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:13:20.376451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:13:20.376451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:13:20.376451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:13:20.376451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:13:20.376451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:13:20.376451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 633/1271] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:13:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:13:20.381261 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45c761-f986-40f5-9dbb-0a4938815ecd None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:20.438379 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:20.478613 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45c761-f986-40f5-9dbb-0a4938815ecd None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:20.509875 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fe9b6-d923-45dc-ab74-d660f0efa37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:20.510463 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fe9b6-d923-45dc-ab74-d660f0efa37a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:20.510736 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fe9b6-d923-45dc-ab74-d660f0efa37a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:20.511002 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fe9b6-d923-45dc-ab74-d660f0efa37a None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:20.511767 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fe9b6-d923-45dc-ab74-d660f0efa37a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:20.512066 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fe9b6-d923-45dc-ab74-d660f0efa37a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:20.513488 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fe9b6-d923-45dc-ab74-d660f0efa37a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:20.525429 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 639/1272] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:13:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:20.531892 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092f35b-1e3d-46dd-ac78-e200c1227112 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:20.620007 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:20.629186 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092f35b-1e3d-46dd-ac78-e200c1227112 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:20.662956 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40786c57-7975-45b1-9687-1f231251fcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:20.663819 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40786c57-7975-45b1-9687-1f231251fcc5 None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:20.664102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40786c57-7975-45b1-9687-1f231251fcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:20.664377 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40786c57-7975-45b1-9687-1f231251fcc5 None admin] PATH_INFO: `/v3/projects/634c9a1745ef44c0ad66e02493d79af0/users/6fb6720f0d0141fea795cecfbf6f2538/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:20.666373 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40786c57-7975-45b1-9687-1f231251fcc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=634c9a1745ef44c0ad66e02493d79af0, user_id=6fb6720f0d0141fea795cecfbf6f2538, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:20.667795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40786c57-7975-45b1-9687-1f231251fcc5 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:20.679995 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 634/1273] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jun 4 08:13:20 2022] PUT /identity/v3/projects/634c9a1745ef44c0ad66e02493d79af0/users/6fb6720f0d0141fea795cecfbf6f2538/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:13:22.878944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5bd03-09ee-41fd-ab95-f32c3294bab9 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:22.879478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5bd03-09ee-41fd-ab95-f32c3294bab9 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:22.879478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5bd03-09ee-41fd-ab95-f32c3294bab9 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:22.880886 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 640/1274] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:13:22.886042 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e8edc-264d-4ce1-9373-e7966a28fccc None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:22.886460 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e8edc-264d-4ce1-9373-e7966a28fccc None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:22.886593 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e8edc-264d-4ce1-9373-e7966a28fccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:22.903402 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-990e8edc-264d-4ce1-9373-e7966a28fccc None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:13:22.904558 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-990e8edc-264d-4ce1-9373-e7966a28fccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:13:22.971085 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 635/1275] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:13:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:13:22.993777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5bd03-09ee-41fd-ab95-f32c3294bab9 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:23.091872 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5bd03-09ee-41fd-ab95-f32c3294bab9 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:23.109343 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:23.125632 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45b0c1-cb36-4452-964e-5db6298d9ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:23.126445 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45b0c1-cb36-4452-964e-5db6298d9ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:23.126730 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45b0c1-cb36-4452-964e-5db6298d9ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:23.127005 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45b0c1-cb36-4452-964e-5db6298d9ce5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:23.136844 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45b0c1-cb36-4452-964e-5db6298d9ce5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 08:13:23.144513 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-ae45b0c1-cb36-4452-964e-5db6298d9ce5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:13:23.144513 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:23.144513 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:23.144513 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:23.144513 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:23.144513 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:23.144513 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:23.144513 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:23.144513 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:23.144513 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:23.144513 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:23.144513 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:23.144513 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 08:13:23.144513 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 08:13:23.144513 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 08:13:23.144513 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 08:13:23.145598 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 08:13:23.145598 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 08:13:23.145598 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 08:13:23.145598 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 08:13:23.145598 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:23.145598 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:23.145598 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:23.145598 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:23.145598 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:23.145598 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:23.145598 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:23.145598 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:23.145598 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:23.145598 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:23.145598 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:23.145598 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:23.146917 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:23.146917 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:23.146917 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:23.146917 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:23.146917 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 08:13:23.146917 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 08:13:23.146917 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 08:13:23.146917 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 08:13:23.146917 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 08:13:23.146917 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 08:13:23.146917 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 08:13:23.146917 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:13:23.146917 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 641/1276] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jun 4 08:13:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:13:23.151479 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e8edc-264d-4ce1-9373-e7966a28fccc None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:23.230882 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:23.249788 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e8edc-264d-4ce1-9373-e7966a28fccc None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:23.282624 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929108d-73e2-4114-8cad-773d9010c670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:23.283277 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929108d-73e2-4114-8cad-773d9010c670 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:23.283560 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929108d-73e2-4114-8cad-773d9010c670 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:23.283838 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929108d-73e2-4114-8cad-773d9010c670 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:23.284573 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929108d-73e2-4114-8cad-773d9010c670 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:23.284879 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929108d-73e2-4114-8cad-773d9010c670 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:23.286379 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929108d-73e2-4114-8cad-773d9010c670 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:23.294138 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 636/1277] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jun 4 08:13:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:23.300221 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45b0c1-cb36-4452-964e-5db6298d9ce5 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:23.397767 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45b0c1-cb36-4452-964e-5db6298d9ce5 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:23.430245 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb346e-802c-41fe-bb2e-5395a8cc7ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:23.431020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb346e-802c-41fe-bb2e-5395a8cc7ffa None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:23.431309 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb346e-802c-41fe-bb2e-5395a8cc7ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:23.431585 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb346e-802c-41fe-bb2e-5395a8cc7ffa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:23.442111 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb346e-802c-41fe-bb2e-5395a8cc7ffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:23.443554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb346e-802c-41fe-bb2e-5395a8cc7ffa None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:23.460635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-b8eb346e-802c-41fe-bb2e-5395a8cc7ffa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:13:23.460635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:23.460635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:23.460635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:23.460635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:23.460635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:23.460635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:23.460635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:23.460635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:23.460635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:23.460635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:23.460635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:23.460635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:13:23.460635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:13:23.460635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:13:23.461712 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:13:23.461712 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:23.461712 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:23.461712 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:23.461712 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:23.461712 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:23.461712 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:23.461712 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:23.461712 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:23.461712 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:23.461712 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:23.461712 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:23.461712 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:23.461712 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:23.461712 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:23.461712 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:23.461712 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:23.463050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:13:23.463050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:13:23.463050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:13:23.463050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:13:23.463050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 642/1278] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:13:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:13:23.467464 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929108d-73e2-4114-8cad-773d9010c670 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:23.572376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929108d-73e2-4114-8cad-773d9010c670 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:23.606398 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568f822-17eb-4300-ada2-f14a123ad5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:23.607045 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568f822-17eb-4300-ada2-f14a123ad5ce None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:23.607327 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568f822-17eb-4300-ada2-f14a123ad5ce None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:23.607599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568f822-17eb-4300-ada2-f14a123ad5ce None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:23.608308 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568f822-17eb-4300-ada2-f14a123ad5ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:23.608610 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568f822-17eb-4300-ada2-f14a123ad5ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:23.610000 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568f822-17eb-4300-ada2-f14a123ad5ce None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:23.621464 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 637/1279] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:23.627078 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb346e-802c-41fe-bb2e-5395a8cc7ffa None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:23.657868 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:23.727418 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb346e-802c-41fe-bb2e-5395a8cc7ffa None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:23.764295 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c565b3-c59b-4921-b07e-90d68ce32a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:23.765857 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c565b3-c59b-4921-b07e-90d68ce32a28 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:23.766216 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c565b3-c59b-4921-b07e-90d68ce32a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:23.766523 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c565b3-c59b-4921-b07e-90d68ce32a28 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:23.774985 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c565b3-c59b-4921-b07e-90d68ce32a28 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:23.776470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c565b3-c59b-4921-b07e-90d68ce32a28 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:23.792109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-e1c565b3-c59b-4921-b07e-90d68ce32a28 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 04 08:13:23.792109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:23.792109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:23.792109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:23.792109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:23.792109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:23.792109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:23.792109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:23.792109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:23.792109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:23.792109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:23.792109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:23.792109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 08:13:23.792109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 08:13:23.792109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 08:13:23.792109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 08:13:23.793259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:23.793259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:23.793259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 08:13:23.793259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:13:23.793259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 08:13:23.793259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 08:13:23.793259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:23.793259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:23.793259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:23.793259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:23.793259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:23.793259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:23.793259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:23.793259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:23.793259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:23.793259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:23.793259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:23.793259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:23.794493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:23.794493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:23.794493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 08:13:23.794493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 08:13:23.794493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 08:13:23.794493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 08:13:23.794493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 08:13:23.794493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 08:13:23.794493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 04 08:13:23.794493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:13:23.794493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 643/1280] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:13:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:13:23.801772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568f822-17eb-4300-ada2-f14a123ad5ce None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:23.805776 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:23.897786 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568f822-17eb-4300-ada2-f14a123ad5ce None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:23.935012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2260d8d-166a-4cd3-99c8-275eb3e27138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:23.935494 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2260d8d-166a-4cd3-99c8-275eb3e27138 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:23.935773 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2260d8d-166a-4cd3-99c8-275eb3e27138 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:23.936050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2260d8d-166a-4cd3-99c8-275eb3e27138 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:23.936924 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2260d8d-166a-4cd3-99c8-275eb3e27138 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:23.937229 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2260d8d-166a-4cd3-99c8-275eb3e27138 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:23.938686 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2260d8d-166a-4cd3-99c8-275eb3e27138 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:23.955101 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 638/1281] 10.222.0.57 () {56 vars in 1143 bytes} [Sat Jun 4 08:13:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:23.960746 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c565b3-c59b-4921-b07e-90d68ce32a28 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:24.049732 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:24.059652 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c565b3-c59b-4921-b07e-90d68ce32a28 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:24.098651 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351fb54-921c-4630-aa22-64dee6efcae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:24.099460 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351fb54-921c-4630-aa22-64dee6efcae0 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:24.099746 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351fb54-921c-4630-aa22-64dee6efcae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:24.100023 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351fb54-921c-4630-aa22-64dee6efcae0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:24.166114 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351fb54-921c-4630-aa22-64dee6efcae0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:24.167506 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351fb54-921c-4630-aa22-64dee6efcae0 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:24.260679 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:24.271497 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 644/1282] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jun 4 08:13:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 08:13:24.277260 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2260d8d-166a-4cd3-99c8-275eb3e27138 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:24.338656 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:24.377923 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2260d8d-166a-4cd3-99c8-275eb3e27138 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:24.411084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec94a5-094d-4658-b12f-310794288601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:24.411868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec94a5-094d-4658-b12f-310794288601 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:24.412155 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec94a5-094d-4658-b12f-310794288601 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:24.412432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec94a5-094d-4658-b12f-310794288601 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:24.423013 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec94a5-094d-4658-b12f-310794288601 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:24.424437 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec94a5-094d-4658-b12f-310794288601 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:24.442801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-35ec94a5-094d-4658-b12f-310794288601 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:13:24.442801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:24.442801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:24.442801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:24.442801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:24.442801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:24.442801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:24.442801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:24.442801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:24.442801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:24.442801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:24.442801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:24.442801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 08:13:24.442801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 08:13:24.442801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 08:13:24.443887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 08:13:24.443887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:24.443887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:24.443887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:24.443887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:24.443887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:24.443887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:24.443887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:24.443887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:24.443887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:24.443887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:24.443887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:24.443887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:24.443887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:24.443887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:24.443887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:24.443887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:24.445020 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 08:13:24.445020 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 08:13:24.445020 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 08:13:24.445020 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:13:24.445020 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 639/1283] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:13:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:13:24.449751 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351fb54-921c-4630-aa22-64dee6efcae0 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:24.548671 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351fb54-921c-4630-aa22-64dee6efcae0 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:24.583161 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea157ac-f303-4ff7-9b10-71499da3af53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:24.583820 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea157ac-f303-4ff7-9b10-71499da3af53 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:24.584107 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea157ac-f303-4ff7-9b10-71499da3af53 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:24.584385 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea157ac-f303-4ff7-9b10-71499da3af53 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:24.585097 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea157ac-f303-4ff7-9b10-71499da3af53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:24.585404 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea157ac-f303-4ff7-9b10-71499da3af53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:24.586806 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea157ac-f303-4ff7-9b10-71499da3af53 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:24.598415 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 645/1284] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jun 4 08:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:24.604024 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec94a5-094d-4658-b12f-310794288601 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:24.705236 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec94a5-094d-4658-b12f-310794288601 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:24.723924 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:24.746036 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff146a-30f6-4588-9332-f6600bdcc760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:24.746833 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff146a-30f6-4588-9332-f6600bdcc760 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:24.747114 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff146a-30f6-4588-9332-f6600bdcc760 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:24.747389 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff146a-30f6-4588-9332-f6600bdcc760 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:24.756058 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff146a-30f6-4588-9332-f6600bdcc760 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:24.757515 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff146a-30f6-4588-9332-f6600bdcc760 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:24.771344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-44ff146a-30f6-4588-9332-f6600bdcc760 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:13:24.771344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:24.771344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:24.771344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:24.771344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:24.771344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:24.771344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:24.771344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:24.771344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:24.771344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:24.771344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:24.771344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:24.771344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 08:13:24.771344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 08:13:24.771344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 08:13:24.772430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 08:13:24.772430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:24.772430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:24.772430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:24.772430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:24.772430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:24.772430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:24.772430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:24.772430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:24.772430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:24.772430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:24.772430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:24.772430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:24.772430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:24.772430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:24.772430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:24.772430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:24.773663 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 08:13:24.773663 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 08:13:24.773663 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 08:13:24.773663 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 08:13:24.773663 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 08:13:24.773663 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 08:13:24.773663 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 08:13:24.773663 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Jun 04 08:13:24.773663 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 640/1285] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jun 4 08:13:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:13:24.779249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea157ac-f303-4ff7-9b10-71499da3af53 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:24.832977 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:24.888114 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea157ac-f303-4ff7-9b10-71499da3af53 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:24.926331 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277dc20-7144-40a3-aa3f-03eb0e01e5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:24.926995 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277dc20-7144-40a3-aa3f-03eb0e01e5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:24.927307 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277dc20-7144-40a3-aa3f-03eb0e01e5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:24.927585 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277dc20-7144-40a3-aa3f-03eb0e01e5b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:24.928635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277dc20-7144-40a3-aa3f-03eb0e01e5b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:24.928941 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277dc20-7144-40a3-aa3f-03eb0e01e5b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:24.930421 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277dc20-7144-40a3-aa3f-03eb0e01e5b1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:24.942228 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 646/1286] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jun 4 08:13:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:24.948121 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff146a-30f6-4588-9332-f6600bdcc760 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:25.046289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff146a-30f6-4588-9332-f6600bdcc760 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:25.079154 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea389750-233a-4564-9e42-21d76707a769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:25.079788 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea389750-233a-4564-9e42-21d76707a769 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:25.080067 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea389750-233a-4564-9e42-21d76707a769 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:25.080338 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea389750-233a-4564-9e42-21d76707a769 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:25.081150 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea389750-233a-4564-9e42-21d76707a769 None admin] RBAC: Adding query filter params (role.id=431cef539cfb476aad50d2470e763b5f, scope.project.id=634c9a1745ef44c0ad66e02493d79af0, user.id=6fb6720f0d0141fea795cecfbf6f2538) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:25.081459 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea389750-233a-4564-9e42-21d76707a769 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:25.082913 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea389750-233a-4564-9e42-21d76707a769 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:25.088597 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 641/1287] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jun 4 08:13:24 2022] GET /identity/v3/role_assignments?user.id=6fb6720f0d0141fea795cecfbf6f2538&scope.project.id=634c9a1745ef44c0ad66e02493d79af0&role.id=431cef539cfb476aad50d2470e763b5f => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:27.314594 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b663ada-251f-4b5d-bba2-1e14c5a8403d None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:27.315147 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b663ada-251f-4b5d-bba2-1e14c5a8403d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:27.315147 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b663ada-251f-4b5d-bba2-1e14c5a8403d None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:27.316510 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 647/1288] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:13:27.321737 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074dab9-3d15-43d1-b49d-92b680c7aa90 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:27.322167 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074dab9-3d15-43d1-b49d-92b680c7aa90 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:27.322328 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074dab9-3d15-43d1-b49d-92b680c7aa90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:27.338667 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-e074dab9-3d15-43d1-b49d-92b680c7aa90 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:13:27.339857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e074dab9-3d15-43d1-b49d-92b680c7aa90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:13:27.368794 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:27.404943 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 642/1289] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:13:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:13:27.427345 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b663ada-251f-4b5d-bba2-1e14c5a8403d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:27.525763 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b663ada-251f-4b5d-bba2-1e14c5a8403d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:27.536478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:27.560015 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd387d20-9145-488b-924b-8cc855a9b4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:27.560798 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd387d20-9145-488b-924b-8cc855a9b4bf None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:27.561080 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd387d20-9145-488b-924b-8cc855a9b4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:27.561354 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd387d20-9145-488b-924b-8cc855a9b4bf None admin] PATH_INFO: `/v3/services/placement` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:27.562047 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd387d20-9145-488b-924b-8cc855a9b4bf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:27.563404 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd387d20-9145-488b-924b-8cc855a9b4bf None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:27.574982 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-cd387d20-9145-488b-924b-8cc855a9b4bf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 08:13:27.574982 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:27.574982 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 08:13:27.574982 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 08:13:27.574982 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 08:13:27.574982 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 08:13:27.574982 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 08:13:27.574982 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:13:27.574982 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 08:13:27.574982 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:13:27.574982 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 08:13:27.574982 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:13:27.574982 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:27.574982 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:27.574982 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:27.574982 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:27.574982 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:27.576220 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:27.576220 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:27.576220 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:27.576220 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:27.576220 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:27.576220 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:27.576220 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 08:13:27.576220 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 08:13:27.576220 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 08:13:27.576220 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 08:13:27.576220 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:27.576220 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:27.576220 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:27.576220 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:27.576220 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:27.576220 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:27.577392 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:27.577392 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:27.577392 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:27.577392 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:27.577392 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:27.577392 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:27.577392 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:27.577392 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:27.577392 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:27.577392 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:27.577392 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 08:13:27.577392 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:13:27.577392 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 08:13:27.577392 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:13:27.577392 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 648/1290] 10.222.0.57 () {56 vars in 1117 bytes} [Sat Jun 4 08:13:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:13:27.582225 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074dab9-3d15-43d1-b49d-92b680c7aa90 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:27.678630 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074dab9-3d15-43d1-b49d-92b680c7aa90 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:27.711384 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb2258-8f1c-455c-8aa5-44530853fbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:27.711967 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb2258-8f1c-455c-8aa5-44530853fbf1 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:27.712249 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb2258-8f1c-455c-8aa5-44530853fbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:27.712525 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb2258-8f1c-455c-8aa5-44530853fbf1 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:27.713294 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb2258-8f1c-455c-8aa5-44530853fbf1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:27.713530 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb2258-8f1c-455c-8aa5-44530853fbf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:27.714937 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb2258-8f1c-455c-8aa5-44530853fbf1 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:27.720499 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 643/1291] 10.222.0.57 () {56 vars in 1116 bytes} [Sat Jun 4 08:13:27 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:27.726453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd387d20-9145-488b-924b-8cc855a9b4bf None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:27.833224 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd387d20-9145-488b-924b-8cc855a9b4bf None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:27.866277 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9f7e4-3990-4f6d-ab81-1936a2208dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:27.866928 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9f7e4-3990-4f6d-ab81-1936a2208dee None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:27.867212 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9f7e4-3990-4f6d-ab81-1936a2208dee None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:27.867489 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9f7e4-3990-4f6d-ab81-1936a2208dee None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:27.868184 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9f7e4-3990-4f6d-ab81-1936a2208dee None admin] RBAC: Adding query filter params (type=placement) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:27.868490 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9f7e4-3990-4f6d-ab81-1936a2208dee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:27.869902 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9f7e4-3990-4f6d-ab81-1936a2208dee None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:27.874298 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 649/1292] 10.222.0.57 () {56 vars in 1116 bytes} [Sat Jun 4 08:13:27 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:30.088102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051c4b7-63e1-492d-903a-d63997b89f08 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:30.088643 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051c4b7-63e1-492d-903a-d63997b89f08 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:30.088643 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051c4b7-63e1-492d-903a-d63997b89f08 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:30.090042 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 644/1293] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:13:30.095142 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae30e51-19c4-4b36-b7ef-b15a0dab6d6b None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:30.095577 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae30e51-19c4-4b36-b7ef-b15a0dab6d6b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:30.095710 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae30e51-19c4-4b36-b7ef-b15a0dab6d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:30.113422 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6ae30e51-19c4-4b36-b7ef-b15a0dab6d6b None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:13:30.115408 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6ae30e51-19c4-4b36-b7ef-b15a0dab6d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:13:30.144449 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:30.185806 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 650/1294] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:13:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:13:30.208720 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051c4b7-63e1-492d-903a-d63997b89f08 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:30.239186 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:30.307004 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051c4b7-63e1-492d-903a-d63997b89f08 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:30.339336 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c256535-eb13-43d6-ac49-6aeb07c7f837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:30.339978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c256535-eb13-43d6-ac49-6aeb07c7f837 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:30.340262 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c256535-eb13-43d6-ac49-6aeb07c7f837 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:30.340536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c256535-eb13-43d6-ac49-6aeb07c7f837 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:30.341251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c256535-eb13-43d6-ac49-6aeb07c7f837 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:30.342675 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c256535-eb13-43d6-ac49-6aeb07c7f837 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:30.354766 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 645/1295] 10.222.0.57 () {60 vars in 1141 bytes} [Sat Jun 4 08:13:30 2022] POST /identity/v3/services => generated 246 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:13:32.608986 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e3cf8-db72-440b-a687-eb9476dbb66a None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:32.609515 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e3cf8-db72-440b-a687-eb9476dbb66a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:32.609515 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e3cf8-db72-440b-a687-eb9476dbb66a None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:32.610940 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 651/1296] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:13:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:13:32.616175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04ca16-2bf2-4da3-bbed-9ce70e124be6 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:32.616576 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04ca16-2bf2-4da3-bbed-9ce70e124be6 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:32.616733 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04ca16-2bf2-4da3-bbed-9ce70e124be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:32.633731 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-ee04ca16-2bf2-4da3-bbed-9ce70e124be6 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:13:32.634947 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ee04ca16-2bf2-4da3-bbed-9ce70e124be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:13:32.705437 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 646/1297] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:13:32 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:13:32.729438 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e3cf8-db72-440b-a687-eb9476dbb66a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:32.827733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e3cf8-db72-440b-a687-eb9476dbb66a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:32.860859 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1802bb-72cd-4b39-9ab3-0ff1b436208d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:32.861573 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1802bb-72cd-4b39-9ab3-0ff1b436208d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:32.861880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1802bb-72cd-4b39-9ab3-0ff1b436208d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:32.862158 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1802bb-72cd-4b39-9ab3-0ff1b436208d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:32.862796 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1802bb-72cd-4b39-9ab3-0ff1b436208d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:32.864149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1802bb-72cd-4b39-9ab3-0ff1b436208d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:32.875760 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-2d1802bb-72cd-4b39-9ab3-0ff1b436208d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 08:13:32.875760 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:32.875760 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 08:13:32.875760 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 08:13:32.875760 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 08:13:32.875760 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 08:13:32.875760 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 08:13:32.875760 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:13:32.875760 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 08:13:32.875760 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:13:32.875760 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 08:13:32.875760 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:13:32.875760 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:32.875760 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:32.875760 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:32.875760 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:32.875760 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:32.876934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:32.876934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:32.876934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:32.876934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:32.876934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:32.876934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:32.876934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 08:13:32.876934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 08:13:32.876934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 08:13:32.876934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 08:13:32.876934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:32.876934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:32.876934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:32.876934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:32.876934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:32.876934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:32.878275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:32.878275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:32.878275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:32.878275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:32.878275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:32.878275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:32.878275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:32.878275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:32.878275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:32.878275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:32.878275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 08:13:32.878275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:13:32.878275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 08:13:32.878275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:13:32.878275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 652/1298] 10.222.0.57 () {56 vars in 1117 bytes} [Sat Jun 4 08:13:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:13:32.882821 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04ca16-2bf2-4da3-bbed-9ce70e124be6 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:32.900665 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:32.982091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04ca16-2bf2-4da3-bbed-9ce70e124be6 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:33.014718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba71934-4ddf-4480-8c84-24bc59387355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:33.015366 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba71934-4ddf-4480-8c84-24bc59387355 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:33.015646 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba71934-4ddf-4480-8c84-24bc59387355 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:33.015917 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba71934-4ddf-4480-8c84-24bc59387355 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:33.016606 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba71934-4ddf-4480-8c84-24bc59387355 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:33.016907 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba71934-4ddf-4480-8c84-24bc59387355 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:33.018309 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba71934-4ddf-4480-8c84-24bc59387355 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:33.023303 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 647/1299] 10.222.0.57 () {56 vars in 1116 bytes} [Sat Jun 4 08:13:32 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:33.029048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1802bb-72cd-4b39-9ab3-0ff1b436208d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:33.060386 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:33.126799 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1802bb-72cd-4b39-9ab3-0ff1b436208d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:33.159459 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74cbfc-598a-43d5-9f49-4937a5943fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:33.160094 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74cbfc-598a-43d5-9f49-4937a5943fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:33.160375 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74cbfc-598a-43d5-9f49-4937a5943fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:33.160652 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74cbfc-598a-43d5-9f49-4937a5943fa7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:33.161432 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74cbfc-598a-43d5-9f49-4937a5943fa7 None admin] RBAC: Adding query filter params (interface=public, service_id=cfb2ab0f5da14fcc9ec011709870910b, region_id=RegionOne) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:33.161740 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74cbfc-598a-43d5-9f49-4937a5943fa7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:33.163126 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74cbfc-598a-43d5-9f49-4937a5943fa7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:33.167966 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 653/1300] 10.222.0.57 () {56 vars in 1251 bytes} [Sat Jun 4 08:13:33 2022] GET /identity/v3/endpoints?service_id=cfb2ab0f5da14fcc9ec011709870910b&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:33.173375 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba71934-4ddf-4480-8c84-24bc59387355 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:33.253636 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:33.271829 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba71934-4ddf-4480-8c84-24bc59387355 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:33.309148 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638be43-cc5b-4fa6-955d-402480f10754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:33.309798 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638be43-cc5b-4fa6-955d-402480f10754 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:33.310109 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638be43-cc5b-4fa6-955d-402480f10754 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:33.310380 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638be43-cc5b-4fa6-955d-402480f10754 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:33.311045 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d638be43-cc5b-4fa6-955d-402480f10754 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:33.313024 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d638be43-cc5b-4fa6-955d-402480f10754 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:33.319653 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 648/1301] 10.222.0.57 () {56 vars in 1087 bytes} [Sat Jun 4 08:13:33 2022] GET /identity/v3/services => generated 2191 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:13:35.504337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96bbf1-7d78-4957-a2a5-6f5bc78d5675 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:35.504871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96bbf1-7d78-4957-a2a5-6f5bc78d5675 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:35.504871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96bbf1-7d78-4957-a2a5-6f5bc78d5675 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:35.506284 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 654/1302] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:13:35.511504 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc98bda-9fdf-429a-a3e5-2184b4d98ab0 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:35.511950 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc98bda-9fdf-429a-a3e5-2184b4d98ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:35.512046 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc98bda-9fdf-429a-a3e5-2184b4d98ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:35.528117 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-6dc98bda-9fdf-429a-a3e5-2184b4d98ab0 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:13:35.529273 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-6dc98bda-9fdf-429a-a3e5-2184b4d98ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:13:35.594023 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 649/1303] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:13:35 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 08:13:35.616564 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96bbf1-7d78-4957-a2a5-6f5bc78d5675 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:35.708676 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:35.716058 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96bbf1-7d78-4957-a2a5-6f5bc78d5675 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:35.753531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e1014-eb7a-45ca-912f-266be4d263a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:35.754431 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e1014-eb7a-45ca-912f-266be4d263a6 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:35.754640 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e1014-eb7a-45ca-912f-266be4d263a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:35.754908 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e1014-eb7a-45ca-912f-266be4d263a6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:35.755551 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e1014-eb7a-45ca-912f-266be4d263a6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:35.756901 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e1014-eb7a-45ca-912f-266be4d263a6 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:35.768459 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-388e1014-eb7a-45ca-912f-266be4d263a6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 08:13:35.768459 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:35.768459 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 08:13:35.768459 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 08:13:35.768459 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 08:13:35.768459 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 08:13:35.768459 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 08:13:35.768459 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:13:35.768459 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 08:13:35.768459 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:13:35.768459 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 08:13:35.768459 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:13:35.768459 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 08:13:35.768459 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 08:13:35.768459 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 08:13:35.768459 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 08:13:35.768459 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 08:13:35.769614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 08:13:35.769614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 08:13:35.769614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 08:13:35.769614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 08:13:35.769614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 08:13:35.769614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 08:13:35.769614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 08:13:35.769614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 08:13:35.769614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 08:13:35.769614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 08:13:35.769614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 08:13:35.769614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 08:13:35.769614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 08:13:35.769614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 08:13:35.769614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 08:13:35.769614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 08:13:35.770673 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 08:13:35.770673 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jun 04 08:13:35.770673 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 08:13:35.770673 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jun 04 08:13:35.770673 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 08:13:35.770673 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 08:13:35.770673 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 08:13:35.770673 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jun 04 08:13:35.770673 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 08:13:35.770673 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jun 04 08:13:35.770673 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 08:13:35.770673 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 08:13:35.770673 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 08:13:35.770673 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jun 04 08:13:35.770673 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 655/1304] 10.222.0.57 () {56 vars in 1117 bytes} [Sat Jun 4 08:13:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 08:13:35.775804 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc98bda-9fdf-429a-a3e5-2184b4d98ab0 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:35.850153 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:35.872827 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc98bda-9fdf-429a-a3e5-2184b4d98ab0 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:35.905831 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0430bee-8686-4c82-b1e5-315931a8e3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:35.906500 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0430bee-8686-4c82-b1e5-315931a8e3d6 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:35.906782 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0430bee-8686-4c82-b1e5-315931a8e3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:35.907055 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0430bee-8686-4c82-b1e5-315931a8e3d6 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:35.907749 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0430bee-8686-4c82-b1e5-315931a8e3d6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:13:35.908056 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0430bee-8686-4c82-b1e5-315931a8e3d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:35.909418 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0430bee-8686-4c82-b1e5-315931a8e3d6 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:35.915045 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 650/1305] 10.222.0.57 () {56 vars in 1116 bytes} [Sat Jun 4 08:13:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:13:35.921241 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e1014-eb7a-45ca-912f-266be4d263a6 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:13:36.016343 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e1014-eb7a-45ca-912f-266be4d263a6 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:13:36.056340 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39f02b-33f9-442a-b3e1-af8233b613df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:13:36.056985 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39f02b-33f9-442a-b3e1-af8233b613df None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:13:36.057268 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39f02b-33f9-442a-b3e1-af8233b613df None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:13:36.057542 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39f02b-33f9-442a-b3e1-af8233b613df None admin] PATH_INFO: `/v3/endpoints` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:13:36.058313 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39f02b-33f9-442a-b3e1-af8233b613df None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:13:36.059677 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39f02b-33f9-442a-b3e1-af8233b613df None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:13:36.078018 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 656/1306] 10.222.0.57 () {60 vars in 1144 bytes} [Sat Jun 4 08:13:35 2022] POST /identity/v3/endpoints => generated 331 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:13:45.911877 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=30 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:13:46.073706 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:14:39.560438 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed11cf2-4d6d-4a60-a083-72841cb32ce0 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:14:39.561352 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed11cf2-4d6d-4a60-a083-72841cb32ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:14:39.561784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed11cf2-4d6d-4a60-a083-72841cb32ce0 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:14:39.567307 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 651/1307] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:14:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:14:39.568614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ec594-2ff7-431d-a5ab-ef5626c9c66e None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:14:39.569045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ec594-2ff7-431d-a5ab-ef5626c9c66e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:14:39.569171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ec594-2ff7-431d-a5ab-ef5626c9c66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:14:39.646951 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e80ec594-2ff7-431d-a5ab-ef5626c9c66e None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:14:39.648064 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e80ec594-2ff7-431d-a5ab-ef5626c9c66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:14:39.775204 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 657/1308] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:14:39.827257 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aab3ad-3a87-419a-96db-400541a625ff None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:14:39.828374 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aab3ad-3a87-419a-96db-400541a625ff None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:14:39.829726 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aab3ad-3a87-419a-96db-400541a625ff None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:14:39.835049 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 652/1309] 10.222.0.57 () {54 vars in 964 bytes} [Sat Jun 4 08:14:39 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:14:39.841537 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f945a-27a6-4c6a-85bc-6bc1446ac794 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:14:39.841853 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f945a-27a6-4c6a-85bc-6bc1446ac794 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:14:39.842141 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f945a-27a6-4c6a-85bc-6bc1446ac794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:14:40.025403 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-df3f945a-27a6-4c6a-85bc-6bc1446ac794 None None] MFA Rules not processed for user `5fd5768a512c4177abae05f4ccd5c59f`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:14:40.027176 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-df3f945a-27a6-4c6a-85bc-6bc1446ac794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:14:40.070304 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:14:40.134535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 658/1310] 10.222.0.57 () {58 vars in 1061 bytes} [Sat Jun 4 08:14:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:14:40.144397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aab3ad-3a87-419a-96db-400541a625ff None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:14:40.146339 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-b0aab3ad-3a87-419a-96db-400541a625ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:14:40.274308 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aab3ad-3a87-419a-96db-400541a625ff None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:14:40.354179 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb639f39-24ae-4ca3-b24d-d95ba08a5797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:14:40.354851 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb639f39-24ae-4ca3-b24d-d95ba08a5797 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:14:40.355137 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb639f39-24ae-4ca3-b24d-d95ba08a5797 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:14:40.355672 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb639f39-24ae-4ca3-b24d-d95ba08a5797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:14:40.357973 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-bb639f39-24ae-4ca3-b24d-d95ba08a5797 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:14:40.420204 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:14:40.487695 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb639f39-24ae-4ca3-b24d-d95ba08a5797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:14:40.489242 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb639f39-24ae-4ca3-b24d-d95ba08a5797 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:14:40.510080 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 653/1311] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:14:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:14:43.096365 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f311e-b991-4e19-adfe-bead2609854b None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:14:43.096943 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f311e-b991-4e19-adfe-bead2609854b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:14:43.096943 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f311e-b991-4e19-adfe-bead2609854b None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:14:43.098463 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 659/1312] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:14:43.103658 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c13571-a0a0-41ce-ab48-e30d3c38bf11 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:14:43.104108 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c13571-a0a0-41ce-ab48-e30d3c38bf11 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:14:43.104199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c13571-a0a0-41ce-ab48-e30d3c38bf11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:14:43.188091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-25c13571-a0a0-41ce-ab48-e30d3c38bf11 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:14:43.189269 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-25c13571-a0a0-41ce-ab48-e30d3c38bf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:14:43.301861 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 654/1313] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:14:43.340401 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f311e-b991-4e19-adfe-bead2609854b None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:14:43.342075 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-084f311e-b991-4e19-adfe-bead2609854b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:14:43.459915 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f311e-b991-4e19-adfe-bead2609854b None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:14:43.540933 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:14:43.543775 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eac10c-5110-4cd2-90e0-2ac714561080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:14:43.544662 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eac10c-5110-4cd2-90e0-2ac714561080 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:14:43.545488 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eac10c-5110-4cd2-90e0-2ac714561080 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:14:43.546266 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eac10c-5110-4cd2-90e0-2ac714561080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:14:43.548326 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-87eac10c-5110-4cd2-90e0-2ac714561080 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:14:43.795497 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eac10c-5110-4cd2-90e0-2ac714561080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:14:43.796975 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eac10c-5110-4cd2-90e0-2ac714561080 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:14:43.816681 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 660/1314] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:14:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:14:46.400392 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5059b-d320-4807-b74d-8269efe48c7b None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:14:46.400929 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5059b-d320-4807-b74d-8269efe48c7b None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:14:46.400929 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5059b-d320-4807-b74d-8269efe48c7b None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:14:46.402360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 655/1315] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:14:46.408006 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad2079-571c-4f9c-b5e6-b5d25d9341ba None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:14:46.408392 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad2079-571c-4f9c-b5e6-b5d25d9341ba None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:14:46.408555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad2079-571c-4f9c-b5e6-b5d25d9341ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:14:46.471541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-7dad2079-571c-4f9c-b5e6-b5d25d9341ba None None] MFA Rules not processed for user `8de86eb101ea4d8ca7abd59c20dd7150`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:14:46.472727 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-7dad2079-571c-4f9c-b5e6-b5d25d9341ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:14:46.524882 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:14:46.569078 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 661/1316] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:14:46 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:14:46.623373 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b42e0-0ea2-4fe0-9f37-321f33d6e4d7 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:14:46.623665 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b42e0-0ea2-4fe0-9f37-321f33d6e4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:14:46.623945 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b42e0-0ea2-4fe0-9f37-321f33d6e4d7 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:14:46.625384 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 656/1317] 10.222.0.57 () {54 vars in 964 bytes} [Sat Jun 4 08:14:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:14:46.631497 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995b3a7-7d6a-4776-943a-d62e30250b96 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:14:46.631782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995b3a7-7d6a-4776-943a-d62e30250b96 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:14:46.632051 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995b3a7-7d6a-4776-943a-d62e30250b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:14:46.705629 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e995b3a7-7d6a-4776-943a-d62e30250b96 None None] MFA Rules not processed for user `5fd5768a512c4177abae05f4ccd5c59f`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:14:46.706792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e995b3a7-7d6a-4776-943a-d62e30250b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:14:46.780681 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 662/1318] 10.222.0.57 () {58 vars in 1061 bytes} [Sat Jun 4 08:14:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:14:46.789910 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b42e0-0ea2-4fe0-9f37-321f33d6e4d7 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:14:46.791465 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ea1b42e0-0ea2-4fe0-9f37-321f33d6e4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:14:46.801750 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:14:46.894379 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b42e0-0ea2-4fe0-9f37-321f33d6e4d7 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:14:46.967512 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47bc8e-b79d-4ebf-acae-ba4763b423f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:14:46.968092 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47bc8e-b79d-4ebf-acae-ba4763b423f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:14:46.968374 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47bc8e-b79d-4ebf-acae-ba4763b423f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:14:46.968651 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47bc8e-b79d-4ebf-acae-ba4763b423f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:14:46.970316 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1e47bc8e-b79d-4ebf-acae-ba4763b423f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:14:47.167134 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:14:47.219539 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47bc8e-b79d-4ebf-acae-ba4763b423f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:14:47.220907 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47bc8e-b79d-4ebf-acae-ba4763b423f2 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:14:47.238708 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 657/1319] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:14:46 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:14:50.396221 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e51ab-73a9-46f9-8b30-a4c22ec98cac None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:14:50.396798 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e51ab-73a9-46f9-8b30-a4c22ec98cac None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:14:50.396798 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e51ab-73a9-46f9-8b30-a4c22ec98cac None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:14:50.398209 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 663/1320] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:14:50.403780 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c4fa9-73e0-49a3-9119-a1f1a2fb2630 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:14:50.404217 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c4fa9-73e0-49a3-9119-a1f1a2fb2630 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:14:50.404323 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c4fa9-73e0-49a3-9119-a1f1a2fb2630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:14:50.467549 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-474c4fa9-73e0-49a3-9119-a1f1a2fb2630 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:14:50.468734 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-474c4fa9-73e0-49a3-9119-a1f1a2fb2630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:14:50.564474 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 658/1321] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:14:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:14:50.603722 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e51ab-73a9-46f9-8b30-a4c22ec98cac None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:14:50.605259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-990e51ab-73a9-46f9-8b30-a4c22ec98cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:14:50.655274 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:14:50.709335 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e51ab-73a9-46f9-8b30-a4c22ec98cac None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:14:50.783863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c6fa6-b47a-499d-bffe-20f8d7fb77d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:14:50.784504 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c6fa6-b47a-499d-bffe-20f8d7fb77d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:14:50.784783 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c6fa6-b47a-499d-bffe-20f8d7fb77d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:14:50.785054 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c6fa6-b47a-499d-bffe-20f8d7fb77d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:14:50.786715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-414c6fa6-b47a-499d-bffe-20f8d7fb77d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:14:50.878301 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:14:50.892261 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c6fa6-b47a-499d-bffe-20f8d7fb77d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:14:50.893699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c6fa6-b47a-499d-bffe-20f8d7fb77d0 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:14:50.911880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 664/1322] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:14:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:14:53.812319 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b8986-673e-49b5-808b-f8057b00a0d2 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:14:53.812843 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b8986-673e-49b5-808b-f8057b00a0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:14:53.812843 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b8986-673e-49b5-808b-f8057b00a0d2 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:14:53.814175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 659/1323] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:14:53.819230 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef00d8-4dd5-4b5a-8011-8d286ca29d1b None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:14:53.819625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef00d8-4dd5-4b5a-8011-8d286ca29d1b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:14:53.819785 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef00d8-4dd5-4b5a-8011-8d286ca29d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:14:53.883873 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e9ef00d8-4dd5-4b5a-8011-8d286ca29d1b None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:14:53.885068 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e9ef00d8-4dd5-4b5a-8011-8d286ca29d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:14:53.984246 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 665/1324] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:14:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:14:54.019686 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b8986-673e-49b5-808b-f8057b00a0d2 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:14:54.021372 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a11b8986-673e-49b5-808b-f8057b00a0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:14:54.041330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:14:54.128309 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b8986-673e-49b5-808b-f8057b00a0d2 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:14:54.205552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d8538-6d2c-4c34-bca9-101788c5e402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:14:54.206241 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d8538-6d2c-4c34-bca9-101788c5e402 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:14:54.206525 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d8538-6d2c-4c34-bca9-101788c5e402 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:14:54.206801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d8538-6d2c-4c34-bca9-101788c5e402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:14:54.208556 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-116d8538-6d2c-4c34-bca9-101788c5e402 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:14:54.281785 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:14:54.320848 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d8538-6d2c-4c34-bca9-101788c5e402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:14:54.322311 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d8538-6d2c-4c34-bca9-101788c5e402 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:14:54.341180 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 660/1325] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:14:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:14:56.621991 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55397c2c-c191-427b-a436-05d4768e8e89 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:14:56.622541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55397c2c-c191-427b-a436-05d4768e8e89 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:14:56.622541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55397c2c-c191-427b-a436-05d4768e8e89 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:14:56.623942 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 666/1326] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:14:56.630230 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a3648-a4d9-4c93-8acb-cda8f81018e9 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:14:56.630747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a3648-a4d9-4c93-8acb-cda8f81018e9 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:14:56.631258 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a3648-a4d9-4c93-8acb-cda8f81018e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:14:56.695832 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-9d7a3648-a4d9-4c93-8acb-cda8f81018e9 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:14:56.697018 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-9d7a3648-a4d9-4c93-8acb-cda8f81018e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:14:56.792736 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 661/1327] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:14:56.828102 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55397c2c-c191-427b-a436-05d4768e8e89 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:14:56.829750 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-55397c2c-c191-427b-a436-05d4768e8e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:14:56.890402 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:14:56.938816 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55397c2c-c191-427b-a436-05d4768e8e89 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:14:57.013609 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2ab04-96f3-4daf-a7ad-56f9aa6fc594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:14:57.014284 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2ab04-96f3-4daf-a7ad-56f9aa6fc594 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:14:57.014561 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2ab04-96f3-4daf-a7ad-56f9aa6fc594 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:14:57.014829 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2ab04-96f3-4daf-a7ad-56f9aa6fc594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:14:57.016459 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ada2ab04-96f3-4daf-a7ad-56f9aa6fc594 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:14:57.119867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:14:57.122828 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2ab04-96f3-4daf-a7ad-56f9aa6fc594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:14:57.124280 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2ab04-96f3-4daf-a7ad-56f9aa6fc594 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:14:57.143117 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 667/1328] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:14:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:14:59.562714 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9a0e4-75dd-4aab-843d-b14e1aa620d3 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:14:59.563208 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9a0e4-75dd-4aab-843d-b14e1aa620d3 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:14:59.563302 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9a0e4-75dd-4aab-843d-b14e1aa620d3 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:14:59.564668 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 662/1329] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:14:59.569908 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f7dda-cba8-475a-9123-5e2853efcb69 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:14:59.570308 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f7dda-cba8-475a-9123-5e2853efcb69 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:14:59.570577 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f7dda-cba8-475a-9123-5e2853efcb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:14:59.633729 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-ac6f7dda-cba8-475a-9123-5e2853efcb69 None None] MFA Rules not processed for user `8de86eb101ea4d8ca7abd59c20dd7150`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:14:59.634949 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ac6f7dda-cba8-475a-9123-5e2853efcb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:14:59.728032 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 668/1330] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:14:59 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:14:59.765158 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9a0e4-75dd-4aab-843d-b14e1aa620d3 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:14:59.766751 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1ef9a0e4-75dd-4aab-843d-b14e1aa620d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:14:59.798135 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:14:59.871479 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9a0e4-75dd-4aab-843d-b14e1aa620d3 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:14:59.947013 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ecfec-d30a-4c05-9850-318d26d07d05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:14:59.947656 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ecfec-d30a-4c05-9850-318d26d07d05 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:14:59.947935 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ecfec-d30a-4c05-9850-318d26d07d05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:14:59.948209 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ecfec-d30a-4c05-9850-318d26d07d05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:14:59.949894 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-767ecfec-d30a-4c05-9850-318d26d07d05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:15:00.026942 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:15:00.060255 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ecfec-d30a-4c05-9850-318d26d07d05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:15:00.061612 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ecfec-d30a-4c05-9850-318d26d07d05 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:15:00.079690 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 663/1331] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:14:59 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:15:02.578694 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a656c6-2553-4dae-8441-7e1d42f743ef None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:02.579121 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a656c6-2553-4dae-8441-7e1d42f743ef None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:02.579258 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a656c6-2553-4dae-8441-7e1d42f743ef None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:02.581211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 669/1332] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:15:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:15:02.586131 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c3b54-4531-4fa8-9987-5e3280276e9a None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:02.587852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c3b54-4531-4fa8-9987-5e3280276e9a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:02.587852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c3b54-4531-4fa8-9987-5e3280276e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:02.665143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-3c2c3b54-4531-4fa8-9987-5e3280276e9a None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:15:02.666545 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-3c2c3b54-4531-4fa8-9987-5e3280276e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:15:02.764221 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 664/1333] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:15:02.799837 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a656c6-2553-4dae-8441-7e1d42f743ef None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:15:02.801396 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-07a656c6-2553-4dae-8441-7e1d42f743ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:15:02.871063 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:15:02.905915 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a656c6-2553-4dae-8441-7e1d42f743ef None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:15:02.982999 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38a3f0-2b1f-4605-81fd-99162d207cbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:15:02.983652 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38a3f0-2b1f-4605-81fd-99162d207cbd service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:02.983934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38a3f0-2b1f-4605-81fd-99162d207cbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:02.984210 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38a3f0-2b1f-4605-81fd-99162d207cbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:02.985861 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ff38a3f0-2b1f-4605-81fd-99162d207cbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:15:03.094766 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38a3f0-2b1f-4605-81fd-99162d207cbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:15:03.096204 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38a3f0-2b1f-4605-81fd-99162d207cbd service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:15:03.106094 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:15:03.114644 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 670/1334] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:15:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:15:05.452802 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ccafc-106c-4a10-9a5a-f9dc022aad59 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:05.453344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ccafc-106c-4a10-9a5a-f9dc022aad59 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:05.453344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ccafc-106c-4a10-9a5a-f9dc022aad59 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:05.454750 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 665/1335] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:15:05.460062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49477b49-b3e5-4446-bd5e-b59d892c67de None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:05.460449 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49477b49-b3e5-4446-bd5e-b59d892c67de None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:05.460622 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49477b49-b3e5-4446-bd5e-b59d892c67de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:05.526727 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-49477b49-b3e5-4446-bd5e-b59d892c67de None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:15:05.527881 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-49477b49-b3e5-4446-bd5e-b59d892c67de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:15:05.626155 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 671/1336] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:15:05.665053 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ccafc-106c-4a10-9a5a-f9dc022aad59 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:15:05.666638 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c43ccafc-106c-4a10-9a5a-f9dc022aad59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:15:05.707862 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:15:05.771044 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ccafc-106c-4a10-9a5a-f9dc022aad59 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:15:05.843506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c43905-1dd0-49af-ba4f-0ff49f0e5584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:15:05.844144 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c43905-1dd0-49af-ba4f-0ff49f0e5584 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:05.844424 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c43905-1dd0-49af-ba4f-0ff49f0e5584 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:05.844696 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c43905-1dd0-49af-ba4f-0ff49f0e5584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:05.846363 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e1c43905-1dd0-49af-ba4f-0ff49f0e5584 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:15:05.929576 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:15:05.955928 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c43905-1dd0-49af-ba4f-0ff49f0e5584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:15:05.957374 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c43905-1dd0-49af-ba4f-0ff49f0e5584 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:15:05.975616 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 666/1337] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:15:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:15:08.644213 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc62f11-ad40-4827-bd7c-e0b99857bd8e None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:08.644783 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc62f11-ad40-4827-bd7c-e0b99857bd8e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:08.644783 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc62f11-ad40-4827-bd7c-e0b99857bd8e None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:08.646199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 672/1338] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:15:08.651585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0b560-43e8-4ae8-bf4a-63cc08dfbcb2 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:08.652071 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0b560-43e8-4ae8-bf4a-63cc08dfbcb2 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:08.652168 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0b560-43e8-4ae8-bf4a-63cc08dfbcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:08.717000 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-27b0b560-43e8-4ae8-bf4a-63cc08dfbcb2 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:15:08.718251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-27b0b560-43e8-4ae8-bf4a-63cc08dfbcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:15:08.818820 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 667/1339] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:15:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:15:08.855266 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc62f11-ad40-4827-bd7c-e0b99857bd8e None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:15:08.856793 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4bc62f11-ad40-4827-bd7c-e0b99857bd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:15:08.931494 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:15:08.960047 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc62f11-ad40-4827-bd7c-e0b99857bd8e None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:15:09.032544 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6344b-c464-4f04-bc9e-719277e73a55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:15:09.033225 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6344b-c464-4f04-bc9e-719277e73a55 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:09.033506 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6344b-c464-4f04-bc9e-719277e73a55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:09.033780 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6344b-c464-4f04-bc9e-719277e73a55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:09.035467 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2ac6344b-c464-4f04-bc9e-719277e73a55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:15:09.150110 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6344b-c464-4f04-bc9e-719277e73a55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:15:09.151550 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6344b-c464-4f04-bc9e-719277e73a55 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:15:09.170197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 673/1340] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:15:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:15:13.455528 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daed343-3137-4532-aad4-dcec4c16a354 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:13.456105 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daed343-3137-4532-aad4-dcec4c16a354 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:13.456105 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daed343-3137-4532-aad4-dcec4c16a354 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:13.457368 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 668/1341] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:15:13.462516 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412ec07-0efc-4d80-94b8-5389f3dbf671 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:13.463021 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412ec07-0efc-4d80-94b8-5389f3dbf671 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:13.463135 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412ec07-0efc-4d80-94b8-5389f3dbf671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:13.469009 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:15:13.534130 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-4412ec07-0efc-4d80-94b8-5389f3dbf671 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:15:13.535508 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4412ec07-0efc-4d80-94b8-5389f3dbf671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:15:13.638194 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 674/1342] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:15:13.676213 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daed343-3137-4532-aad4-dcec4c16a354 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:15:13.678573 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-9daed343-3137-4532-aad4-dcec4c16a354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:15:13.731037 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:15:13.777335 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daed343-3137-4532-aad4-dcec4c16a354 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:15:13.780978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d5a62-45d3-48bd-bbf9-4b771526e6cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:15:13.781597 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d5a62-45d3-48bd-bbf9-4b771526e6cc service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:13.781910 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d5a62-45d3-48bd-bbf9-4b771526e6cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:13.782188 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d5a62-45d3-48bd-bbf9-4b771526e6cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:13.791335 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d5a62-45d3-48bd-bbf9-4b771526e6cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:15:13.793269 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d5a62-45d3-48bd-bbf9-4b771526e6cc service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:15:13.803120 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 669/1343] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:15:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:15:16.597918 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb807b8-b5e1-4cc5-8038-928a96cbd4ae None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:16.598415 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb807b8-b5e1-4cc5-8038-928a96cbd4ae None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:16.598415 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb807b8-b5e1-4cc5-8038-928a96cbd4ae None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:16.599795 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 675/1344] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:15:16.605530 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4294f1c-7c9c-4403-87f6-0f71c2c80a60 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:16.605963 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4294f1c-7c9c-4403-87f6-0f71c2c80a60 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:16.606237 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4294f1c-7c9c-4403-87f6-0f71c2c80a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:16.632883 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-e4294f1c-7c9c-4403-87f6-0f71c2c80a60 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:15:16.634081 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e4294f1c-7c9c-4403-87f6-0f71c2c80a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:15:16.712179 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 670/1345] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:15:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:15:16.750730 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb807b8-b5e1-4cc5-8038-928a96cbd4ae None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:15:16.752999 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6fb807b8-b5e1-4cc5-8038-928a96cbd4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:15:16.766406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb807b8-b5e1-4cc5-8038-928a96cbd4ae None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:15:16.769890 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2fef8-8a7b-400c-a6cb-03fe769f570c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:15:16.770526 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2fef8-8a7b-400c-a6cb-03fe769f570c service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:16.770803 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2fef8-8a7b-400c-a6cb-03fe769f570c service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:16.771073 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2fef8-8a7b-400c-a6cb-03fe769f570c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:16.780555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2fef8-8a7b-400c-a6cb-03fe769f570c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:15:16.781998 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2fef8-8a7b-400c-a6cb-03fe769f570c service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:15:16.791339 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 676/1346] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:15:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:15:21.228905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2c290-8ef8-4e38-a52e-0159b106c341 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:21.229428 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2c290-8ef8-4e38-a52e-0159b106c341 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:21.229510 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2c290-8ef8-4e38-a52e-0159b106c341 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:21.231404 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 671/1347] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:15:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:15:21.236786 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b0846-2e27-4bd6-9c34-2394d7f1e513 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:21.237202 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b0846-2e27-4bd6-9c34-2394d7f1e513 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:21.237337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b0846-2e27-4bd6-9c34-2394d7f1e513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:21.255230 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-bd4b0846-2e27-4bd6-9c34-2394d7f1e513 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:15:21.256421 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-bd4b0846-2e27-4bd6-9c34-2394d7f1e513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:15:21.265140 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 677/1348] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:15:21.302525 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2c290-8ef8-4e38-a52e-0159b106c341 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:15:21.313729 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2c290-8ef8-4e38-a52e-0159b106c341 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:15:21.317291 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59736db8-9c52-4b97-8449-62f1b3621e8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:15:21.317958 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59736db8-9c52-4b97-8449-62f1b3621e8c service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:21.318247 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59736db8-9c52-4b97-8449-62f1b3621e8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:21.318525 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59736db8-9c52-4b97-8449-62f1b3621e8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:21.327372 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59736db8-9c52-4b97-8449-62f1b3621e8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:15:21.328792 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59736db8-9c52-4b97-8449-62f1b3621e8c service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:15:21.338078 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 672/1349] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:15:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:15:26.637351 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41ef09-80b8-43c8-aa25-a216c481f4bb None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:26.639286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41ef09-80b8-43c8-aa25-a216c481f4bb None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:26.639772 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41ef09-80b8-43c8-aa25-a216c481f4bb None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:26.641853 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 678/1350] 10.222.0.57 () {54 vars in 921 bytes} [Sat Jun 4 08:15:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:15:26.646982 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e801917-a9e3-487e-aa00-fd19c223b5e4 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:26.647423 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e801917-a9e3-487e-aa00-fd19c223b5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:26.647537 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e801917-a9e3-487e-aa00-fd19c223b5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:26.750947 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-7e801917-a9e3-487e-aa00-fd19c223b5e4 None None] MFA Rules not processed for user `6fb6720f0d0141fea795cecfbf6f2538`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:15:26.752260 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-7e801917-a9e3-487e-aa00-fd19c223b5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:15:26.779921 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:15:26.835027 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 673/1351] 10.222.0.57 () {58 vars in 1018 bytes} [Sat Jun 4 08:15:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:15:31.250166 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=72 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:15:31.329407 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4d984-78d3-4e16-94ea-9cc152fd1b7e None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:31.330024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4d984-78d3-4e16-94ea-9cc152fd1b7e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:31.330297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4d984-78d3-4e16-94ea-9cc152fd1b7e None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:31.331860 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 679/1352] 10.222.0.57 () {54 vars in 921 bytes} [Sat Jun 4 08:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:15:31.336713 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695aa298-54d0-476d-8675-9063e0892955 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:31.337187 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695aa298-54d0-476d-8675-9063e0892955 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:31.337490 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695aa298-54d0-476d-8675-9063e0892955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:31.357346 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-695aa298-54d0-476d-8675-9063e0892955 None None] MFA Rules not processed for user `6fb6720f0d0141fea795cecfbf6f2538`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:15:31.358614 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-695aa298-54d0-476d-8675-9063e0892955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:15:31.367468 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 674/1353] 10.222.0.57 () {58 vars in 1018 bytes} [Sat Jun 4 08:15:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:15:32.993383 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db024d-d417-480b-86a8-12a89380fc0d None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:32.994064 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db024d-d417-480b-86a8-12a89380fc0d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:32.994064 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db024d-d417-480b-86a8-12a89380fc0d None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:32.995342 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 680/1354] 10.222.0.57 () {54 vars in 921 bytes} [Sat Jun 4 08:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:15:33.000840 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273ba79-8ffb-4952-883a-79a0defc1139 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:33.001361 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273ba79-8ffb-4952-883a-79a0defc1139 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:33.001538 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273ba79-8ffb-4952-883a-79a0defc1139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:33.020362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-f273ba79-8ffb-4952-883a-79a0defc1139 None None] MFA Rules not processed for user `6fb6720f0d0141fea795cecfbf6f2538`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:15:33.021645 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f273ba79-8ffb-4952-883a-79a0defc1139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:15:33.030699 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 675/1355] 10.222.0.57 () {58 vars in 1018 bytes} [Sat Jun 4 08:15:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:15:36.761469 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa53fa-c67e-43a1-8d57-e3b262fe45d9 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:36.762056 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa53fa-c67e-43a1-8d57-e3b262fe45d9 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:36.762056 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa53fa-c67e-43a1-8d57-e3b262fe45d9 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:36.763410 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 681/1356] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:15:36.768637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6310b1-6607-4bd4-9276-9307893ea79c None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:36.769056 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6310b1-6607-4bd4-9276-9307893ea79c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:36.769180 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6310b1-6607-4bd4-9276-9307893ea79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:36.787718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-bf6310b1-6607-4bd4-9276-9307893ea79c None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:15:36.788900 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-bf6310b1-6607-4bd4-9276-9307893ea79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:15:36.798346 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 676/1357] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:15:36.853237 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb868e-8ad3-44b1-8696-c9cd6f630d5a None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:36.853523 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb868e-8ad3-44b1-8696-c9cd6f630d5a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:36.853799 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb868e-8ad3-44b1-8696-c9cd6f630d5a None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:36.856026 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 682/1358] 10.222.0.57 () {54 vars in 961 bytes} [Sat Jun 4 08:15:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:15:36.867215 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa863fc2-1870-4665-b4f5-0db2f09532e8 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:36.867953 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa863fc2-1870-4665-b4f5-0db2f09532e8 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:36.868551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa863fc2-1870-4665-b4f5-0db2f09532e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:36.941700 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-fa863fc2-1870-4665-b4f5-0db2f09532e8 None None] MFA Rules not processed for user `7e64d002241242928936dd0d991ecdc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:15:36.943017 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-fa863fc2-1870-4665-b4f5-0db2f09532e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:15:37.029723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 677/1359] 10.222.0.57 () {58 vars in 1058 bytes} [Sat Jun 4 08:15:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:15:37.037458 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb868e-8ad3-44b1-8696-c9cd6f630d5a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:15:37.052662 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb868e-8ad3-44b1-8696-c9cd6f630d5a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:15:37.058487 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594b583-81c1-4315-aeb0-9608ec71f8ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:15:37.059396 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594b583-81c1-4315-aeb0-9608ec71f8ee service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:37.059863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594b583-81c1-4315-aeb0-9608ec71f8ee service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:37.060322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594b583-81c1-4315-aeb0-9608ec71f8ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:37.069307 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594b583-81c1-4315-aeb0-9608ec71f8ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:15:37.071003 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594b583-81c1-4315-aeb0-9608ec71f8ee service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:15:37.086002 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 683/1360] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:15:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:15:39.531537 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc15cf2-d71c-47f7-a72f-97bb2ea6dbfc None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:39.532090 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc15cf2-d71c-47f7-a72f-97bb2ea6dbfc None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:39.532090 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc15cf2-d71c-47f7-a72f-97bb2ea6dbfc None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:39.533598 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 678/1361] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:15:39.538696 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9a49d-cf37-4d53-9189-e335331aa979 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:39.539088 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9a49d-cf37-4d53-9189-e335331aa979 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:39.539249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9a49d-cf37-4d53-9189-e335331aa979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:39.559670 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-36b9a49d-cf37-4d53-9189-e335331aa979 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:15:39.561037 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-36b9a49d-cf37-4d53-9189-e335331aa979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:15:39.568818 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 684/1362] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:15:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:15:39.614005 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc15cf2-d71c-47f7-a72f-97bb2ea6dbfc None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:15:39.629803 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc15cf2-d71c-47f7-a72f-97bb2ea6dbfc None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:15:39.635547 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed0821-a08f-49d1-ad46-423b7ad20046 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:15:39.636197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed0821-a08f-49d1-ad46-423b7ad20046 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:39.636478 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed0821-a08f-49d1-ad46-423b7ad20046 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:39.636755 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed0821-a08f-49d1-ad46-423b7ad20046 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:39.646128 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed0821-a08f-49d1-ad46-423b7ad20046 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:15:39.647988 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed0821-a08f-49d1-ad46-423b7ad20046 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:15:39.659074 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 679/1363] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:15:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:15:42.249677 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdb4e7-922e-40d6-b6e1-561147d82373 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:42.250198 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdb4e7-922e-40d6-b6e1-561147d82373 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:42.250293 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdb4e7-922e-40d6-b6e1-561147d82373 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:42.251752 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 685/1364] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:15:42.257183 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac871ab-be51-4fb0-b595-b0cdbc90937c None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:42.257617 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac871ab-be51-4fb0-b595-b0cdbc90937c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:42.257716 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac871ab-be51-4fb0-b595-b0cdbc90937c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:42.277290 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-9ac871ab-be51-4fb0-b595-b0cdbc90937c None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:15:42.278518 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-9ac871ab-be51-4fb0-b595-b0cdbc90937c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:15:42.287648 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 680/1365] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:15:42.338191 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341b5aa-62eb-4297-9a67-967491628f6c None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:42.338584 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341b5aa-62eb-4297-9a67-967491628f6c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:42.338932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341b5aa-62eb-4297-9a67-967491628f6c None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:42.340364 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 686/1366] 10.222.0.57 () {54 vars in 961 bytes} [Sat Jun 4 08:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:15:42.345911 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d0803-3705-4d57-a56b-7e893320c3f9 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:42.346288 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d0803-3705-4d57-a56b-7e893320c3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:42.346630 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d0803-3705-4d57-a56b-7e893320c3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:42.365103 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-dc3d0803-3705-4d57-a56b-7e893320c3f9 None None] MFA Rules not processed for user `7e64d002241242928936dd0d991ecdc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:15:42.366257 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-dc3d0803-3705-4d57-a56b-7e893320c3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:15:42.378700 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 681/1367] 10.222.0.57 () {58 vars in 1058 bytes} [Sat Jun 4 08:15:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:15:42.386778 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341b5aa-62eb-4297-9a67-967491628f6c None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:15:42.401492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341b5aa-62eb-4297-9a67-967491628f6c None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:15:42.407015 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbcb0e3-1ae7-4bc8-bb50-3605848b7b96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:15:42.407661 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcb0e3-1ae7-4bc8-bb50-3605848b7b96 service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:42.407944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcb0e3-1ae7-4bc8-bb50-3605848b7b96 service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:42.408221 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcb0e3-1ae7-4bc8-bb50-3605848b7b96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:42.417248 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbcb0e3-1ae7-4bc8-bb50-3605848b7b96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:15:42.418847 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbcb0e3-1ae7-4bc8-bb50-3605848b7b96 service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:15:42.428405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 687/1368] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:15:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:15:44.790448 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f057c-c2b2-41a5-a66d-0c436593ee5c None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:44.791050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f057c-c2b2-41a5-a66d-0c436593ee5c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:44.791050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f057c-c2b2-41a5-a66d-0c436593ee5c None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:44.792587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 682/1369] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:15:44.798194 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e10908-d640-435f-ac85-217141efef77 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:44.798634 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e10908-d640-435f-ac85-217141efef77 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:44.798750 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e10908-d640-435f-ac85-217141efef77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:44.816898 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-69e10908-d640-435f-ac85-217141efef77 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:15:44.818157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-69e10908-d640-435f-ac85-217141efef77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:15:44.826740 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 688/1370] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:15:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:15:44.871890 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f057c-c2b2-41a5-a66d-0c436593ee5c None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:15:44.887034 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f057c-c2b2-41a5-a66d-0c436593ee5c None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:15:44.892545 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ab7bf-0e2b-4c5c-9382-5cec81642ff7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:15:44.893399 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ab7bf-0e2b-4c5c-9382-5cec81642ff7 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:44.893681 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ab7bf-0e2b-4c5c-9382-5cec81642ff7 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:44.893983 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ab7bf-0e2b-4c5c-9382-5cec81642ff7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:44.902662 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ab7bf-0e2b-4c5c-9382-5cec81642ff7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:15:44.904236 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ab7bf-0e2b-4c5c-9382-5cec81642ff7 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:15:44.920100 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 683/1371] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:15:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:15:45.107380 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f61c9-799e-4eeb-bbc7-9ee2be2e7728 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:45.107569 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f61c9-799e-4eeb-bbc7-9ee2be2e7728 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:45.107839 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f61c9-799e-4eeb-bbc7-9ee2be2e7728 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:45.109464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 689/1372] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:15:45.115379 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb1f91-5126-4a69-9896-93147b9902dc None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:45.115670 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb1f91-5126-4a69-9896-93147b9902dc None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:45.116156 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb1f91-5126-4a69-9896-93147b9902dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:45.135279 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-8fdb1f91-5126-4a69-9896-93147b9902dc None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:15:45.136554 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8fdb1f91-5126-4a69-9896-93147b9902dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:15:45.144995 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 684/1373] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:15:45.465934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de469e75-a3a3-4d43-b3f3-22938007fbee None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:45.465934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de469e75-a3a3-4d43-b3f3-22938007fbee None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:45.465934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de469e75-a3a3-4d43-b3f3-22938007fbee None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:45.468333 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 690/1374] 10.222.0.57 () {54 vars in 963 bytes} [Sat Jun 4 08:15:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:15:45.473723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836df73-5e2d-4bd5-8f67-723dfe9afa62 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:45.474121 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836df73-5e2d-4bd5-8f67-723dfe9afa62 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:45.474480 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836df73-5e2d-4bd5-8f67-723dfe9afa62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:45.481890 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:15:45.526250 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-a836df73-5e2d-4bd5-8f67-723dfe9afa62 None None] MFA Rules not processed for user `3ab0603fbcd54121b543fbf2a44fecf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:15:45.527803 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a836df73-5e2d-4bd5-8f67-723dfe9afa62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:15:45.592573 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 685/1375] 10.222.0.57 () {58 vars in 1060 bytes} [Sat Jun 4 08:15:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:15:45.600227 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de469e75-a3a3-4d43-b3f3-22938007fbee None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:15:45.612440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de469e75-a3a3-4d43-b3f3-22938007fbee None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:15:45.616140 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97067ecc-e955-4279-b05a-53f7e9b05125 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:15:45.616858 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97067ecc-e955-4279-b05a-53f7e9b05125 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:45.617211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97067ecc-e955-4279-b05a-53f7e9b05125 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:45.617558 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97067ecc-e955-4279-b05a-53f7e9b05125 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:45.627540 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97067ecc-e955-4279-b05a-53f7e9b05125 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:15:45.629196 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97067ecc-e955-4279-b05a-53f7e9b05125 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:15:45.639379 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 691/1376] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:15:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:15:47.213118 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9be93c-a559-4a1e-a37f-025b34d6b9c9 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:47.214202 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9be93c-a559-4a1e-a37f-025b34d6b9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:47.214202 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9be93c-a559-4a1e-a37f-025b34d6b9c9 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:47.215749 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 686/1377] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:15:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:15:47.220761 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8770cf4-5d27-4af1-9b5d-492f7d1aba7d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:47.221188 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8770cf4-5d27-4af1-9b5d-492f7d1aba7d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:47.221489 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8770cf4-5d27-4af1-9b5d-492f7d1aba7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:47.239527 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-c8770cf4-5d27-4af1-9b5d-492f7d1aba7d None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:15:47.240804 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c8770cf4-5d27-4af1-9b5d-492f7d1aba7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:15:47.248698 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 692/1378] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:15:47.294701 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9be93c-a559-4a1e-a37f-025b34d6b9c9 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:15:47.309246 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9be93c-a559-4a1e-a37f-025b34d6b9c9 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:15:47.315001 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8eb585-211d-477b-bc50-19a1aaaecc62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:15:47.315646 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8eb585-211d-477b-bc50-19a1aaaecc62 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:47.315933 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8eb585-211d-477b-bc50-19a1aaaecc62 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:47.316237 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8eb585-211d-477b-bc50-19a1aaaecc62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:47.325428 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8eb585-211d-477b-bc50-19a1aaaecc62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:15:47.327092 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8eb585-211d-477b-bc50-19a1aaaecc62 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:15:47.339088 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 687/1379] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:15:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:15:49.661509 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9fe34-9604-4629-a4e6-e7b31d49489b None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:49.662073 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9fe34-9604-4629-a4e6-e7b31d49489b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:49.662073 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9fe34-9604-4629-a4e6-e7b31d49489b None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:49.663441 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 693/1380] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:15:49.669162 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fad28-213a-4ca4-a8da-6ee4512967c7 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:49.669579 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fad28-213a-4ca4-a8da-6ee4512967c7 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:49.669711 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fad28-213a-4ca4-a8da-6ee4512967c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:49.689700 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-0c7fad28-213a-4ca4-a8da-6ee4512967c7 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:15:49.690914 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0c7fad28-213a-4ca4-a8da-6ee4512967c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:15:49.699655 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 688/1381] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:15:49.751480 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9fe34-9604-4629-a4e6-e7b31d49489b None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:15:49.766889 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9fe34-9604-4629-a4e6-e7b31d49489b None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:15:49.772460 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a07e5a-40b4-4409-9b7f-6b982ffbd45b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:15:49.773224 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a07e5a-40b4-4409-9b7f-6b982ffbd45b service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:49.773560 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a07e5a-40b4-4409-9b7f-6b982ffbd45b service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:49.773955 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a07e5a-40b4-4409-9b7f-6b982ffbd45b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:49.783355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a07e5a-40b4-4409-9b7f-6b982ffbd45b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:15:49.785010 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a07e5a-40b4-4409-9b7f-6b982ffbd45b service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:15:49.795627 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 694/1382] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:15:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:15:52.087071 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df46f5b-c83d-47bf-9cb7-7f99cc58fcd0 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:52.087629 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df46f5b-c83d-47bf-9cb7-7f99cc58fcd0 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:52.087629 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df46f5b-c83d-47bf-9cb7-7f99cc58fcd0 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:52.088999 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 689/1383] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:15:52.094391 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087554d-1857-4b82-ae21-7903bfee4af1 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:52.094819 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087554d-1857-4b82-ae21-7903bfee4af1 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:52.094902 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087554d-1857-4b82-ae21-7903bfee4af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:52.113073 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-9087554d-1857-4b82-ae21-7903bfee4af1 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:15:52.114297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9087554d-1857-4b82-ae21-7903bfee4af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:15:52.122942 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 695/1384] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:15:52.167439 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df46f5b-c83d-47bf-9cb7-7f99cc58fcd0 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:15:52.183892 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df46f5b-c83d-47bf-9cb7-7f99cc58fcd0 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:15:52.189637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd49cb-afde-4de9-b893-d8f0a9663d31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:15:52.190352 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd49cb-afde-4de9-b893-d8f0a9663d31 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:52.190623 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd49cb-afde-4de9-b893-d8f0a9663d31 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:52.190909 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd49cb-afde-4de9-b893-d8f0a9663d31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:52.200126 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd49cb-afde-4de9-b893-d8f0a9663d31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:15:52.201717 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd49cb-afde-4de9-b893-d8f0a9663d31 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:15:52.211954 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 690/1385] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:15:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:15:54.511053 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0c170-e49e-4cfc-8a40-044235da956e None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:54.511595 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0c170-e49e-4cfc-8a40-044235da956e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:54.511707 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0c170-e49e-4cfc-8a40-044235da956e None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:54.513054 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 696/1386] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:15:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:15:54.518504 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21610c7e-060d-458b-9a7a-7dedfe04380b None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:54.518983 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21610c7e-060d-458b-9a7a-7dedfe04380b None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:54.519083 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21610c7e-060d-458b-9a7a-7dedfe04380b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:54.539638 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-21610c7e-060d-458b-9a7a-7dedfe04380b None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:15:54.540847 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-21610c7e-060d-458b-9a7a-7dedfe04380b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:15:54.549074 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 691/1387] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:15:54.601229 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0c170-e49e-4cfc-8a40-044235da956e None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:15:54.616055 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0c170-e49e-4cfc-8a40-044235da956e None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:15:54.622556 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac190f0-9005-4ba8-bfc9-638387c04d4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:15:54.623225 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac190f0-9005-4ba8-bfc9-638387c04d4e service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:54.623525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac190f0-9005-4ba8-bfc9-638387c04d4e service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:54.623818 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac190f0-9005-4ba8-bfc9-638387c04d4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:54.632360 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac190f0-9005-4ba8-bfc9-638387c04d4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:15:54.634064 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac190f0-9005-4ba8-bfc9-638387c04d4e service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:15:54.645091 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 697/1388] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:15:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:15:57.053846 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a25f1-3ad1-49f9-9797-284343649e78 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:57.054661 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a25f1-3ad1-49f9-9797-284343649e78 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:57.054661 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a25f1-3ad1-49f9-9797-284343649e78 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:57.056798 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 692/1389] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:15:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:15:57.063343 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289097f0-aac3-4233-a0af-61f86298c8c4 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:57.063830 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289097f0-aac3-4233-a0af-61f86298c8c4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:57.063951 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289097f0-aac3-4233-a0af-61f86298c8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:57.083183 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-289097f0-aac3-4233-a0af-61f86298c8c4 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:15:57.084464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-289097f0-aac3-4233-a0af-61f86298c8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:15:57.093434 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 698/1390] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:15:57.139572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a25f1-3ad1-49f9-9797-284343649e78 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:15:57.159586 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a25f1-3ad1-49f9-9797-284343649e78 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:15:57.167506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121237d6-38a3-4824-8129-d962da70b016 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:15:57.168476 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121237d6-38a3-4824-8129-d962da70b016 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:15:57.168927 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121237d6-38a3-4824-8129-d962da70b016 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:15:57.169312 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121237d6-38a3-4824-8129-d962da70b016 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:15:57.181921 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121237d6-38a3-4824-8129-d962da70b016 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:15:57.184862 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121237d6-38a3-4824-8129-d962da70b016 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:15:57.197471 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 693/1391] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:15:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:16:00.038712 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39beb6bd-ee37-4ccc-a9cb-62ff2ea876bb None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:00.039342 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39beb6bd-ee37-4ccc-a9cb-62ff2ea876bb None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:00.039342 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39beb6bd-ee37-4ccc-a9cb-62ff2ea876bb None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:00.040611 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 699/1392] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:16:00.046686 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbcb73-0d17-421b-a9ae-27855601d42e None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:00.047155 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbcb73-0d17-421b-a9ae-27855601d42e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:00.047258 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbcb73-0d17-421b-a9ae-27855601d42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:00.065166 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-78cbcb73-0d17-421b-a9ae-27855601d42e None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:16:00.066379 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-78cbcb73-0d17-421b-a9ae-27855601d42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:16:00.074270 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 694/1393] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:16:00.118119 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39beb6bd-ee37-4ccc-a9cb-62ff2ea876bb None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:16:00.132783 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39beb6bd-ee37-4ccc-a9cb-62ff2ea876bb None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:16:00.138411 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb12ef-36f8-4c37-8891-1726027a0cd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:16:00.139042 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb12ef-36f8-4c37-8891-1726027a0cd5 service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:00.139324 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb12ef-36f8-4c37-8891-1726027a0cd5 service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:00.139600 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb12ef-36f8-4c37-8891-1726027a0cd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:00.148402 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb12ef-36f8-4c37-8891-1726027a0cd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:16:00.150066 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb12ef-36f8-4c37-8891-1726027a0cd5 service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:16:00.160381 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 700/1394] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:16:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:16:02.185443 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a11e6-bb1b-4605-aa2f-d4ccc10b6d07 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:02.185993 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a11e6-bb1b-4605-aa2f-d4ccc10b6d07 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:02.185993 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a11e6-bb1b-4605-aa2f-d4ccc10b6d07 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:02.187302 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 695/1395] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:16:02.192702 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad0e77-7e72-4fee-9f4d-ada27c94dbb2 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:02.193126 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad0e77-7e72-4fee-9f4d-ada27c94dbb2 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:02.193344 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad0e77-7e72-4fee-9f4d-ada27c94dbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:02.199805 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=52 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:16:02.212523 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-69ad0e77-7e72-4fee-9f4d-ada27c94dbb2 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:16:02.214254 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-69ad0e77-7e72-4fee-9f4d-ada27c94dbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:16:02.222098 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 701/1396] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:16:02.277510 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef4f56-f823-4b86-9252-ea43f51172ca None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:02.277792 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef4f56-f823-4b86-9252-ea43f51172ca None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:02.278090 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef4f56-f823-4b86-9252-ea43f51172ca None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:02.279433 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 696/1397] 10.222.0.57 () {54 vars in 962 bytes} [Sat Jun 4 08:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:16:02.284769 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3db5b3-6c2d-4cc3-bdee-24c8a31ef49e None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:02.285121 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3db5b3-6c2d-4cc3-bdee-24c8a31ef49e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:02.285492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3db5b3-6c2d-4cc3-bdee-24c8a31ef49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:02.332917 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-4c3db5b3-6c2d-4cc3-bdee-24c8a31ef49e None None] MFA Rules not processed for user `5cd24a726e4e4ce687d150a3bdc5948f`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:16:02.334159 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4c3db5b3-6c2d-4cc3-bdee-24c8a31ef49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:16:02.401553 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 702/1398] 10.222.0.57 () {58 vars in 1059 bytes} [Sat Jun 4 08:16:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:16:02.407087 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef4f56-f823-4b86-9252-ea43f51172ca None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:16:02.423388 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef4f56-f823-4b86-9252-ea43f51172ca None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:16:02.426131 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccada8c9-0a6a-4d2d-adb2-12e789990d78 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:02.426491 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccada8c9-0a6a-4d2d-adb2-12e789990d78 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:02.426836 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccada8c9-0a6a-4d2d-adb2-12e789990d78 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:02.428694 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 703/1399] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 08:16:02.428943 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8b31f-807a-490f-91cb-ff7c3db2302a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cd24a726e4e4ce687d150a3bdc5948f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:16:02.429582 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8b31f-807a-490f-91cb-ff7c3db2302a service glance] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:02.429965 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8b31f-807a-490f-91cb-ff7c3db2302a service glance] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:02.430244 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8b31f-807a-490f-91cb-ff7c3db2302a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:02.433724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a61283-a41d-4328-9afa-a913ac7423be None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:02.434042 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a61283-a41d-4328-9afa-a913ac7423be None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:02.434326 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a61283-a41d-4328-9afa-a913ac7423be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:02.439774 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8b31f-807a-490f-91cb-ff7c3db2302a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:16:02.441139 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8b31f-807a-490f-91cb-ff7c3db2302a service glance] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:16:02.451146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 697/1400] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:16:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:16:02.452521 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-69a61283-a41d-4328-9afa-a913ac7423be None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:16:02.453737 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-69a61283-a41d-4328-9afa-a913ac7423be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:16:02.461577 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 704/1401] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:16:02.505019 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8b31f-807a-490f-91cb-ff7c3db2302a service glance] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:16:02.517461 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8b31f-807a-490f-91cb-ff7c3db2302a service glance] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:16:02.523129 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf8553-0f8d-48cc-ad16-73f3adf1916b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:16:02.523772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf8553-0f8d-48cc-ad16-73f3adf1916b service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:02.524063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf8553-0f8d-48cc-ad16-73f3adf1916b service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:02.524342 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf8553-0f8d-48cc-ad16-73f3adf1916b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:02.533325 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf8553-0f8d-48cc-ad16-73f3adf1916b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:16:02.534969 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf8553-0f8d-48cc-ad16-73f3adf1916b service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:16:02.544349 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 698/1402] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:16:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:16:02.992282 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55749415-8c26-429b-8271-4238798b8b61 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:02.992684 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55749415-8c26-429b-8271-4238798b8b61 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:02.993088 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55749415-8c26-429b-8271-4238798b8b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:03.040378 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-55749415-8c26-429b-8271-4238798b8b61 None None] MFA Rules not processed for user `aff5d82384e84b669eeb00089ab8e09a`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:16:03.041571 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-55749415-8c26-429b-8271-4238798b8b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:16:03.106773 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 705/1403] 10.222.0.57 () {58 vars in 1009 bytes} [Sat Jun 4 08:16:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:16:03.151817 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a910251-0e1d-4d3a-8fc5-87e50b55577a None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:03.152105 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a910251-0e1d-4d3a-8fc5-87e50b55577a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:03.152386 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a910251-0e1d-4d3a-8fc5-87e50b55577a None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:03.153855 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 699/1404] 10.222.0.57 () {54 vars in 942 bytes} [Sat Jun 4 08:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:16:03.160046 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9bf64-b168-4b0c-9aee-31d46c4c33f3 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:03.160334 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9bf64-b168-4b0c-9aee-31d46c4c33f3 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:03.160653 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9bf64-b168-4b0c-9aee-31d46c4c33f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:03.208864 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-95b9bf64-b168-4b0c-9aee-31d46c4c33f3 None None] MFA Rules not processed for user `05ea412cab4244c58a2670c66f5a311c`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:16:03.210068 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-95b9bf64-b168-4b0c-9aee-31d46c4c33f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:16:03.218303 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:16:03.281754 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 706/1405] 10.222.0.57 () {58 vars in 1039 bytes} [Sat Jun 4 08:16:03 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:16:03.290838 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a910251-0e1d-4d3a-8fc5-87e50b55577a None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:16:03.304996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a910251-0e1d-4d3a-8fc5-87e50b55577a None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:16:03.310625 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498a4fd-1e2b-4440-807d-66cb2ae3a57a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05ea412cab4244c58a2670c66f5a311c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:16:03.311266 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498a4fd-1e2b-4440-807d-66cb2ae3a57a service swift] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:03.311546 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498a4fd-1e2b-4440-807d-66cb2ae3a57a service swift] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:03.311818 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498a4fd-1e2b-4440-807d-66cb2ae3a57a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:03.320061 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498a4fd-1e2b-4440-807d-66cb2ae3a57a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:16:03.321624 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498a4fd-1e2b-4440-807d-66cb2ae3a57a service swift] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:16:03.329642 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 700/1406] 10.222.0.57 () {60 vars in 1384 bytes} [Sat Jun 4 08:16:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 08:16:04.830420 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2e6ec-d225-48f7-8dd4-fea7492aa8e9 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:04.830967 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2e6ec-d225-48f7-8dd4-fea7492aa8e9 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:04.831092 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2e6ec-d225-48f7-8dd4-fea7492aa8e9 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:04.832463 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 707/1407] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:16:04.839797 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e783f7-122a-4d13-bdfc-7440708c76b4 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:04.840257 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e783f7-122a-4d13-bdfc-7440708c76b4 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:04.840371 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e783f7-122a-4d13-bdfc-7440708c76b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:04.859684 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-e7e783f7-122a-4d13-bdfc-7440708c76b4 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:16:04.860906 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e7e783f7-122a-4d13-bdfc-7440708c76b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:16:04.873861 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 701/1408] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:16:04.920925 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2e6ec-d225-48f7-8dd4-fea7492aa8e9 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:16:04.944709 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2e6ec-d225-48f7-8dd4-fea7492aa8e9 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:16:04.952207 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377fc20-a1de-4ced-801f-3ab445cae2e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:16:04.952875 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377fc20-a1de-4ced-801f-3ab445cae2e2 service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:04.955965 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377fc20-a1de-4ced-801f-3ab445cae2e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:04.955965 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377fc20-a1de-4ced-801f-3ab445cae2e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:04.966044 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377fc20-a1de-4ced-801f-3ab445cae2e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:16:04.967689 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377fc20-a1de-4ced-801f-3ab445cae2e2 service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:16:04.979489 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 708/1409] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:16:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:16:14.853871 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=84 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:16:14.973587 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=33 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:16:26.696812 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96281b-a694-450a-892b-447e1facb64c None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:26.697467 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96281b-a694-450a-892b-447e1facb64c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:26.697467 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96281b-a694-450a-892b-447e1facb64c None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:26.698779 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 702/1410] 10.222.0.57 () {54 vars in 918 bytes} [Sat Jun 4 08:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:16:26.703852 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2bf65-4ad9-400b-bf4c-12370fc4e555 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:26.704343 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2bf65-4ad9-400b-bf4c-12370fc4e555 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:26.704451 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2bf65-4ad9-400b-bf4c-12370fc4e555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:26.721857 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-2ae2bf65-4ad9-400b-bf4c-12370fc4e555 None None] MFA Rules not processed for user `6fb6720f0d0141fea795cecfbf6f2538`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:16:26.723039 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2ae2bf65-4ad9-400b-bf4c-12370fc4e555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:16:26.731858 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 709/1411] 10.222.0.57 () {58 vars in 1015 bytes} [Sat Jun 4 08:16:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:16:26.746415 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c048770-fc0d-4e03-8ae3-206753edbf0b None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:26.746704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c048770-fc0d-4e03-8ae3-206753edbf0b None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:26.746983 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c048770-fc0d-4e03-8ae3-206753edbf0b None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:26.748323 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 703/1412] 10.222.0.57 () {54 vars in 918 bytes} [Sat Jun 4 08:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:16:26.752755 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebba990-3e86-4140-beee-f69562a0abc1 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:26.753040 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebba990-3e86-4140-beee-f69562a0abc1 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:26.753317 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebba990-3e86-4140-beee-f69562a0abc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:26.770766 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-0ebba990-3e86-4140-beee-f69562a0abc1 None None] MFA Rules not processed for user `7e64d002241242928936dd0d991ecdc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:16:26.771936 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0ebba990-3e86-4140-beee-f69562a0abc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:16:26.780774 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 710/1413] 10.222.0.57 () {58 vars in 1015 bytes} [Sat Jun 4 08:16:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:16:29.527051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7917faa-ef6f-4323-84fc-067c3cd4fedd None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:29.527634 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7917faa-ef6f-4323-84fc-067c3cd4fedd None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:29.527634 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7917faa-ef6f-4323-84fc-067c3cd4fedd None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:29.528944 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 08:16:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:16:29.535210 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f3386-d149-4aed-894a-3412b3b2e1ce None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:29.536506 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f3386-d149-4aed-894a-3412b3b2e1ce None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:29.536506 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f3386-d149-4aed-894a-3412b3b2e1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:29.553367 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f20f3386-d149-4aed-894a-3412b3b2e1ce None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:16:29.554592 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f20f3386-d149-4aed-894a-3412b3b2e1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:16:29.562358 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 08:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:16:29.607348 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7917faa-ef6f-4323-84fc-067c3cd4fedd None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:16:29.624910 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7917faa-ef6f-4323-84fc-067c3cd4fedd None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:16:29.630554 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166769b-122b-4d35-ac91-ca3d57da943e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:16:29.631224 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166769b-122b-4d35-ac91-ca3d57da943e service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:29.631506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166769b-122b-4d35-ac91-ca3d57da943e service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:29.631782 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166769b-122b-4d35-ac91-ca3d57da943e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:29.641507 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166769b-122b-4d35-ac91-ca3d57da943e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:16:29.644265 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166769b-122b-4d35-ac91-ca3d57da943e service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:16:29.655089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 705/1416] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:16:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:16:30.673063 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909eba1-bdeb-4a9f-8bb6-f3da067b9810 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:30.673690 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909eba1-bdeb-4a9f-8bb6-f3da067b9810 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:30.673690 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909eba1-bdeb-4a9f-8bb6-f3da067b9810 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:30.675016 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 08:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:16:30.680104 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b68c71-0a5b-4edb-9bda-e969dcd31743 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:30.680532 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b68c71-0a5b-4edb-9bda-e969dcd31743 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:30.680644 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b68c71-0a5b-4edb-9bda-e969dcd31743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:30.698373 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-96b68c71-0a5b-4edb-9bda-e969dcd31743 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:16:30.699561 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-96b68c71-0a5b-4edb-9bda-e969dcd31743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:16:30.707330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 08:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:16:30.871982 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909eba1-bdeb-4a9f-8bb6-f3da067b9810 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:16:30.886293 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909eba1-bdeb-4a9f-8bb6-f3da067b9810 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:16:30.891624 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4f6cf-b590-445a-b147-af4e0dee4327 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:16:30.892257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4f6cf-b590-445a-b147-af4e0dee4327 service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:30.892540 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4f6cf-b590-445a-b147-af4e0dee4327 service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:30.892816 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4f6cf-b590-445a-b147-af4e0dee4327 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:30.901312 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4f6cf-b590-445a-b147-af4e0dee4327 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:16:30.902923 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4f6cf-b590-445a-b147-af4e0dee4327 service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:16:30.912194 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 713/1419] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:16:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:16:31.836126 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166184f-a048-4cdc-b3d1-df4db0e46db3 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:31.836657 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166184f-a048-4cdc-b3d1-df4db0e46db3 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:31.836657 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166184f-a048-4cdc-b3d1-df4db0e46db3 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:31.838627 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 08:16:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:16:31.843580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e8607-51b6-47b0-b3d0-5b0be14d56ae None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:31.844015 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e8607-51b6-47b0-b3d0-5b0be14d56ae None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:31.844122 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e8607-51b6-47b0-b3d0-5b0be14d56ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:31.861916 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-344e8607-51b6-47b0-b3d0-5b0be14d56ae None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:16:31.863113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-344e8607-51b6-47b0-b3d0-5b0be14d56ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:16:31.870947 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 08:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:16:32.020616 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166184f-a048-4cdc-b3d1-df4db0e46db3 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:16:32.035277 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166184f-a048-4cdc-b3d1-df4db0e46db3 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:16:32.040651 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754072f5-2421-4b31-b0d9-713d3a676676 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:16:32.041279 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754072f5-2421-4b31-b0d9-713d3a676676 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:32.041563 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754072f5-2421-4b31-b0d9-713d3a676676 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:32.041869 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754072f5-2421-4b31-b0d9-713d3a676676 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:32.049893 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754072f5-2421-4b31-b0d9-713d3a676676 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:16:32.051477 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754072f5-2421-4b31-b0d9-713d3a676676 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:16:32.061548 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 708/1422] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:16:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:16:32.949193 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6db34-a851-4325-a016-2bcbb2f6ba4a None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:32.949678 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6db34-a851-4325-a016-2bcbb2f6ba4a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:32.949774 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6db34-a851-4325-a016-2bcbb2f6ba4a None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:32.951171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 08:16:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 08:16:32.956091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea26051-fe92-402c-877a-d8fa79aa595b None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:32.956622 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea26051-fe92-402c-877a-d8fa79aa595b None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:32.956622 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea26051-fe92-402c-877a-d8fa79aa595b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:32.974496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-aea26051-fe92-402c-877a-d8fa79aa595b None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:16:32.975674 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-aea26051-fe92-402c-877a-d8fa79aa595b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:16:32.983289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 08:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:16:33.129536 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6db34-a851-4325-a016-2bcbb2f6ba4a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:16:33.145567 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6db34-a851-4325-a016-2bcbb2f6ba4a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:16:33.151047 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8eec1-ca69-4f83-82de-e23fa0fff89f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:16:33.151719 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8eec1-ca69-4f83-82de-e23fa0fff89f service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:33.152003 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8eec1-ca69-4f83-82de-e23fa0fff89f service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:33.152307 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8eec1-ca69-4f83-82de-e23fa0fff89f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:33.160594 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8eec1-ca69-4f83-82de-e23fa0fff89f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:16:33.162216 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8eec1-ca69-4f83-82de-e23fa0fff89f service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:16:33.171567 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 716/1425] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:16:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:16:34.076132 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad077279-4601-4295-aa01-f5fe9a75c0d8 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:34.076670 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad077279-4601-4295-aa01-f5fe9a75c0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:34.076670 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad077279-4601-4295-aa01-f5fe9a75c0d8 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:34.078086 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 08:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:16:34.083045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf21b8-49bc-496a-afcd-1de781087c43 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:34.083480 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf21b8-49bc-496a-afcd-1de781087c43 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:34.083610 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf21b8-49bc-496a-afcd-1de781087c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:34.102918 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-38bf21b8-49bc-496a-afcd-1de781087c43 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:16:34.104119 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-38bf21b8-49bc-496a-afcd-1de781087c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:16:34.111879 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 08:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:16:34.259173 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad077279-4601-4295-aa01-f5fe9a75c0d8 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:16:34.273784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad077279-4601-4295-aa01-f5fe9a75c0d8 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:16:34.279783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c10e1-d41d-4fd8-85ed-2ff94184fb83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:16:34.280417 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c10e1-d41d-4fd8-85ed-2ff94184fb83 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:34.280704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c10e1-d41d-4fd8-85ed-2ff94184fb83 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:34.280983 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c10e1-d41d-4fd8-85ed-2ff94184fb83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:34.289046 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c10e1-d41d-4fd8-85ed-2ff94184fb83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:16:34.290693 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c10e1-d41d-4fd8-85ed-2ff94184fb83 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:16:34.300035 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 711/1428] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:16:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:16:35.153427 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae506fe-10e5-4bf2-953e-9304657c23ef None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:35.154019 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae506fe-10e5-4bf2-953e-9304657c23ef None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:35.154019 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae506fe-10e5-4bf2-953e-9304657c23ef None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:35.155377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 08:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:16:35.160215 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252779b-bc72-436b-acc7-77a62cddd3f2 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:35.160600 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252779b-bc72-436b-acc7-77a62cddd3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:35.160774 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252779b-bc72-436b-acc7-77a62cddd3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:35.179291 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-2252779b-bc72-436b-acc7-77a62cddd3f2 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:16:35.180415 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2252779b-bc72-436b-acc7-77a62cddd3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:16:35.188235 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 08:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:16:35.336643 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae506fe-10e5-4bf2-953e-9304657c23ef None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:16:35.351578 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae506fe-10e5-4bf2-953e-9304657c23ef None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:16:35.357738 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00771c0d-556f-4351-b41e-88ba5189941b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:16:35.358406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00771c0d-556f-4351-b41e-88ba5189941b service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:35.358697 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00771c0d-556f-4351-b41e-88ba5189941b service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:35.358975 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00771c0d-556f-4351-b41e-88ba5189941b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:35.367188 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00771c0d-556f-4351-b41e-88ba5189941b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:16:35.368820 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00771c0d-556f-4351-b41e-88ba5189941b service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:16:35.378148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 719/1431] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:16:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:16:36.224971 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb1c32-5c61-41e2-b5ce-3e3934d52dbe None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:36.225515 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb1c32-5c61-41e2-b5ce-3e3934d52dbe None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:36.225515 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb1c32-5c61-41e2-b5ce-3e3934d52dbe None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:36.226876 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 08:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:16:36.232405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f730d2d-b300-4a09-8248-6d778ca1b52b None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:36.232817 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f730d2d-b300-4a09-8248-6d778ca1b52b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:36.232957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f730d2d-b300-4a09-8248-6d778ca1b52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:36.251239 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-8f730d2d-b300-4a09-8248-6d778ca1b52b None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:16:36.252428 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8f730d2d-b300-4a09-8248-6d778ca1b52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:16:36.260392 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 08:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:16:36.406812 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb1c32-5c61-41e2-b5ce-3e3934d52dbe None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:16:36.421228 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb1c32-5c61-41e2-b5ce-3e3934d52dbe None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:16:36.426474 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee232ba5-70d6-425b-95e0-59c45945131e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:16:36.427103 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee232ba5-70d6-425b-95e0-59c45945131e service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:36.427636 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee232ba5-70d6-425b-95e0-59c45945131e service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:36.427908 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee232ba5-70d6-425b-95e0-59c45945131e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:36.436387 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee232ba5-70d6-425b-95e0-59c45945131e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:16:36.437976 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee232ba5-70d6-425b-95e0-59c45945131e service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:16:36.447094 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 714/1434] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:16:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:16:37.303026 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d1e50-ac3d-4bce-bf61-98e67214f0eb None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:37.303566 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d1e50-ac3d-4bce-bf61-98e67214f0eb None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:37.303566 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d1e50-ac3d-4bce-bf61-98e67214f0eb None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:37.304951 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 08:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:16:37.310530 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94315728-8899-47c1-bac7-4f778a475b75 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:37.310963 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94315728-8899-47c1-bac7-4f778a475b75 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:37.311119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94315728-8899-47c1-bac7-4f778a475b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:37.329285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-94315728-8899-47c1-bac7-4f778a475b75 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:16:37.330534 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-94315728-8899-47c1-bac7-4f778a475b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:16:37.338310 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 08:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:16:37.485292 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d1e50-ac3d-4bce-bf61-98e67214f0eb None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:16:37.500015 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d1e50-ac3d-4bce-bf61-98e67214f0eb None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:16:37.505521 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8f8ba-6e5b-4cfd-bb66-a149f625c94f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:16:37.506482 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8f8ba-6e5b-4cfd-bb66-a149f625c94f service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:37.506770 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8f8ba-6e5b-4cfd-bb66-a149f625c94f service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:37.507048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8f8ba-6e5b-4cfd-bb66-a149f625c94f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:37.515871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8f8ba-6e5b-4cfd-bb66-a149f625c94f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:16:37.517468 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8f8ba-6e5b-4cfd-bb66-a149f625c94f service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:16:37.529389 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 722/1437] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:16:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:16:38.366798 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300055e-0e7c-4fa0-a2a7-66b29076b4ac None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:38.367377 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300055e-0e7c-4fa0-a2a7-66b29076b4ac None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:38.367377 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300055e-0e7c-4fa0-a2a7-66b29076b4ac None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:38.368714 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 08:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:16:38.373871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b85f2-e601-40be-8923-a8a0defb0bac None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:38.374331 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b85f2-e601-40be-8923-a8a0defb0bac None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:38.374427 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b85f2-e601-40be-8923-a8a0defb0bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:38.392821 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-7e7b85f2-e601-40be-8923-a8a0defb0bac None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:16:38.394317 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-7e7b85f2-e601-40be-8923-a8a0defb0bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:16:38.402771 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 08:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:16:38.550245 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300055e-0e7c-4fa0-a2a7-66b29076b4ac None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:16:38.565025 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300055e-0e7c-4fa0-a2a7-66b29076b4ac None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:16:38.571209 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e003ea2-1713-4beb-b72c-3ae2b1077bf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:16:38.572391 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e003ea2-1713-4beb-b72c-3ae2b1077bf7 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:38.572682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e003ea2-1713-4beb-b72c-3ae2b1077bf7 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:38.572963 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e003ea2-1713-4beb-b72c-3ae2b1077bf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:38.581155 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e003ea2-1713-4beb-b72c-3ae2b1077bf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:16:38.582771 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e003ea2-1713-4beb-b72c-3ae2b1077bf7 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:16:38.593418 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 717/1440] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:16:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:16:40.659924 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43890800-e9c3-45a0-b7c1-17f7c0ff7b63 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:40.660487 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43890800-e9c3-45a0-b7c1-17f7c0ff7b63 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:40.660487 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43890800-e9c3-45a0-b7c1-17f7c0ff7b63 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:40.661843 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 08:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:16:40.667189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d5025-a4ad-4680-86c0-95c2ea39fca9 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:40.667608 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d5025-a4ad-4680-86c0-95c2ea39fca9 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:40.667768 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d5025-a4ad-4680-86c0-95c2ea39fca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:40.686548 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-ce7d5025-a4ad-4680-86c0-95c2ea39fca9 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:16:40.687737 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ce7d5025-a4ad-4680-86c0-95c2ea39fca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:16:40.695479 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 08:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:16:40.734376 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43890800-e9c3-45a0-b7c1-17f7c0ff7b63 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:16:40.745596 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43890800-e9c3-45a0-b7c1-17f7c0ff7b63 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:16:40.749108 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5299b-8fbc-4107-9f80-d7145c252296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:16:40.749739 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5299b-8fbc-4107-9f80-d7145c252296 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:40.750058 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5299b-8fbc-4107-9f80-d7145c252296 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:40.750339 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5299b-8fbc-4107-9f80-d7145c252296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:40.759097 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5299b-8fbc-4107-9f80-d7145c252296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:16:40.760535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5299b-8fbc-4107-9f80-d7145c252296 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:16:40.769765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 725/1443] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:16:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:16:43.161227 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4ae13-d646-495b-9ab6-bb17e93606b8 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:43.161744 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4ae13-d646-495b-9ab6-bb17e93606b8 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:43.161744 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4ae13-d646-495b-9ab6-bb17e93606b8 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:43.163125 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 08:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:16:43.168647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5ca60-9842-4a99-a9df-587325bd80c6 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:43.169073 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5ca60-9842-4a99-a9df-587325bd80c6 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:43.169222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5ca60-9842-4a99-a9df-587325bd80c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:43.186827 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6dc5ca60-9842-4a99-a9df-587325bd80c6 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:16:43.188005 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6dc5ca60-9842-4a99-a9df-587325bd80c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:16:43.195599 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 08:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:16:43.234051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4ae13-d646-495b-9ab6-bb17e93606b8 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:16:43.245286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4ae13-d646-495b-9ab6-bb17e93606b8 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:16:43.249085 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66924bef-7cd3-4144-9de1-61e7a121dd7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:16:43.249732 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66924bef-7cd3-4144-9de1-61e7a121dd7d service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:43.250024 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66924bef-7cd3-4144-9de1-61e7a121dd7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:43.250331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66924bef-7cd3-4144-9de1-61e7a121dd7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:43.259235 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66924bef-7cd3-4144-9de1-61e7a121dd7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:16:43.260644 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66924bef-7cd3-4144-9de1-61e7a121dd7d service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:16:43.270295 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 720/1446] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:16:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:16:45.903017 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bec45-ebeb-4fcb-a326-2caadf056ad2 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:45.903535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bec45-ebeb-4fcb-a326-2caadf056ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:45.903535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bec45-ebeb-4fcb-a326-2caadf056ad2 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:45.904843 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 08:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:16:45.910002 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aab5b0-e46b-45bd-a21d-d672ed40a550 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:45.910471 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aab5b0-e46b-45bd-a21d-d672ed40a550 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:45.910595 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aab5b0-e46b-45bd-a21d-d672ed40a550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:45.929799 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-e5aab5b0-e46b-45bd-a21d-d672ed40a550 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:16:45.931015 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e5aab5b0-e46b-45bd-a21d-d672ed40a550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:16:45.938855 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 08:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:16:45.977082 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170bec45-ebeb-4fcb-a326-2caadf056ad2 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:16:45.987543 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170bec45-ebeb-4fcb-a326-2caadf056ad2 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:16:45.990984 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507ce1f-68d4-4f07-8f58-972063c4ed5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:16:45.991613 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507ce1f-68d4-4f07-8f58-972063c4ed5d service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:45.991892 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507ce1f-68d4-4f07-8f58-972063c4ed5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:45.992166 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507ce1f-68d4-4f07-8f58-972063c4ed5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:46.000930 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507ce1f-68d4-4f07-8f58-972063c4ed5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:16:46.002429 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507ce1f-68d4-4f07-8f58-972063c4ed5d service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:16:46.012347 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 728/1449] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:16:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:16:48.337168 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7d554-38c4-42c5-9b82-509732a215be None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:48.337794 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7d554-38c4-42c5-9b82-509732a215be None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:48.337794 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7d554-38c4-42c5-9b82-509732a215be None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:48.339106 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 08:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:16:48.344327 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686d2b3-ebde-40ee-ac8d-80fe4382248f None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:48.344785 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686d2b3-ebde-40ee-ac8d-80fe4382248f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:48.344899 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686d2b3-ebde-40ee-ac8d-80fe4382248f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:48.362733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e686d2b3-ebde-40ee-ac8d-80fe4382248f None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:16:48.363915 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e686d2b3-ebde-40ee-ac8d-80fe4382248f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:16:48.372248 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 08:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:16:48.411692 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7d554-38c4-42c5-9b82-509732a215be None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:16:48.422805 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7d554-38c4-42c5-9b82-509732a215be None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:16:48.426506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca9277-c081-4df0-99a5-ce3d715978c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:16:48.427140 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca9277-c081-4df0-99a5-ce3d715978c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:48.427674 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca9277-c081-4df0-99a5-ce3d715978c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:48.427949 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca9277-c081-4df0-99a5-ce3d715978c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:48.437480 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca9277-c081-4df0-99a5-ce3d715978c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:16:48.438938 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca9277-c081-4df0-99a5-ce3d715978c2 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:16:48.448502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 723/1452] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:16:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:16:50.707308 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2827550-46c4-4fa4-9c48-12ed1b4cb18f None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:50.707886 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2827550-46c4-4fa4-9c48-12ed1b4cb18f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:50.707886 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2827550-46c4-4fa4-9c48-12ed1b4cb18f None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:50.709248 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 08:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:16:50.715130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de4f3c-79e7-48ca-b36a-280639e61461 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:50.715545 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de4f3c-79e7-48ca-b36a-280639e61461 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:50.715738 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de4f3c-79e7-48ca-b36a-280639e61461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:50.733227 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-09de4f3c-79e7-48ca-b36a-280639e61461 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:16:50.734455 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-09de4f3c-79e7-48ca-b36a-280639e61461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:16:50.742268 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 08:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:16:50.780893 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2827550-46c4-4fa4-9c48-12ed1b4cb18f None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:16:50.791412 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2827550-46c4-4fa4-9c48-12ed1b4cb18f None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:16:50.794924 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a8cf8-343d-4eac-a730-af59bafd6ef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:16:50.795554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a8cf8-343d-4eac-a730-af59bafd6ef4 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:50.795839 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a8cf8-343d-4eac-a730-af59bafd6ef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:50.796115 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a8cf8-343d-4eac-a730-af59bafd6ef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:50.805303 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a8cf8-343d-4eac-a730-af59bafd6ef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:16:50.807294 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a8cf8-343d-4eac-a730-af59bafd6ef4 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:16:50.816561 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 731/1455] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:16:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:16:53.103012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b38dbe-9a5e-4903-840f-626e75554289 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:53.103569 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b38dbe-9a5e-4903-840f-626e75554289 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:53.103569 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b38dbe-9a5e-4903-840f-626e75554289 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:53.104925 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 08:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:16:53.110205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9450a21-c777-4ab5-be50-427b53cf2bea None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:53.110606 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9450a21-c777-4ab5-be50-427b53cf2bea None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:53.110775 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9450a21-c777-4ab5-be50-427b53cf2bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:53.128668 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-b9450a21-c777-4ab5-be50-427b53cf2bea None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:16:53.129899 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b9450a21-c777-4ab5-be50-427b53cf2bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:16:53.138394 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 08:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:16:53.174720 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b38dbe-9a5e-4903-840f-626e75554289 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:16:53.185922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b38dbe-9a5e-4903-840f-626e75554289 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:16:53.189544 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae6d1f-49a6-4809-87f6-7e05fd9edc67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:16:53.190230 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae6d1f-49a6-4809-87f6-7e05fd9edc67 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:53.190545 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae6d1f-49a6-4809-87f6-7e05fd9edc67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:53.190821 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae6d1f-49a6-4809-87f6-7e05fd9edc67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:53.200501 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae6d1f-49a6-4809-87f6-7e05fd9edc67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:16:53.201975 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae6d1f-49a6-4809-87f6-7e05fd9edc67 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:16:53.211278 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 726/1458] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:16:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:16:55.496522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454a08f-add3-4cd6-be3c-5ba59968ff63 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:55.497104 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454a08f-add3-4cd6-be3c-5ba59968ff63 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:55.497104 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454a08f-add3-4cd6-be3c-5ba59968ff63 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:55.498510 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 08:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:16:55.504022 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc52636-4f3c-4c12-b98e-c250c92b867f None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:55.504460 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc52636-4f3c-4c12-b98e-c250c92b867f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:55.504560 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc52636-4f3c-4c12-b98e-c250c92b867f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:55.510636 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=70 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:16:55.523179 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-1dc52636-4f3c-4c12-b98e-c250c92b867f None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:16:55.524378 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1dc52636-4f3c-4c12-b98e-c250c92b867f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:16:55.532763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 08:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:16:55.570811 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454a08f-add3-4cd6-be3c-5ba59968ff63 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:16:55.576236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=73 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:16:55.582457 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454a08f-add3-4cd6-be3c-5ba59968ff63 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:16:55.585862 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71886664-1245-44aa-8be3-bab6cecdaec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:16:55.586495 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71886664-1245-44aa-8be3-bab6cecdaec7 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:55.586778 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71886664-1245-44aa-8be3-bab6cecdaec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:55.587547 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71886664-1245-44aa-8be3-bab6cecdaec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:55.596298 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71886664-1245-44aa-8be3-bab6cecdaec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:16:55.597719 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71886664-1245-44aa-8be3-bab6cecdaec7 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:16:55.607831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 734/1461] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:16:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:16:57.902658 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312c1d1-ab1f-40a0-8843-1bfbea19ebb4 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:57.903171 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312c1d1-ab1f-40a0-8843-1bfbea19ebb4 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:57.903171 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312c1d1-ab1f-40a0-8843-1bfbea19ebb4 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:57.904496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 08:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:16:57.909867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3700f-8e29-4397-b72c-3880a9f06087 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:57.910297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3700f-8e29-4397-b72c-3880a9f06087 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:57.910412 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3700f-8e29-4397-b72c-3880a9f06087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:57.930562 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-b0e3700f-8e29-4397-b72c-3880a9f06087 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:16:57.931765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b0e3700f-8e29-4397-b72c-3880a9f06087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:16:57.939662 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 08:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:16:57.977389 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312c1d1-ab1f-40a0-8843-1bfbea19ebb4 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:16:57.987898 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312c1d1-ab1f-40a0-8843-1bfbea19ebb4 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:16:57.991370 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fbbc9-89b0-41e0-9614-2de887b6d983 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:16:57.991994 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fbbc9-89b0-41e0-9614-2de887b6d983 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:16:57.992273 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fbbc9-89b0-41e0-9614-2de887b6d983 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:16:57.992546 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fbbc9-89b0-41e0-9614-2de887b6d983 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:16:58.001248 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373fbbc9-89b0-41e0-9614-2de887b6d983 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:16:58.002687 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373fbbc9-89b0-41e0-9614-2de887b6d983 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:16:58.012393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 729/1464] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:16:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:17:00.255380 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ec4dd-42c9-49b4-b266-0ad33cd6ee86 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:17:00.255926 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ec4dd-42c9-49b4-b266-0ad33cd6ee86 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:17:00.255926 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ec4dd-42c9-49b4-b266-0ad33cd6ee86 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:17:00.257289 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 08:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:17:00.262561 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2061ac2-2c0d-4a23-9e02-e164e264937d None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:17:00.263009 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2061ac2-2c0d-4a23-9e02-e164e264937d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:17:00.263144 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2061ac2-2c0d-4a23-9e02-e164e264937d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:17:00.280588 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-d2061ac2-2c0d-4a23-9e02-e164e264937d None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:17:00.281789 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d2061ac2-2c0d-4a23-9e02-e164e264937d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:17:00.289601 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 08:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:17:00.325938 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ec4dd-42c9-49b4-b266-0ad33cd6ee86 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:17:00.336408 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ec4dd-42c9-49b4-b266-0ad33cd6ee86 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:17:00.339911 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd402b-384d-4003-9a0b-eead3d58e508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:17:00.340535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd402b-384d-4003-9a0b-eead3d58e508 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:17:00.340814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd402b-384d-4003-9a0b-eead3d58e508 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:17:00.341085 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd402b-384d-4003-9a0b-eead3d58e508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:17:00.349734 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd402b-384d-4003-9a0b-eead3d58e508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:17:00.351177 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd402b-384d-4003-9a0b-eead3d58e508 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:17:00.360824 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 737/1467] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:17:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:17:02.641611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08d077-b007-41eb-8bd1-19390ebc353a None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:17:02.642219 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08d077-b007-41eb-8bd1-19390ebc353a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:17:02.642219 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08d077-b007-41eb-8bd1-19390ebc353a None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:17:02.643574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 08:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:17:02.648997 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0f840-004b-4c79-9e25-7c6484e602a5 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:17:02.650022 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0f840-004b-4c79-9e25-7c6484e602a5 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:17:02.650226 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0f840-004b-4c79-9e25-7c6484e602a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:17:02.667453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e2a0f840-004b-4c79-9e25-7c6484e602a5 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:17:02.668637 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e2a0f840-004b-4c79-9e25-7c6484e602a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:17:02.676326 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 08:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:17:02.713361 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08d077-b007-41eb-8bd1-19390ebc353a None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:17:02.723919 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08d077-b007-41eb-8bd1-19390ebc353a None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:17:02.727572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d54af-95fe-4aa4-b86a-58be18278f75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:17:02.728352 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d54af-95fe-4aa4-b86a-58be18278f75 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:17:02.728632 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d54af-95fe-4aa4-b86a-58be18278f75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:17:02.729057 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d54af-95fe-4aa4-b86a-58be18278f75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:17:02.737918 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d54af-95fe-4aa4-b86a-58be18278f75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:17:02.739343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d54af-95fe-4aa4-b86a-58be18278f75 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:17:02.748976 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 732/1470] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:17:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:17:12.662414 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=17 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:17:12.744573 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=17 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:17:34.359335 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71462ad-705e-40bd-b00b-d442abccaa55 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:17:34.359933 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71462ad-705e-40bd-b00b-d442abccaa55 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:17:34.359933 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71462ad-705e-40bd-b00b-d442abccaa55 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:17:34.361289 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 739/1471] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:17:34.366732 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87302a12-f0b9-4e33-ba86-8fa5012d4d56 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:17:34.367725 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87302a12-f0b9-4e33-ba86-8fa5012d4d56 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:17:34.367833 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87302a12-f0b9-4e33-ba86-8fa5012d4d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:17:34.386667 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-87302a12-f0b9-4e33-ba86-8fa5012d4d56 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:17:34.387863 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-87302a12-f0b9-4e33-ba86-8fa5012d4d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:17:34.395659 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 733/1472] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:17:34.442502 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad84a2-7884-4259-afc0-44649b2b2458 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:17:34.442795 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad84a2-7884-4259-afc0-44649b2b2458 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:17:34.443073 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad84a2-7884-4259-afc0-44649b2b2458 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:17:34.444426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 740/1473] 10.222.0.57 () {54 vars in 962 bytes} [Sat Jun 4 08:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:17:34.449933 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330e4a6-362f-460c-befd-5e5d03ca3636 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:17:34.450225 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330e4a6-362f-460c-befd-5e5d03ca3636 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:17:34.450502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330e4a6-362f-460c-befd-5e5d03ca3636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:17:34.467977 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-0330e4a6-362f-460c-befd-5e5d03ca3636 None None] MFA Rules not processed for user `5cd24a726e4e4ce687d150a3bdc5948f`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:17:34.469154 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0330e4a6-362f-460c-befd-5e5d03ca3636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:17:34.475574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 734/1474] 10.222.0.57 () {58 vars in 1059 bytes} [Sat Jun 4 08:17:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:17:34.482661 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad84a2-7884-4259-afc0-44649b2b2458 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:17:34.493765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad84a2-7884-4259-afc0-44649b2b2458 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:17:34.497338 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d712e74-ab3e-4679-abba-dd43ff89dc39 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cd24a726e4e4ce687d150a3bdc5948f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:17:34.498001 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d712e74-ab3e-4679-abba-dd43ff89dc39 service glance] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:17:34.498289 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d712e74-ab3e-4679-abba-dd43ff89dc39 service glance] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:17:34.498564 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d712e74-ab3e-4679-abba-dd43ff89dc39 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:17:34.507366 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d712e74-ab3e-4679-abba-dd43ff89dc39 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:17:34.509426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d712e74-ab3e-4679-abba-dd43ff89dc39 service glance] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:17:34.519804 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 741/1475] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:17:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:17:36.858262 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b20674-6c2d-49d8-8c7a-6e29677a9282 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:17:36.858877 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b20674-6c2d-49d8-8c7a-6e29677a9282 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:17:36.858877 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b20674-6c2d-49d8-8c7a-6e29677a9282 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:17:36.860091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 735/1476] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:17:36.865233 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b1b08-b327-4c85-811f-ab11dc7e039d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:17:36.865660 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b1b08-b327-4c85-811f-ab11dc7e039d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:17:36.865807 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b1b08-b327-4c85-811f-ab11dc7e039d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:17:36.883277 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-cf9b1b08-b327-4c85-811f-ab11dc7e039d None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:17:36.884490 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-cf9b1b08-b327-4c85-811f-ab11dc7e039d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:17:36.892355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 742/1477] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:17:36.917708 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b20674-6c2d-49d8-8c7a-6e29677a9282 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:17:36.933394 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b20674-6c2d-49d8-8c7a-6e29677a9282 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:17:36.937887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c411ec-4f3e-4da2-a187-89778e7fc331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:17:36.938536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c411ec-4f3e-4da2-a187-89778e7fc331 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:17:36.938821 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c411ec-4f3e-4da2-a187-89778e7fc331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:17:36.939095 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c411ec-4f3e-4da2-a187-89778e7fc331 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:17:36.939821 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c411ec-4f3e-4da2-a187-89778e7fc331 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:17:36.941571 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: WARNING py.warnings [None req-f4c411ec-4f3e-4da2-a187-89778e7fc331 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 08:17:36.941571 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: warnings.warn(msg) Jun 04 08:17:36.941571 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: Jun 04 08:17:36.942737 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c411ec-4f3e-4da2-a187-89778e7fc331 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:17:36.962437 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 736/1478] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jun 4 08:17:36 2022] GET /identity/v3/projects => generated 2553 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:17:39.222290 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd07b5-210b-47b9-90a1-0092c4f2745c None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:17:39.222839 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd07b5-210b-47b9-90a1-0092c4f2745c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:17:39.222839 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd07b5-210b-47b9-90a1-0092c4f2745c None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:17:39.224132 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 743/1479] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:17:39.230075 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05878689-6e9f-4d57-8c40-49bc5a40d500 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:17:39.230584 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05878689-6e9f-4d57-8c40-49bc5a40d500 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:17:39.230684 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05878689-6e9f-4d57-8c40-49bc5a40d500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:17:39.248797 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-05878689-6e9f-4d57-8c40-49bc5a40d500 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:17:39.250027 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-05878689-6e9f-4d57-8c40-49bc5a40d500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:17:39.257846 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 737/1480] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:17:39.301433 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd07b5-210b-47b9-90a1-0092c4f2745c None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:17:39.316565 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd07b5-210b-47b9-90a1-0092c4f2745c None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:17:39.321973 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d54fb1-3ce8-472b-b82f-0a94d0a3d552 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:17:39.322611 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d54fb1-3ce8-472b-b82f-0a94d0a3d552 service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:17:39.322893 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d54fb1-3ce8-472b-b82f-0a94d0a3d552 service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:17:39.323173 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d54fb1-3ce8-472b-b82f-0a94d0a3d552 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:17:39.331308 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d54fb1-3ce8-472b-b82f-0a94d0a3d552 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:17:39.332884 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d54fb1-3ce8-472b-b82f-0a94d0a3d552 service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:17:39.342282 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 744/1481] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:17:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:17:41.744156 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4375f1-3e1b-438a-baf5-6a7f2258419f None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:17:41.744720 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4375f1-3e1b-438a-baf5-6a7f2258419f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:17:41.744720 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4375f1-3e1b-438a-baf5-6a7f2258419f None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:17:41.746189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 738/1482] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:17:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:17:41.751337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bbea0-b2fb-401e-953b-bf7348f8d516 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:17:41.751779 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bbea0-b2fb-401e-953b-bf7348f8d516 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:17:41.751928 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bbea0-b2fb-401e-953b-bf7348f8d516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:17:41.769287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f00bbea0-b2fb-401e-953b-bf7348f8d516 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:17:41.770511 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f00bbea0-b2fb-401e-953b-bf7348f8d516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:17:41.778236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 745/1483] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:17:41.815453 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4375f1-3e1b-438a-baf5-6a7f2258419f None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:17:41.826369 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4375f1-3e1b-438a-baf5-6a7f2258419f None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:17:41.829905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b09266-38fb-4065-a10c-bedce591c09b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:17:41.830534 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b09266-38fb-4065-a10c-bedce591c09b service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:17:41.830817 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b09266-38fb-4065-a10c-bedce591c09b service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:17:41.831124 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b09266-38fb-4065-a10c-bedce591c09b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:17:41.840489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b09266-38fb-4065-a10c-bedce591c09b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:17:41.841954 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b09266-38fb-4065-a10c-bedce591c09b service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:17:41.851980 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 739/1484] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:17:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:17:44.110745 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482320d5-d196-4a77-805c-63e7cb969ef4 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:17:44.111301 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482320d5-d196-4a77-805c-63e7cb969ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:17:44.111301 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482320d5-d196-4a77-805c-63e7cb969ef4 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:17:44.112700 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 746/1485] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:17:44.118347 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acbead-6896-4d46-8108-ae4da8871462 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:17:44.118804 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acbead-6896-4d46-8108-ae4da8871462 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:17:44.118916 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acbead-6896-4d46-8108-ae4da8871462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:17:44.136822 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-28acbead-6896-4d46-8108-ae4da8871462 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:17:44.138025 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-28acbead-6896-4d46-8108-ae4da8871462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:17:44.145675 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 740/1486] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:17:44.182561 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482320d5-d196-4a77-805c-63e7cb969ef4 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:17:44.193045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482320d5-d196-4a77-805c-63e7cb969ef4 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:17:44.197134 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc57cb-7291-4ba6-9108-a07db0e2049a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:17:44.197764 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc57cb-7291-4ba6-9108-a07db0e2049a service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:17:44.198077 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc57cb-7291-4ba6-9108-a07db0e2049a service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:17:44.198352 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc57cb-7291-4ba6-9108-a07db0e2049a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:17:44.207561 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc57cb-7291-4ba6-9108-a07db0e2049a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:17:44.208992 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc57cb-7291-4ba6-9108-a07db0e2049a service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:17:44.218404 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 747/1487] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:17:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:17:46.521569 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7753c-bc4c-4189-90a0-fb8ecb1a3d21 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:17:46.522156 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7753c-bc4c-4189-90a0-fb8ecb1a3d21 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:17:46.522156 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7753c-bc4c-4189-90a0-fb8ecb1a3d21 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:17:46.524042 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 741/1488] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:17:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:17:46.529518 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6c38c-35b9-43d7-afc2-110e0463f42e None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:17:46.529956 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6c38c-35b9-43d7-afc2-110e0463f42e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:17:46.530124 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6c38c-35b9-43d7-afc2-110e0463f42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:17:46.548209 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-ddc6c38c-35b9-43d7-afc2-110e0463f42e None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:17:46.549404 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ddc6c38c-35b9-43d7-afc2-110e0463f42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:17:46.557616 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 748/1489] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:17:46.597026 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7753c-bc4c-4189-90a0-fb8ecb1a3d21 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:17:46.609358 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7753c-bc4c-4189-90a0-fb8ecb1a3d21 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:17:46.612858 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293ec0e-87f8-4920-8d9f-40968a30751b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:17:46.613486 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293ec0e-87f8-4920-8d9f-40968a30751b service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:17:46.613769 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293ec0e-87f8-4920-8d9f-40968a30751b service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:17:46.614072 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293ec0e-87f8-4920-8d9f-40968a30751b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:17:46.622746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293ec0e-87f8-4920-8d9f-40968a30751b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:17:46.624170 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293ec0e-87f8-4920-8d9f-40968a30751b service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:17:46.633356 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 742/1490] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:17:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:17:49.102237 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb53b9b-0300-4bb5-b773-c141338bbd00 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:17:49.102820 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb53b9b-0300-4bb5-b773-c141338bbd00 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:17:49.102820 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb53b9b-0300-4bb5-b773-c141338bbd00 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:17:49.104147 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 749/1491] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jun 4 08:17:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:17:49.109337 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba3872-8701-4172-8783-d203a2e279f2 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:17:49.109744 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba3872-8701-4172-8783-d203a2e279f2 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:17:49.109966 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba3872-8701-4172-8783-d203a2e279f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:17:49.128048 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-5dba3872-8701-4172-8783-d203a2e279f2 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:17:49.129252 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-5dba3872-8701-4172-8783-d203a2e279f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:17:49.137037 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 743/1492] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jun 4 08:17:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:17:49.174831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb53b9b-0300-4bb5-b773-c141338bbd00 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:17:49.186239 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb53b9b-0300-4bb5-b773-c141338bbd00 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:17:49.189677 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed01f9-7404-4d7d-9b4d-cec4193943ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:17:49.190342 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed01f9-7404-4d7d-9b4d-cec4193943ec service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:17:49.190628 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed01f9-7404-4d7d-9b4d-cec4193943ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:17:49.190907 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed01f9-7404-4d7d-9b4d-cec4193943ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:17:49.199713 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed01f9-7404-4d7d-9b4d-cec4193943ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:17:49.201139 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed01f9-7404-4d7d-9b4d-cec4193943ec service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:17:49.210401 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 750/1493] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:17:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:17:59.123029 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=33 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:17:59.206408 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=33 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:19:14.682958 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd209da2-218c-4e8b-b655-a37d0453bba4 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:19:14.683566 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd209da2-218c-4e8b-b655-a37d0453bba4 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:19:14.683566 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd209da2-218c-4e8b-b655-a37d0453bba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:19:14.701981 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-cd209da2-218c-4e8b-b655-a37d0453bba4 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:19:14.703191 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-cd209da2-218c-4e8b-b655-a37d0453bba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:19:14.711590 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 744/1494] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:19:14.719582 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91236661-5646-4d39-8a95-16441fe1d115 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:19:14.720056 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91236661-5646-4d39-8a95-16441fe1d115 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:19:14.720160 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91236661-5646-4d39-8a95-16441fe1d115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:19:14.737493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-91236661-5646-4d39-8a95-16441fe1d115 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:19:14.738954 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-91236661-5646-4d39-8a95-16441fe1d115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:19:14.747182 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 751/1495] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:19:14.751616 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd209da2-218c-4e8b-b655-a37d0453bba4 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:19:14.761682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd209da2-218c-4e8b-b655-a37d0453bba4 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:19:14.766174 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1853e1f-f293-4d76-a7ee-45810e23a1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:19:14.766819 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1853e1f-f293-4d76-a7ee-45810e23a1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:19:14.767101 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1853e1f-f293-4d76-a7ee-45810e23a1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:19:14.767377 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1853e1f-f293-4d76-a7ee-45810e23a1e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:19:14.768089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1853e1f-f293-4d76-a7ee-45810e23a1e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:19:14.768396 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1853e1f-f293-4d76-a7ee-45810e23a1e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:19:14.769407 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: WARNING py.warnings [None req-e1853e1f-f293-4d76-a7ee-45810e23a1e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 08:19:14.769407 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: warnings.warn(msg) Jun 04 08:19:14.769407 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: Jun 04 08:19:14.770919 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1853e1f-f293-4d76-a7ee-45810e23a1e0 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:19:14.782376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 745/1496] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:19:14.790334 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91236661-5646-4d39-8a95-16441fe1d115 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:19:14.800239 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91236661-5646-4d39-8a95-16441fe1d115 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:19:14.805619 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e65caf-773c-4202-8f03-e8510f0d1005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:19:14.806308 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e65caf-773c-4202-8f03-e8510f0d1005 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:19:14.806595 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e65caf-773c-4202-8f03-e8510f0d1005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:19:14.806871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e65caf-773c-4202-8f03-e8510f0d1005 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:19:14.807556 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e65caf-773c-4202-8f03-e8510f0d1005 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:19:14.809294 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: WARNING py.warnings [None req-45e65caf-773c-4202-8f03-e8510f0d1005 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 08:19:14.809294 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: warnings.warn(msg) Jun 04 08:19:14.809294 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: Jun 04 08:19:14.810533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e65caf-773c-4202-8f03-e8510f0d1005 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:19:14.846401 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 752/1497] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:19:14 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:19:14.850571 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1853e1f-f293-4d76-a7ee-45810e23a1e0 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:19:14.860611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1853e1f-f293-4d76-a7ee-45810e23a1e0 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:19:14.916038 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b32317-235e-490a-bf37-c5793799cb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:19:14.916714 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b32317-235e-490a-bf37-c5793799cb77 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:19:14.916999 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b32317-235e-490a-bf37-c5793799cb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:19:14.917278 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b32317-235e-490a-bf37-c5793799cb77 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:19:14.918009 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b32317-235e-490a-bf37-c5793799cb77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:19:14.919049 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: WARNING py.warnings [None req-c0b32317-235e-490a-bf37-c5793799cb77 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 08:19:14.919049 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: warnings.warn(msg) Jun 04 08:19:14.919049 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: Jun 04 08:19:14.920291 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b32317-235e-490a-bf37-c5793799cb77 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:19:14.941346 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 746/1498] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:19:14 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:19:14.946131 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e65caf-773c-4202-8f03-e8510f0d1005 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:19:14.956209 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e65caf-773c-4202-8f03-e8510f0d1005 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:19:14.960785 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5d522-6b1c-4b09-9300-5156c906d8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:19:14.961437 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5d522-6b1c-4b09-9300-5156c906d8ed admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:19:14.961723 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5d522-6b1c-4b09-9300-5156c906d8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:19:14.962037 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5d522-6b1c-4b09-9300-5156c906d8ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:19:14.962757 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5d522-6b1c-4b09-9300-5156c906d8ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:19:14.963797 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: WARNING py.warnings [None req-8ae5d522-6b1c-4b09-9300-5156c906d8ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 08:19:14.963797 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: warnings.warn(msg) Jun 04 08:19:14.963797 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: Jun 04 08:19:14.964683 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5d522-6b1c-4b09-9300-5156c906d8ed admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:19:14.977173 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 753/1499] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:19:14.980939 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b32317-235e-490a-bf37-c5793799cb77 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:19:14.991252 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b32317-235e-490a-bf37-c5793799cb77 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:19:14.995823 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf009e-db72-44f8-b896-747593c92c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:19:14.996471 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf009e-db72-44f8-b896-747593c92c66 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:19:14.996749 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf009e-db72-44f8-b896-747593c92c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:19:14.997024 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf009e-db72-44f8-b896-747593c92c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:19:14.997735 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf009e-db72-44f8-b896-747593c92c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:19:14.998760 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: WARNING py.warnings [None req-fcbf009e-db72-44f8-b896-747593c92c66 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 08:19:14.998760 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: warnings.warn(msg) Jun 04 08:19:14.998760 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: Jun 04 08:19:14.999733 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf009e-db72-44f8-b896-747593c92c66 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:19:15.013152 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 747/1500] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:19:15.017027 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5d522-6b1c-4b09-9300-5156c906d8ed admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:19:15.026502 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5d522-6b1c-4b09-9300-5156c906d8ed admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:19:15.030913 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c221885-11aa-4d1f-9a8d-674c5abf3461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:19:15.031794 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c221885-11aa-4d1f-9a8d-674c5abf3461 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:19:15.032070 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c221885-11aa-4d1f-9a8d-674c5abf3461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:19:15.032340 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c221885-11aa-4d1f-9a8d-674c5abf3461 admin admin] PATH_INFO: `/v3/projects/8634e385f9c34925839f380c671f427d/users/a2e68adf6ee04464b3661cf138cc58cd/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:19:15.046480 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c221885-11aa-4d1f-9a8d-674c5abf3461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8634e385f9c34925839f380c671f427d, user_id=a2e68adf6ee04464b3661cf138cc58cd, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:19:15.047500 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: WARNING py.warnings [None req-5c221885-11aa-4d1f-9a8d-674c5abf3461 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 08:19:15.047500 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: warnings.warn(msg) Jun 04 08:19:15.047500 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: Jun 04 08:19:15.049409 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c221885-11aa-4d1f-9a8d-674c5abf3461 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:19:15.062294 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 754/1501] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:19:15 2022] PUT /identity/v3/projects/8634e385f9c34925839f380c671f427d/users/a2e68adf6ee04464b3661cf138cc58cd/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:19:15.075258 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec32c0-7ece-4a44-bda3-c6ad2acfaa1c None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:19:15.075553 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec32c0-7ece-4a44-bda3-c6ad2acfaa1c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:19:15.075835 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec32c0-7ece-4a44-bda3-c6ad2acfaa1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:19:15.101724 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-21ec32c0-7ece-4a44-bda3-c6ad2acfaa1c None None] MFA Rules not processed for user `a2e68adf6ee04464b3661cf138cc58cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:19:15.102967 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-21ec32c0-7ece-4a44-bda3-c6ad2acfaa1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:19:15.169420 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 748/1502] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:19:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:19:15.183578 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5810df-945d-473e-bb93-9e6fc9d2b700 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:19:15.183860 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5810df-945d-473e-bb93-9e6fc9d2b700 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:19:15.184134 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5810df-945d-473e-bb93-9e6fc9d2b700 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:19:15.185548 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 755/1503] 10.222.0.57 () {54 vars in 963 bytes} [Sat Jun 4 08:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:19:15.190554 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64139fb3-a637-493c-9876-b5c1f26ce950 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:19:15.190850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64139fb3-a637-493c-9876-b5c1f26ce950 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:19:15.191133 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64139fb3-a637-493c-9876-b5c1f26ce950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:19:15.209325 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-64139fb3-a637-493c-9876-b5c1f26ce950 None None] MFA Rules not processed for user `3ab0603fbcd54121b543fbf2a44fecf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:19:15.210525 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-64139fb3-a637-493c-9876-b5c1f26ce950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:19:15.255376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:19:15.264164 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 749/1504] 10.222.0.57 () {58 vars in 1060 bytes} [Sat Jun 4 08:19:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:19:15.271520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5810df-945d-473e-bb93-9e6fc9d2b700 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:19:15.281740 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5810df-945d-473e-bb93-9e6fc9d2b700 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:19:15.285185 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec6f73-bdfe-40b8-bbd7-456a0ac7153a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:19:15.286356 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec6f73-bdfe-40b8-bbd7-456a0ac7153a service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:19:15.286636 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec6f73-bdfe-40b8-bbd7-456a0ac7153a service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:19:15.286906 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec6f73-bdfe-40b8-bbd7-456a0ac7153a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:19:15.294944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec6f73-bdfe-40b8-bbd7-456a0ac7153a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:19:15.296381 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec6f73-bdfe-40b8-bbd7-456a0ac7153a service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:19:15.305908 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 756/1505] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:19:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:19:15.347521 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7c551-8ca3-43f4-a92d-82a09e8b38b5 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:19:15.347811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7c551-8ca3-43f4-a92d-82a09e8b38b5 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:19:15.348089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7c551-8ca3-43f4-a92d-82a09e8b38b5 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:19:15.349929 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 750/1506] 10.222.0.57 () {52 vars in 829 bytes} [Sat Jun 4 08:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:19:15.353421 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec6f73-bdfe-40b8-bbd7-456a0ac7153a service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:19:15.413694 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec6f73-bdfe-40b8-bbd7-456a0ac7153a service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:19:15.418198 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758895a0-7b17-4f97-8546-b4db0b513a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:19:15.419074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758895a0-7b17-4f97-8546-b4db0b513a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:19:15.419386 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758895a0-7b17-4f97-8546-b4db0b513a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:19:15.419662 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758895a0-7b17-4f97-8546-b4db0b513a28 admin admin] PATH_INFO: `/v3/users/a2e68adf6ee04464b3661cf138cc58cd` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:19:15.420835 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758895a0-7b17-4f97-8546-b4db0b513a28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2e68adf6ee04464b3661cf138cc58cd)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:19:15.421869 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: WARNING py.warnings [None req-758895a0-7b17-4f97-8546-b4db0b513a28 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 08:19:15.421869 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: warnings.warn(msg) Jun 04 08:19:15.421869 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: Jun 04 08:19:15.423075 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758895a0-7b17-4f97-8546-b4db0b513a28 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:19:15.485910 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-758895a0-7b17-4f97-8546-b4db0b513a28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2e68adf6ee04464b3661cf138cc58cd'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:19:15.497668 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-758895a0-7b17-4f97-8546-b4db0b513a28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2e68adf6ee04464b3661cf138cc58cd'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:19:15.498440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-758895a0-7b17-4f97-8546-b4db0b513a28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2e68adf6ee04464b3661cf138cc58cd'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:19:15.499093 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-758895a0-7b17-4f97-8546-b4db0b513a28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2e68adf6ee04464b3661cf138cc58cd'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:19:15.517015 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-758895a0-7b17-4f97-8546-b4db0b513a28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2e68adf6ee04464b3661cf138cc58cd'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:19:15.521496 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:19:15.532954 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 757/1507] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:19:15 2022] DELETE /identity/v3/users/a2e68adf6ee04464b3661cf138cc58cd => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:19:15.537389 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a79efe-7544-4a7d-ba61-fb2852c124d2 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:19:15.537675 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a79efe-7544-4a7d-ba61-fb2852c124d2 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:19:15.538006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a79efe-7544-4a7d-ba61-fb2852c124d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:19:15.555651 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-35a79efe-7544-4a7d-ba61-fb2852c124d2 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:19:15.556870 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-35a79efe-7544-4a7d-ba61-fb2852c124d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:19:15.614615 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 751/1508] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:19:15.624462 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758895a0-7b17-4f97-8546-b4db0b513a28 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:19:15.625848 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-758895a0-7b17-4f97-8546-b4db0b513a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:19:15.680652 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758895a0-7b17-4f97-8546-b4db0b513a28 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:19:15.684227 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b153c2-8d00-477f-91b6-5ca372cbffe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:19:15.684863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b153c2-8d00-477f-91b6-5ca372cbffe4 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:19:15.685164 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b153c2-8d00-477f-91b6-5ca372cbffe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:19:15.685435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b153c2-8d00-477f-91b6-5ca372cbffe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:19:15.694839 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b153c2-8d00-477f-91b6-5ca372cbffe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:19:15.696260 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b153c2-8d00-477f-91b6-5ca372cbffe4 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:19:15.705398 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 758/1509] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:19:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:19:16.031814 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a79efe-7544-4a7d-ba61-fb2852c124d2 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:19:16.033376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-35a79efe-7544-4a7d-ba61-fb2852c124d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:19:16.045376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a79efe-7544-4a7d-ba61-fb2852c124d2 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:19:16.050209 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a05b16-c1fc-4b22-acda-be8e98da8920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:19:16.051017 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a05b16-c1fc-4b22-acda-be8e98da8920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:19:16.051341 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a05b16-c1fc-4b22-acda-be8e98da8920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:19:16.051619 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a05b16-c1fc-4b22-acda-be8e98da8920 admin admin] PATH_INFO: `/v3/projects/8634e385f9c34925839f380c671f427d` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:19:16.053102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a05b16-c1fc-4b22-acda-be8e98da8920 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8634e385f9c34925839f380c671f427d)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:19:16.054160 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: WARNING py.warnings [None req-a9a05b16-c1fc-4b22-acda-be8e98da8920 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 08:19:16.054160 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: warnings.warn(msg) Jun 04 08:19:16.054160 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: Jun 04 08:19:16.055361 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a05b16-c1fc-4b22-acda-be8e98da8920 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:19:16.115258 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a9a05b16-c1fc-4b22-acda-be8e98da8920 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8634e385f9c34925839f380c671f427d', 'request_id': 'req-a9a05b16-c1fc-4b22-acda-be8e98da8920'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:19:16.128343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a9a05b16-c1fc-4b22-acda-be8e98da8920 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8634e385f9c34925839f380c671f427d', 'request_id': 'req-a9a05b16-c1fc-4b22-acda-be8e98da8920'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:19:16.137442 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a9a05b16-c1fc-4b22-acda-be8e98da8920 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8634e385f9c34925839f380c671f427d', 'request_id': 'req-a9a05b16-c1fc-4b22-acda-be8e98da8920'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:19:16.148313 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a9a05b16-c1fc-4b22-acda-be8e98da8920 admin admin] The token cache is being invalidate because project 8634e385f9c34925839f380c671f427d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:19:16.148602 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a9a05b16-c1fc-4b22-acda-be8e98da8920 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:19:16.149324 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a9a05b16-c1fc-4b22-acda-be8e98da8920 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:19:16.150920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 752/1510] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:19:16 2022] DELETE /identity/v3/projects/8634e385f9c34925839f380c671f427d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:19:25.701376 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:19:26.145266 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:20:52.244651 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254ad52-0138-4bbd-bb55-93e50e71b09f None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:20:52.245251 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254ad52-0138-4bbd-bb55-93e50e71b09f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:20:52.245251 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254ad52-0138-4bbd-bb55-93e50e71b09f None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:20:52.246647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 08:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:20:52.251448 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c67536-303a-409c-8e04-661cd7f26443 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:20:52.251903 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c67536-303a-409c-8e04-661cd7f26443 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:20:52.252013 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c67536-303a-409c-8e04-661cd7f26443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:20:52.270583 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-27c67536-303a-409c-8e04-661cd7f26443 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:20:52.271810 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-27c67536-303a-409c-8e04-661cd7f26443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:20:52.330951 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 08:20:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:20:52.503317 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254ad52-0138-4bbd-bb55-93e50e71b09f None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:20:52.505034 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6254ad52-0138-4bbd-bb55-93e50e71b09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:20:52.577511 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254ad52-0138-4bbd-bb55-93e50e71b09f None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:20:52.582985 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d75705-c79a-494e-9f19-cbca83bb323c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:20:52.583621 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d75705-c79a-494e-9f19-cbca83bb323c service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:20:52.583904 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d75705-c79a-494e-9f19-cbca83bb323c service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:20:52.584179 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d75705-c79a-494e-9f19-cbca83bb323c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:20:52.592162 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d75705-c79a-494e-9f19-cbca83bb323c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:20:52.593729 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d75705-c79a-494e-9f19-cbca83bb323c service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:20:52.603578 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 760/1513] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:20:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:20:53.488247 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8caf8fc-5c3f-4979-ab3b-e844b81c4bf4 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:20:53.488783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8caf8fc-5c3f-4979-ab3b-e844b81c4bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:20:53.488783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8caf8fc-5c3f-4979-ab3b-e844b81c4bf4 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:20:53.490159 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 08:20:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:20:53.495132 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242ec04-465e-4456-90e9-4719c96dce58 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:20:53.495579 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242ec04-465e-4456-90e9-4719c96dce58 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:20:53.495693 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242ec04-465e-4456-90e9-4719c96dce58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:20:53.514192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-8242ec04-465e-4456-90e9-4719c96dce58 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:20:53.515362 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8242ec04-465e-4456-90e9-4719c96dce58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:20:53.524499 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 08:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:20:53.572253 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cff0b-a6b7-41aa-a4c0-7982a6f740cc None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:20:53.572616 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cff0b-a6b7-41aa-a4c0-7982a6f740cc None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:20:53.572901 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cff0b-a6b7-41aa-a4c0-7982a6f740cc None None] PATH_INFO: `/v3` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:20:53.574245 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 755/1516] 10.222.0.77 () {54 vars in 925 bytes} [Sat Jun 4 08:20:53 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:20:53.580084 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0796b84-15fe-4eee-835e-b731a4a0de82 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:20:53.580400 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0796b84-15fe-4eee-835e-b731a4a0de82 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:20:53.580673 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0796b84-15fe-4eee-835e-b731a4a0de82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:20:53.600807 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f0796b84-15fe-4eee-835e-b731a4a0de82 None None] MFA Rules not processed for user `6fb6720f0d0141fea795cecfbf6f2538`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:20:53.602044 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f0796b84-15fe-4eee-835e-b731a4a0de82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:20:53.663603 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 762/1517] 10.222.0.77 () {58 vars in 1015 bytes} [Sat Jun 4 08:20:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:20:53.674675 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1cff0b-a6b7-41aa-a4c0-7982a6f740cc None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:20:53.689596 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1cff0b-a6b7-41aa-a4c0-7982a6f740cc None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:20:53.695659 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510fadc-0819-402e-a744-dbdeba571d2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:20:53.696288 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510fadc-0819-402e-a744-dbdeba571d2f service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:20:53.696572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510fadc-0819-402e-a744-dbdeba571d2f service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:20:53.696851 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510fadc-0819-402e-a744-dbdeba571d2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:20:53.704927 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510fadc-0819-402e-a744-dbdeba571d2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:20:53.706584 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510fadc-0819-402e-a744-dbdeba571d2f service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:20:53.715891 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 756/1518] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:20:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:20:57.526469 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242eb20-0d6b-4720-9b24-c45b99d15aaf None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:20:57.527049 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242eb20-0d6b-4720-9b24-c45b99d15aaf None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:20:57.527049 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242eb20-0d6b-4720-9b24-c45b99d15aaf None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:20:57.528394 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 763/1519] 10.222.0.57 () {54 vars in 960 bytes} [Sat Jun 4 08:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:20:57.533945 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d975ead-dfa7-4f0b-9d1e-7e084864eef0 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:20:57.534473 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d975ead-dfa7-4f0b-9d1e-7e084864eef0 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:20:57.535103 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d975ead-dfa7-4f0b-9d1e-7e084864eef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:20:57.554971 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-9d975ead-dfa7-4f0b-9d1e-7e084864eef0 None None] MFA Rules not processed for user `6fb6720f0d0141fea795cecfbf6f2538`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:20:57.556190 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-9d975ead-dfa7-4f0b-9d1e-7e084864eef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:20:57.564959 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 757/1520] 10.222.0.57 () {58 vars in 1057 bytes} [Sat Jun 4 08:20:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:20:57.572974 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242eb20-0d6b-4720-9b24-c45b99d15aaf None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:20:57.587668 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242eb20-0d6b-4720-9b24-c45b99d15aaf None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:20:57.592711 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a58dff-6ab5-44a1-a61c-d6c000df8379 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fb6720f0d0141fea795cecfbf6f2538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:20:57.593531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a58dff-6ab5-44a1-a61c-d6c000df8379 service placement] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:20:57.593849 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a58dff-6ab5-44a1-a61c-d6c000df8379 service placement] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:20:57.594136 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a58dff-6ab5-44a1-a61c-d6c000df8379 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:20:57.603606 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a58dff-6ab5-44a1-a61c-d6c000df8379 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:20:57.605211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a58dff-6ab5-44a1-a61c-d6c000df8379 service placement] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:20:57.615694 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 764/1521] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:20:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:21:04.982484 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de2ae9-1450-4c7a-921e-5734137cf74b None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:21:04.983058 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de2ae9-1450-4c7a-921e-5734137cf74b None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:21:04.983058 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de2ae9-1450-4c7a-921e-5734137cf74b None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:21:04.984449 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 08:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:21:04.989608 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a2362-0786-48fe-af2c-55cbd95ab38d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:21:04.990114 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a2362-0786-48fe-af2c-55cbd95ab38d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:21:04.990225 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a2362-0786-48fe-af2c-55cbd95ab38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:21:05.008785 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-616a2362-0786-48fe-af2c-55cbd95ab38d None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:21:05.010011 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-616a2362-0786-48fe-af2c-55cbd95ab38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:21:05.017972 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 08:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:21:05.170094 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de2ae9-1450-4c7a-921e-5734137cf74b None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:21:05.185073 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de2ae9-1450-4c7a-921e-5734137cf74b None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:21:05.190492 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0aa8b-aa00-42c8-bac7-423216ad9713 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:21:05.191121 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0aa8b-aa00-42c8-bac7-423216ad9713 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:21:05.191402 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0aa8b-aa00-42c8-bac7-423216ad9713 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:21:05.191675 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0aa8b-aa00-42c8-bac7-423216ad9713 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:21:05.199785 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0aa8b-aa00-42c8-bac7-423216ad9713 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:21:05.201379 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0aa8b-aa00-42c8-bac7-423216ad9713 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:21:05.210714 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 759/1524] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:21:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:21:06.071382 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddfd93-8c6e-4309-835b-fa48a87fc43d None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:21:06.071937 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddfd93-8c6e-4309-835b-fa48a87fc43d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:21:06.071937 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddfd93-8c6e-4309-835b-fa48a87fc43d None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:21:06.073349 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 08:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:21:06.078222 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fada03-3e8d-479a-8aae-373d1a89ff22 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:21:06.078618 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fada03-3e8d-479a-8aae-373d1a89ff22 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:21:06.078776 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fada03-3e8d-479a-8aae-373d1a89ff22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:21:06.097201 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-77fada03-3e8d-479a-8aae-373d1a89ff22 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:21:06.098435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-77fada03-3e8d-479a-8aae-373d1a89ff22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:21:06.107385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 08:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:21:06.256995 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddfd93-8c6e-4309-835b-fa48a87fc43d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:21:06.271243 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddfd93-8c6e-4309-835b-fa48a87fc43d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:21:06.276622 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4808747-5dbc-4516-8f07-8723456b1fe0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:21:06.277254 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4808747-5dbc-4516-8f07-8723456b1fe0 service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:21:06.277542 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4808747-5dbc-4516-8f07-8723456b1fe0 service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:21:06.277814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4808747-5dbc-4516-8f07-8723456b1fe0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:21:06.285838 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4808747-5dbc-4516-8f07-8723456b1fe0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:21:06.287427 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4808747-5dbc-4516-8f07-8723456b1fe0 service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:21:06.296732 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 767/1527] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:21:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:21:10.583889 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c06f5-bd56-4f17-8fa4-50748e3372b8 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:21:10.584481 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c06f5-bd56-4f17-8fa4-50748e3372b8 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:21:10.584481 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c06f5-bd56-4f17-8fa4-50748e3372b8 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:21:10.585814 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 08:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:21:10.591076 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0a327-60b7-4f89-90f8-d27fdfb855f1 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:21:10.591486 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0a327-60b7-4f89-90f8-d27fdfb855f1 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:21:10.591633 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0a327-60b7-4f89-90f8-d27fdfb855f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:21:10.609252 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-9ac0a327-60b7-4f89-90f8-d27fdfb855f1 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:21:10.610463 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9ac0a327-60b7-4f89-90f8-d27fdfb855f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:21:10.618103 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 08:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:21:10.654234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c06f5-bd56-4f17-8fa4-50748e3372b8 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:21:10.656015 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-fa6c06f5-bd56-4f17-8fa4-50748e3372b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:21:10.713547 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c06f5-bd56-4f17-8fa4-50748e3372b8 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:21:10.717149 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274e3f9-98fb-4cd3-8953-83894d09c8bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:21:10.717791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274e3f9-98fb-4cd3-8953-83894d09c8bd service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:21:10.718108 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274e3f9-98fb-4cd3-8953-83894d09c8bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:21:10.718384 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274e3f9-98fb-4cd3-8953-83894d09c8bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:21:10.727183 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274e3f9-98fb-4cd3-8953-83894d09c8bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:21:10.728605 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274e3f9-98fb-4cd3-8953-83894d09c8bd service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:21:10.738445 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 762/1530] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:21:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:21:12.954597 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f251b4c-ee02-411c-827c-37652f30681a None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:21:12.955121 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f251b4c-ee02-411c-827c-37652f30681a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:21:12.955236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f251b4c-ee02-411c-827c-37652f30681a None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:21:12.957059 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 08:21:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 08:21:12.962419 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c123d-64a5-4c32-aa0b-27921c5bb45f None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:21:12.962825 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c123d-64a5-4c32-aa0b-27921c5bb45f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:21:12.963048 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c123d-64a5-4c32-aa0b-27921c5bb45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:21:12.983182 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-956c123d-64a5-4c32-aa0b-27921c5bb45f None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:21:12.984353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-956c123d-64a5-4c32-aa0b-27921c5bb45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:21:12.992060 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 08:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:21:13.027139 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f251b4c-ee02-411c-827c-37652f30681a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:21:13.038353 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f251b4c-ee02-411c-827c-37652f30681a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:21:13.043022 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f60e3-5275-4c7f-8971-acb16a0f7815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:21:13.043676 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f60e3-5275-4c7f-8971-acb16a0f7815 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:21:13.043978 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f60e3-5275-4c7f-8971-acb16a0f7815 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:21:13.044247 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f60e3-5275-4c7f-8971-acb16a0f7815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:21:13.054522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f60e3-5275-4c7f-8971-acb16a0f7815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:21:13.056053 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f60e3-5275-4c7f-8971-acb16a0f7815 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:21:13.067192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 770/1533] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:21:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:21:16.829662 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89391a6f-f958-444f-82a3-d7aa4f9f0a76 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:21:16.830265 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89391a6f-f958-444f-82a3-d7aa4f9f0a76 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:21:16.830265 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89391a6f-f958-444f-82a3-d7aa4f9f0a76 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:21:16.832163 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 08:21:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:21:16.837285 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12290740-5920-432e-b2a8-d11208d274b4 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:21:16.837691 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12290740-5920-432e-b2a8-d11208d274b4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:21:16.837843 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12290740-5920-432e-b2a8-d11208d274b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:21:16.844036 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=91 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:21:16.857020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-12290740-5920-432e-b2a8-d11208d274b4 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:21:16.858228 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-12290740-5920-432e-b2a8-d11208d274b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:21:16.865861 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 08:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:21:17.134533 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89391a6f-f958-444f-82a3-d7aa4f9f0a76 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:21:17.136316 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-89391a6f-f958-444f-82a3-d7aa4f9f0a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:21:17.142189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=75 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:21:17.194743 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89391a6f-f958-444f-82a3-d7aa4f9f0a76 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:21:17.198320 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19a853-7bf8-4dae-b203-176e35ffc0b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:21:17.198968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19a853-7bf8-4dae-b203-176e35ffc0b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:21:17.199250 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19a853-7bf8-4dae-b203-176e35ffc0b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:21:17.199525 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19a853-7bf8-4dae-b203-176e35ffc0b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:21:17.208978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19a853-7bf8-4dae-b203-176e35ffc0b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:21:17.210452 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19a853-7bf8-4dae-b203-176e35ffc0b3 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:21:17.219782 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 765/1536] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:21:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:21:19.490137 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0669c4-a9e3-4d46-ad8d-04b52fb3060f None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:21:19.490703 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0669c4-a9e3-4d46-ad8d-04b52fb3060f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:21:19.490703 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0669c4-a9e3-4d46-ad8d-04b52fb3060f None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:21:19.492065 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 08:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:21:19.497223 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc1783-a7b4-4ba0-8f7a-e73b76c80b5d None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:21:19.497630 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc1783-a7b4-4ba0-8f7a-e73b76c80b5d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:21:19.497783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc1783-a7b4-4ba0-8f7a-e73b76c80b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:21:19.515663 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-f0fc1783-a7b4-4ba0-8f7a-e73b76c80b5d None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:21:19.516859 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f0fc1783-a7b4-4ba0-8f7a-e73b76c80b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:21:19.524736 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 08:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:21:19.795370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0669c4-a9e3-4d46-ad8d-04b52fb3060f None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:21:19.797019 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ac0669c4-a9e3-4d46-ad8d-04b52fb3060f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:21:19.811581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0669c4-a9e3-4d46-ad8d-04b52fb3060f None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:21:19.815821 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b838e-3813-44fc-8de9-82c3dd345b36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:21:19.816462 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b838e-3813-44fc-8de9-82c3dd345b36 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:21:19.816737 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b838e-3813-44fc-8de9-82c3dd345b36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:21:19.817012 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b838e-3813-44fc-8de9-82c3dd345b36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:21:19.826304 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b838e-3813-44fc-8de9-82c3dd345b36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:21:19.828354 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b838e-3813-44fc-8de9-82c3dd345b36 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:21:19.839357 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 773/1539] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:21:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:21:29.510533 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=28 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:21:29.835049 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=8 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:22:48.137126 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5bcf0-fbe8-4f0f-afcf-865a8b1d0146 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:48.137720 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5bcf0-fbe8-4f0f-afcf-865a8b1d0146 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:48.137720 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5bcf0-fbe8-4f0f-afcf-865a8b1d0146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:48.165694 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-48e5bcf0-fbe8-4f0f-afcf-865a8b1d0146 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:48.166930 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-48e5bcf0-fbe8-4f0f-afcf-865a8b1d0146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:48.178559 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 767/1540] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:48.187535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a29ce9-3bc8-4762-b1c0-79512fbe9f94 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:48.188646 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a29ce9-3bc8-4762-b1c0-79512fbe9f94 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:48.188752 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a29ce9-3bc8-4762-b1c0-79512fbe9f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:48.218882 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e5a29ce9-3bc8-4762-b1c0-79512fbe9f94 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:48.220200 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e5a29ce9-3bc8-4762-b1c0-79512fbe9f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:48.230870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 774/1541] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:48.235869 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5bcf0-fbe8-4f0f-afcf-865a8b1d0146 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:48.246225 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5bcf0-fbe8-4f0f-afcf-865a8b1d0146 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:48.255434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbbb1a-a0c5-43aa-83bd-9a4b2a7d0473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:48.256100 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbbb1a-a0c5-43aa-83bd-9a4b2a7d0473 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:48.256383 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbbb1a-a0c5-43aa-83bd-9a4b2a7d0473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:48.256659 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbbb1a-a0c5-43aa-83bd-9a4b2a7d0473 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:48.257383 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bbbb1a-a0c5-43aa-83bd-9a4b2a7d0473 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:22:48.257689 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bbbb1a-a0c5-43aa-83bd-9a4b2a7d0473 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:48.259638 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bbbb1a-a0c5-43aa-83bd-9a4b2a7d0473 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:48.276786 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 768/1542] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:22:48.285130 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a29ce9-3bc8-4762-b1c0-79512fbe9f94 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:48.298084 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a29ce9-3bc8-4762-b1c0-79512fbe9f94 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:48.307119 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186c601-5ceb-4a2d-ac71-30907f8bd3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:48.307781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186c601-5ceb-4a2d-ac71-30907f8bd3f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:48.308060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186c601-5ceb-4a2d-ac71-30907f8bd3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:48.308328 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186c601-5ceb-4a2d-ac71-30907f8bd3f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:48.309012 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186c601-5ceb-4a2d-ac71-30907f8bd3f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:48.311054 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186c601-5ceb-4a2d-ac71-30907f8bd3f8 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:48.354962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 775/1543] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:22:48 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:22:48.358766 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbbb1a-a0c5-43aa-83bd-9a4b2a7d0473 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:48.372399 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbbb1a-a0c5-43aa-83bd-9a4b2a7d0473 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:48.443313 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651436f-81c7-4a41-bf49-061c1f5c68cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:48.443918 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651436f-81c7-4a41-bf49-061c1f5c68cb admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:48.444203 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651436f-81c7-4a41-bf49-061c1f5c68cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:48.444482 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651436f-81c7-4a41-bf49-061c1f5c68cb admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:48.445188 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651436f-81c7-4a41-bf49-061c1f5c68cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:48.447450 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651436f-81c7-4a41-bf49-061c1f5c68cb admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:48.487850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 769/1544] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:22:48 2022] POST /identity/v3/users => generated 287 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:22:48.491922 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186c601-5ceb-4a2d-ac71-30907f8bd3f8 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:48.511849 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186c601-5ceb-4a2d-ac71-30907f8bd3f8 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:48.522677 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb3fe3-905f-4324-9ea1-aa6c2a7599cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:48.523808 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb3fe3-905f-4324-9ea1-aa6c2a7599cd admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:48.524315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb3fe3-905f-4324-9ea1-aa6c2a7599cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:48.524820 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb3fe3-905f-4324-9ea1-aa6c2a7599cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:48.525801 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb3fe3-905f-4324-9ea1-aa6c2a7599cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:48.527728 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb3fe3-905f-4324-9ea1-aa6c2a7599cd admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:48.543971 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 776/1545] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:22:48.548379 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651436f-81c7-4a41-bf49-061c1f5c68cb admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:48.564125 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651436f-81c7-4a41-bf49-061c1f5c68cb admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:48.569067 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131f58b-14c1-41e6-a142-8828bd65e59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:48.569751 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131f58b-14c1-41e6-a142-8828bd65e59d admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:48.570071 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131f58b-14c1-41e6-a142-8828bd65e59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:48.570350 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131f58b-14c1-41e6-a142-8828bd65e59d admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:48.571086 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131f58b-14c1-41e6-a142-8828bd65e59d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:48.572711 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131f58b-14c1-41e6-a142-8828bd65e59d admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:48.589245 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 770/1546] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:22:48.593478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb3fe3-905f-4324-9ea1-aa6c2a7599cd admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:48.611569 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb3fe3-905f-4324-9ea1-aa6c2a7599cd admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:48.622366 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f8b60-f963-4234-a257-8caba972c38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:48.623657 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f8b60-f963-4234-a257-8caba972c38a admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:48.624165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f8b60-f963-4234-a257-8caba972c38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:48.624657 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f8b60-f963-4234-a257-8caba972c38a admin admin] PATH_INFO: `/v3/projects/728e5065908f47189cb9300d280b1c8f/users/13801179e3b145f1af900ab9c3d0317b/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:48.643225 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f8b60-f963-4234-a257-8caba972c38a admin admin] RBAC: Authorizing `identity:create_grant(project_id=728e5065908f47189cb9300d280b1c8f, user_id=13801179e3b145f1af900ab9c3d0317b, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:48.646294 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f8b60-f963-4234-a257-8caba972c38a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:48.680179 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 777/1547] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:22:48 2022] PUT /identity/v3/projects/728e5065908f47189cb9300d280b1c8f/users/13801179e3b145f1af900ab9c3d0317b/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:22:48.699485 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962db198-a594-4f6a-b5ec-01bbc21f3a03 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:48.699696 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962db198-a594-4f6a-b5ec-01bbc21f3a03 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:48.699958 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962db198-a594-4f6a-b5ec-01bbc21f3a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:48.741692 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-962db198-a594-4f6a-b5ec-01bbc21f3a03 None None] MFA Rules not processed for user `13801179e3b145f1af900ab9c3d0317b`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:48.742972 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-962db198-a594-4f6a-b5ec-01bbc21f3a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:48.841616 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 771/1548] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:48.876856 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f32b2-0e11-44b5-b6f1-686a990691ad None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:48.883147 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f32b2-0e11-44b5-b6f1-686a990691ad None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:48.883871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f32b2-0e11-44b5-b6f1-686a990691ad None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:48.885989 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 778/1549] 10.222.0.57 () {54 vars in 961 bytes} [Sat Jun 4 08:22:48 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:22:48.894633 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f292add-6f6f-4b58-acc8-645e5fcaf900 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:48.894982 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f292add-6f6f-4b58-acc8-645e5fcaf900 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:48.895210 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f292add-6f6f-4b58-acc8-645e5fcaf900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:48.927699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541e8b9-fa58-44cc-af1d-d15eb90d61d2 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:48.927996 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541e8b9-fa58-44cc-af1d-d15eb90d61d2 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:48.928268 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541e8b9-fa58-44cc-af1d-d15eb90d61d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:48.939545 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-6f292add-6f6f-4b58-acc8-645e5fcaf900 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:48.941435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-6f292add-6f6f-4b58-acc8-645e5fcaf900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:48.963319 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-2541e8b9-fa58-44cc-af1d-d15eb90d61d2 None None] MFA Rules not processed for user `7e64d002241242928936dd0d991ecdc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:48.964478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2541e8b9-fa58-44cc-af1d-d15eb90d61d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:49.040615 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:22:49.074677 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 772/1550] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:49.084849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1df46-8ec9-4213-8e55-19cec380a8e1 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:49.085199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1df46-8ec9-4213-8e55-19cec380a8e1 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:49.085412 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1df46-8ec9-4213-8e55-19cec380a8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:49.090689 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 779/1551] 10.222.0.57 () {58 vars in 1058 bytes} [Sat Jun 4 08:22:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:49.091698 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541e8b9-fa58-44cc-af1d-d15eb90d61d2 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:49.112049 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541e8b9-fa58-44cc-af1d-d15eb90d61d2 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:49.125146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-3ea1df46-8ec9-4213-8e55-19cec380a8e1 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:49.125595 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bfd21-785a-43f9-8206-aa1267bf1955 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:49.126298 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bfd21-785a-43f9-8206-aa1267bf1955 service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:49.126434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-3ea1df46-8ec9-4213-8e55-19cec380a8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:49.126651 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bfd21-785a-43f9-8206-aa1267bf1955 service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:49.126854 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bfd21-785a-43f9-8206-aa1267bf1955 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:49.140872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 773/1552] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:22:49.146467 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1df46-8ec9-4213-8e55-19cec380a8e1 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:49.148241 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01bfd21-785a-43f9-8206-aa1267bf1955 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:49.149873 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01bfd21-785a-43f9-8206-aa1267bf1955 service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:49.165955 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1df46-8ec9-4213-8e55-19cec380a8e1 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:49.166536 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 780/1553] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:22:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:22:49.178710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406954e-b7e0-41c6-99eb-7ac1b4b49829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:49.179397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406954e-b7e0-41c6-99eb-7ac1b4b49829 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:49.179681 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406954e-b7e0-41c6-99eb-7ac1b4b49829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:49.179959 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406954e-b7e0-41c6-99eb-7ac1b4b49829 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:49.180694 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406954e-b7e0-41c6-99eb-7ac1b4b49829 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:22:49.181005 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406954e-b7e0-41c6-99eb-7ac1b4b49829 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:49.182886 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406954e-b7e0-41c6-99eb-7ac1b4b49829 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:49.208260 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 774/1554] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:22:49.216272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bfd21-785a-43f9-8206-aa1267bf1955 service nova] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:49.235690 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3096b91-4152-48ab-9f62-de9a9a70713d None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:49.236035 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3096b91-4152-48ab-9f62-de9a9a70713d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:49.236255 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3096b91-4152-48ab-9f62-de9a9a70713d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:49.238752 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bfd21-785a-43f9-8206-aa1267bf1955 service nova] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:49.251098 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a15f1c-5e14-42b6-88bf-0fa36fa93c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:49.252451 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a15f1c-5e14-42b6-88bf-0fa36fa93c50 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:49.252451 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a15f1c-5e14-42b6-88bf-0fa36fa93c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:49.252451 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a15f1c-5e14-42b6-88bf-0fa36fa93c50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:49.253010 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a15f1c-5e14-42b6-88bf-0fa36fa93c50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:49.255017 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a15f1c-5e14-42b6-88bf-0fa36fa93c50 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:49.270561 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-e3096b91-4152-48ab-9f62-de9a9a70713d None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:49.271782 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e3096b91-4152-48ab-9f62-de9a9a70713d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:49.288749 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 775/1555] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:49.298338 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770c5b9-a75b-4d51-b2d4-e5aa4197f514 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:49.298338 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770c5b9-a75b-4d51-b2d4-e5aa4197f514 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:49.298604 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770c5b9-a75b-4d51-b2d4-e5aa4197f514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:49.329327 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 781/1556] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:22:49 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:22:49.332593 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-8770c5b9-a75b-4d51-b2d4-e5aa4197f514 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:49.333814 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8770c5b9-a75b-4d51-b2d4-e5aa4197f514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:49.340103 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a15f1c-5e14-42b6-88bf-0fa36fa93c50 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:49.440535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:22:49.456260 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a15f1c-5e14-42b6-88bf-0fa36fa93c50 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:49.461017 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 776/1557] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:22:49.461935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab7bcc-da77-463f-a0b5-ce20726ab119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:49.462666 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8f6b9-878a-477e-8862-99c70324dad4 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:49.462954 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8f6b9-878a-477e-8862-99c70324dad4 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:49.463232 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8f6b9-878a-477e-8862-99c70324dad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:49.464040 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab7bcc-da77-463f-a0b5-ce20726ab119 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:49.464560 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab7bcc-da77-463f-a0b5-ce20726ab119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:49.464850 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab7bcc-da77-463f-a0b5-ce20726ab119 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:49.465550 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab7bcc-da77-463f-a0b5-ce20726ab119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:49.466658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: WARNING py.warnings [None req-1eab7bcc-da77-463f-a0b5-ce20726ab119 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 08:22:49.466658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: warnings.warn(msg) Jun 04 08:22:49.466658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: Jun 04 08:22:49.467831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab7bcc-da77-463f-a0b5-ce20726ab119 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:49.482983 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-4ca8f6b9-878a-477e-8862-99c70324dad4 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:49.484404 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4ca8f6b9-878a-477e-8862-99c70324dad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:49.491335 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 782/1558] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:22:49 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:22:49.492775 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73407b-7dbc-439a-b5a0-961978051f65 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:49.493071 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73407b-7dbc-439a-b5a0-961978051f65 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:49.493354 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73407b-7dbc-439a-b5a0-961978051f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:49.496186 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 777/1559] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:49.497340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a9da5-7c74-44c0-a573-6e36e797d619 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:49.497628 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a9da5-7c74-44c0-a573-6e36e797d619 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:49.497961 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a9da5-7c74-44c0-a573-6e36e797d619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:49.515749 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-868a9da5-7c74-44c0-a573-6e36e797d619 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:49.516270 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-ad73407b-7dbc-439a-b5a0-961978051f65 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:49.516997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-868a9da5-7c74-44c0-a573-6e36e797d619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:49.517580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ad73407b-7dbc-439a-b5a0-961978051f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:49.532285 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 783/1560] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:49.532285 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a9da1-3a4e-4962-b199-f54d0c6713ab None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:49.532285 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a9da1-3a4e-4962-b199-f54d0c6713ab None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:49.532285 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a9da1-3a4e-4962-b199-f54d0c6713ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:49.532792 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 778/1561] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:49.532792 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc835e12-0a1a-4f4f-9912-61c555204c43 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:49.532792 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc835e12-0a1a-4f4f-9912-61c555204c43 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:49.532792 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc835e12-0a1a-4f4f-9912-61c555204c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:49.552077 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-2b1a9da1-3a4e-4962-b199-f54d0c6713ab None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:49.554468 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-dc835e12-0a1a-4f4f-9912-61c555204c43 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:49.556104 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2b1a9da1-3a4e-4962-b199-f54d0c6713ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:49.558319 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-dc835e12-0a1a-4f4f-9912-61c555204c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:49.574268 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 779/1562] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:49.574268 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc835e12-0a1a-4f4f-9912-61c555204c43 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:49.574628 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 784/1563] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:49.574628 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a9da1-3a4e-4962-b199-f54d0c6713ab None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:49.584386 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc835e12-0a1a-4f4f-9912-61c555204c43 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:49.584529 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a9da1-3a4e-4962-b199-f54d0c6713ab None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:49.588999 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66e85b-ff96-40e4-9848-08953ec40195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:49.589148 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e972b13-094c-4c10-b7fb-76bab4b4fef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:49.589663 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66e85b-ff96-40e4-9848-08953ec40195 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:49.589769 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e972b13-094c-4c10-b7fb-76bab4b4fef3 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:49.589988 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66e85b-ff96-40e4-9848-08953ec40195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:49.590109 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e972b13-094c-4c10-b7fb-76bab4b4fef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:49.590294 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66e85b-ff96-40e4-9848-08953ec40195 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:49.590388 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e972b13-094c-4c10-b7fb-76bab4b4fef3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:49.590976 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66e85b-ff96-40e4-9848-08953ec40195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:49.591091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e972b13-094c-4c10-b7fb-76bab4b4fef3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:22:49.591360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e972b13-094c-4c10-b7fb-76bab4b4fef3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:49.592575 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66e85b-ff96-40e4-9848-08953ec40195 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:49.592944 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e972b13-094c-4c10-b7fb-76bab4b4fef3 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:49.604016 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 785/1564] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:22:49.605723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 780/1565] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:22:49.608117 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43bc90-5390-4243-93b1-e03eb884f7f6 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:49.608416 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43bc90-5390-4243-93b1-e03eb884f7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:49.608822 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43bc90-5390-4243-93b1-e03eb884f7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:49.614254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74d3ce-9e03-4262-96eb-bb452e6a1ea4 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:49.614545 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74d3ce-9e03-4262-96eb-bb452e6a1ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:49.614833 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74d3ce-9e03-4262-96eb-bb452e6a1ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:49.627973 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-5e43bc90-5390-4243-93b1-e03eb884f7f6 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:49.629194 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-5e43bc90-5390-4243-93b1-e03eb884f7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:49.632905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-cc74d3ce-9e03-4262-96eb-bb452e6a1ea4 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:49.634099 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-cc74d3ce-9e03-4262-96eb-bb452e6a1ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:49.637624 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 786/1566] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:49.638934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cf401-0c06-4099-b535-b9eb91a219df None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:49.639222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cf401-0c06-4099-b535-b9eb91a219df None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:49.639498 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cf401-0c06-4099-b535-b9eb91a219df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:49.646813 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 781/1567] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:49.648384 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63072a08-ad5f-4950-9aec-aa2ec81e2ab6 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:49.648901 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63072a08-ad5f-4950-9aec-aa2ec81e2ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:49.649497 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63072a08-ad5f-4950-9aec-aa2ec81e2ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:49.662079 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-149cf401-0c06-4099-b535-b9eb91a219df None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:49.663276 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-149cf401-0c06-4099-b535-b9eb91a219df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:49.671280 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 787/1568] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:49.671904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-63072a08-ad5f-4950-9aec-aa2ec81e2ab6 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:49.672518 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7511c7-042a-49b0-9fe5-5ae6077facd6 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:49.672805 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7511c7-042a-49b0-9fe5-5ae6077facd6 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:49.673083 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7511c7-042a-49b0-9fe5-5ae6077facd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:49.674556 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-63072a08-ad5f-4950-9aec-aa2ec81e2ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:49.687944 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 782/1569] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:49.687944 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63072a08-ad5f-4950-9aec-aa2ec81e2ab6 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:49.694867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-fb7511c7-042a-49b0-9fe5-5ae6077facd6 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:49.695788 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63072a08-ad5f-4950-9aec-aa2ec81e2ab6 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:49.696088 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-fb7511c7-042a-49b0-9fe5-5ae6077facd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:49.700476 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198b86a-fc59-4ae4-a8fd-73ac0ba4acbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:49.701119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198b86a-fc59-4ae4-a8fd-73ac0ba4acbf admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:49.701405 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198b86a-fc59-4ae4-a8fd-73ac0ba4acbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:49.701678 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198b86a-fc59-4ae4-a8fd-73ac0ba4acbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:49.702418 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8198b86a-fc59-4ae4-a8fd-73ac0ba4acbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:49.704551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8198b86a-fc59-4ae4-a8fd-73ac0ba4acbf admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:49.705012 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 788/1570] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:49.705710 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7511c7-042a-49b0-9fe5-5ae6077facd6 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:49.715789 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7511c7-042a-49b0-9fe5-5ae6077facd6 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:49.718525 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 783/1571] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:22:49.719811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198b86a-fc59-4ae4-a8fd-73ac0ba4acbf admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:49.724386 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f274847-feb5-4a8e-942f-e03c7a8b19e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:49.725034 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f274847-feb5-4a8e-942f-e03c7a8b19e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:49.725322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f274847-feb5-4a8e-942f-e03c7a8b19e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:49.725609 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f274847-feb5-4a8e-942f-e03c7a8b19e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:49.726322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f274847-feb5-4a8e-942f-e03c7a8b19e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:49.728286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f274847-feb5-4a8e-942f-e03c7a8b19e7 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:49.733438 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198b86a-fc59-4ae4-a8fd-73ac0ba4acbf admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:49.739383 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30c135-f06d-48cb-ba09-1edaf6912e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:49.740106 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30c135-f06d-48cb-ba09-1edaf6912e2e admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:49.740460 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30c135-f06d-48cb-ba09-1edaf6912e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:49.740801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30c135-f06d-48cb-ba09-1edaf6912e2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:49.741780 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30c135-f06d-48cb-ba09-1edaf6912e2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:22:49.742131 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30c135-f06d-48cb-ba09-1edaf6912e2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:49.743742 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30c135-f06d-48cb-ba09-1edaf6912e2e admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:49.764682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 784/1573] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:22:49.764682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30c135-f06d-48cb-ba09-1edaf6912e2e admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:49.764991 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 789/1572] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:22:49 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:22:49.764991 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f274847-feb5-4a8e-942f-e03c7a8b19e7 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:49.775406 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30c135-f06d-48cb-ba09-1edaf6912e2e admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:49.832158 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f274847-feb5-4a8e-942f-e03c7a8b19e7 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:49.836869 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4880364-27af-4da2-a1b5-08588c041f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:49.837546 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4880364-27af-4da2-a1b5-08588c041f8a admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:49.837863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4880364-27af-4da2-a1b5-08588c041f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:49.838197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4880364-27af-4da2-a1b5-08588c041f8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:49.839087 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4880364-27af-4da2-a1b5-08588c041f8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:22:49.839211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4880364-27af-4da2-a1b5-08588c041f8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:49.840216 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: WARNING py.warnings [None req-a4880364-27af-4da2-a1b5-08588c041f8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 08:22:49.840216 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: warnings.warn(msg) Jun 04 08:22:49.840216 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: Jun 04 08:22:49.841101 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4880364-27af-4da2-a1b5-08588c041f8a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:49.842924 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:22:49.855041 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 790/1574] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:22:49.862461 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4880364-27af-4da2-a1b5-08588c041f8a admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:49.862580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25b0a4-d26b-415a-b105-52f729b77b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:49.862580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25b0a4-d26b-415a-b105-52f729b77b10 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:49.862580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25b0a4-d26b-415a-b105-52f729b77b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:49.863096 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25b0a4-d26b-415a-b105-52f729b77b10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:49.864403 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25b0a4-d26b-415a-b105-52f729b77b10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:22:49.864841 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25b0a4-d26b-415a-b105-52f729b77b10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:49.866964 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25b0a4-d26b-415a-b105-52f729b77b10 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:49.867201 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4880364-27af-4da2-a1b5-08588c041f8a admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:49.871973 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa095ef2-3858-4da5-8888-eea73da6ef87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:49.872616 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa095ef2-3858-4da5-8888-eea73da6ef87 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:49.872900 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa095ef2-3858-4da5-8888-eea73da6ef87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:49.873175 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa095ef2-3858-4da5-8888-eea73da6ef87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:49.873916 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa095ef2-3858-4da5-8888-eea73da6ef87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:22:49.874221 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa095ef2-3858-4da5-8888-eea73da6ef87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:49.875821 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa095ef2-3858-4da5-8888-eea73da6ef87 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:49.883036 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 785/1575] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:22:49.883036 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25b0a4-d26b-415a-b105-52f729b77b10 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:49.889574 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 791/1576] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:22:49.889730 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25b0a4-d26b-415a-b105-52f729b77b10 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:49.890503 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa095ef2-3858-4da5-8888-eea73da6ef87 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:49.900034 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132f6c2-62da-4c57-aa57-56d49dff2010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:49.900689 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132f6c2-62da-4c57-aa57-56d49dff2010 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:49.900976 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132f6c2-62da-4c57-aa57-56d49dff2010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:49.901254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132f6c2-62da-4c57-aa57-56d49dff2010 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:49.902031 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132f6c2-62da-4c57-aa57-56d49dff2010 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:22:49.902343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132f6c2-62da-4c57-aa57-56d49dff2010 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:49.903979 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132f6c2-62da-4c57-aa57-56d49dff2010 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:49.905654 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa095ef2-3858-4da5-8888-eea73da6ef87 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:49.910975 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015d6d1-dd02-4be7-82ff-2dea5d800f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:49.911882 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015d6d1-dd02-4be7-82ff-2dea5d800f02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:49.912158 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015d6d1-dd02-4be7-82ff-2dea5d800f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:49.912433 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015d6d1-dd02-4be7-82ff-2dea5d800f02 admin admin] PATH_INFO: `/v3/projects/97d43167bd994abc9483d1b86ffda90a/users/a45dac4f789d4e6188da3b7574fb8a57/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:49.918139 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 786/1577] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:22:49.919229 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132f6c2-62da-4c57-aa57-56d49dff2010 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:49.929713 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132f6c2-62da-4c57-aa57-56d49dff2010 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:49.930028 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015d6d1-dd02-4be7-82ff-2dea5d800f02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97d43167bd994abc9483d1b86ffda90a, user_id=a45dac4f789d4e6188da3b7574fb8a57, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:49.932686 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015d6d1-dd02-4be7-82ff-2dea5d800f02 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:49.934267 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb9e58-3389-4a57-b08f-f6e4cc6f71d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:49.934922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb9e58-3389-4a57-b08f-f6e4cc6f71d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:49.935184 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb9e58-3389-4a57-b08f-f6e4cc6f71d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:49.935566 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb9e58-3389-4a57-b08f-f6e4cc6f71d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:49.936251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb9e58-3389-4a57-b08f-f6e4cc6f71d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:49.938219 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb9e58-3389-4a57-b08f-f6e4cc6f71d6 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:49.945686 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 792/1578] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:22:49 2022] PUT /identity/v3/projects/97d43167bd994abc9483d1b86ffda90a/users/a45dac4f789d4e6188da3b7574fb8a57/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:22:49.950738 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015d6d1-dd02-4be7-82ff-2dea5d800f02 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:49.958112 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 787/1579] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:22:49 2022] POST /identity/v3/users => generated 282 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:22:49.959632 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32a04a-6e64-442c-b823-9cd8c1375dcb None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:49.960099 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32a04a-6e64-442c-b823-9cd8c1375dcb None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:49.960371 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32a04a-6e64-442c-b823-9cd8c1375dcb None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:49.961598 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 788/1580] 10.222.0.57 () {54 vars in 961 bytes} [Sat Jun 4 08:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:22:49.962305 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32a04a-6e64-442c-b823-9cd8c1375dcb None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:49.986765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:22:50.015632 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015d6d1-dd02-4be7-82ff-2dea5d800f02 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:50.020779 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf43e25-73c2-4ebb-80e6-c28f8a08c4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:50.021438 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf43e25-73c2-4ebb-80e6-c28f8a08c4dc admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:50.021728 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf43e25-73c2-4ebb-80e6-c28f8a08c4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:50.022040 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf43e25-73c2-4ebb-80e6-c28f8a08c4dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:50.022726 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf43e25-73c2-4ebb-80e6-c28f8a08c4dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:50.024632 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf43e25-73c2-4ebb-80e6-c28f8a08c4dc admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:50.027735 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32a04a-6e64-442c-b823-9cd8c1375dcb None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:50.032430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d930ab-0aae-4a79-a3b4-618c6214be74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:50.033086 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d930ab-0aae-4a79-a3b4-618c6214be74 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:50.033385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d930ab-0aae-4a79-a3b4-618c6214be74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:50.033662 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d930ab-0aae-4a79-a3b4-618c6214be74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:50.034486 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d930ab-0aae-4a79-a3b4-618c6214be74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:50.035493 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: WARNING py.warnings [None req-42d930ab-0aae-4a79-a3b4-618c6214be74 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 08:22:50.035493 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: warnings.warn(msg) Jun 04 08:22:50.035493 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: Jun 04 08:22:50.036675 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d930ab-0aae-4a79-a3b4-618c6214be74 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:50.049774 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 793/1581] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:22:49 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:22:50.050599 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf43e25-73c2-4ebb-80e6-c28f8a08c4dc admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:50.066375 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 789/1582] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:22:49 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:22:50.067047 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d930ab-0aae-4a79-a3b4-618c6214be74 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:50.114829 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf43e25-73c2-4ebb-80e6-c28f8a08c4dc admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:50.129308 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d930ab-0aae-4a79-a3b4-618c6214be74 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:50.134227 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97a09d-2b7f-4506-9f6e-bcec1d375993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:50.134880 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97a09d-2b7f-4506-9f6e-bcec1d375993 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:50.135269 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97a09d-2b7f-4506-9f6e-bcec1d375993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:50.135554 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97a09d-2b7f-4506-9f6e-bcec1d375993 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:50.136236 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97a09d-2b7f-4506-9f6e-bcec1d375993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:50.138167 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97a09d-2b7f-4506-9f6e-bcec1d375993 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:50.169675 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 790/1583] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:22:50 2022] POST /identity/v3/projects => generated 389 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:22:50.169675 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97a09d-2b7f-4506-9f6e-bcec1d375993 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:50.177843 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b899b-92fd-4fd8-8a03-d22236eb90a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:50.178527 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b899b-92fd-4fd8-8a03-d22236eb90a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:50.178815 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b899b-92fd-4fd8-8a03-d22236eb90a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:50.179095 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b899b-92fd-4fd8-8a03-d22236eb90a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:50.179818 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b899b-92fd-4fd8-8a03-d22236eb90a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:50.181741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b899b-92fd-4fd8-8a03-d22236eb90a8 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:50.198456 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:22:50.209035 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 794/1584] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:22:50 2022] POST /identity/v3/projects => generated 391 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:22:50.210663 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2574036-ba02-4874-b313-9fed78ed0f69 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:50.210955 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2574036-ba02-4874-b313-9fed78ed0f69 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:50.211236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2574036-ba02-4874-b313-9fed78ed0f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:50.228219 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-b2574036-ba02-4874-b313-9fed78ed0f69 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:50.229450 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b2574036-ba02-4874-b313-9fed78ed0f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:50.234756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97a09d-2b7f-4506-9f6e-bcec1d375993 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:50.275366 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:22:50.291020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 795/1585] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:50.291835 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2574036-ba02-4874-b313-9fed78ed0f69 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:50.292259 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e30a3e-19d3-46d9-93bd-ff5edfb500bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:50.293027 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e30a3e-19d3-46d9-93bd-ff5edfb500bc admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:50.293313 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e30a3e-19d3-46d9-93bd-ff5edfb500bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:50.293652 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e30a3e-19d3-46d9-93bd-ff5edfb500bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:50.294753 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e30a3e-19d3-46d9-93bd-ff5edfb500bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:50.296734 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e30a3e-19d3-46d9-93bd-ff5edfb500bc admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:50.301759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2574036-ba02-4874-b313-9fed78ed0f69 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:50.306269 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b3455-812b-4171-942e-8f5b1fe61687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:50.306924 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b3455-812b-4171-942e-8f5b1fe61687 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:50.307215 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b3455-812b-4171-942e-8f5b1fe61687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:50.307487 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b3455-812b-4171-942e-8f5b1fe61687 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:50.308210 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b3455-812b-4171-942e-8f5b1fe61687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:50.309804 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b3455-812b-4171-942e-8f5b1fe61687 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:50.320491 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 796/1586] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:22:50.321841 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc8325-1d8d-4e17-9dbe-71a13498f8a6 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:50.322140 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc8325-1d8d-4e17-9dbe-71a13498f8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:50.322516 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc8325-1d8d-4e17-9dbe-71a13498f8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:50.324723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 791/1587] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:22:50 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:22:50.325736 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e30a3e-19d3-46d9-93bd-ff5edfb500bc admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:50.341570 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-27dc8325-1d8d-4e17-9dbe-71a13498f8a6 None None] MFA Rules not processed for user `7e64d002241242928936dd0d991ecdc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:50.342812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-27dc8325-1d8d-4e17-9dbe-71a13498f8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:50.386947 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e30a3e-19d3-46d9-93bd-ff5edfb500bc admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:50.392418 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06faca7-e32e-476e-abac-f2a1f1bcbeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:50.393077 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06faca7-e32e-476e-abac-f2a1f1bcbeb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:50.393418 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06faca7-e32e-476e-abac-f2a1f1bcbeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:50.393634 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06faca7-e32e-476e-abac-f2a1f1bcbeb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:50.394344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06faca7-e32e-476e-abac-f2a1f1bcbeb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:50.396248 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06faca7-e32e-476e-abac-f2a1f1bcbeb0 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:50.410920 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 797/1588] 10.222.0.57 () {58 vars in 1058 bytes} [Sat Jun 4 08:22:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:50.414812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc8325-1d8d-4e17-9dbe-71a13498f8a6 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:50.419134 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 792/1589] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:22:50 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:22:50.419134 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06faca7-e32e-476e-abac-f2a1f1bcbeb0 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:50.425691 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc8325-1d8d-4e17-9dbe-71a13498f8a6 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:50.427573 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06faca7-e32e-476e-abac-f2a1f1bcbeb0 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:50.430518 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ceccf1-7833-4ffc-898f-dc3eea9ba391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:50.431176 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ceccf1-7833-4ffc-898f-dc3eea9ba391 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:50.431463 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ceccf1-7833-4ffc-898f-dc3eea9ba391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:50.431743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ceccf1-7833-4ffc-898f-dc3eea9ba391 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:50.432173 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc9be8-3559-453c-ade5-b40cab82ebdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:50.432430 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ceccf1-7833-4ffc-898f-dc3eea9ba391 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:50.432825 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc9be8-3559-453c-ade5-b40cab82ebdf admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:50.433092 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc9be8-3559-453c-ade5-b40cab82ebdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:50.433370 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc9be8-3559-453c-ade5-b40cab82ebdf admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:50.434071 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc9be8-3559-453c-ade5-b40cab82ebdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:50.434411 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ceccf1-7833-4ffc-898f-dc3eea9ba391 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:50.435959 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc9be8-3559-453c-ade5-b40cab82ebdf admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:50.456216 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 798/1590] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:22:50 2022] POST /identity/v3/users => generated 293 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:22:50.457111 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ceccf1-7833-4ffc-898f-dc3eea9ba391 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:50.457244 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 793/1591] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:22:50 2022] POST /identity/v3/users => generated 295 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:22:50.458165 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc9be8-3559-453c-ade5-b40cab82ebdf admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:50.467531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ceccf1-7833-4ffc-898f-dc3eea9ba391 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:50.472083 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f65dcb-4076-444a-a688-f74850c796ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:50.472769 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f65dcb-4076-444a-a688-f74850c796ee admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:50.473051 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f65dcb-4076-444a-a688-f74850c796ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:50.473322 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f65dcb-4076-444a-a688-f74850c796ee admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:50.474052 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f65dcb-4076-444a-a688-f74850c796ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:50.475947 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f65dcb-4076-444a-a688-f74850c796ee admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:50.492389 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:22:50.497120 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 799/1592] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:22:50 2022] POST /identity/v3/users => generated 296 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:22:50.497932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f65dcb-4076-444a-a688-f74850c796ee admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:50.508580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f65dcb-4076-444a-a688-f74850c796ee admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:50.513637 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce093f5-b53e-44e3-b040-c826717e3b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:50.514306 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce093f5-b53e-44e3-b040-c826717e3b76 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:50.514585 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce093f5-b53e-44e3-b040-c826717e3b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:50.514855 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce093f5-b53e-44e3-b040-c826717e3b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:50.515329 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc9be8-3559-453c-ade5-b40cab82ebdf admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:50.515556 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce093f5-b53e-44e3-b040-c826717e3b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:50.517146 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce093f5-b53e-44e3-b040-c826717e3b76 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:50.518933 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6aa37d-8add-4096-89d3-7b68e69c6c1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:50.519575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6aa37d-8add-4096-89d3-7b68e69c6c1e service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:50.519853 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6aa37d-8add-4096-89d3-7b68e69c6c1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:50.520126 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6aa37d-8add-4096-89d3-7b68e69c6c1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:50.527516 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 800/1593] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:22:50.528197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce093f5-b53e-44e3-b040-c826717e3b76 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:50.529312 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6aa37d-8add-4096-89d3-7b68e69c6c1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:50.530769 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6aa37d-8add-4096-89d3-7b68e69c6c1e service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:50.539777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce093f5-b53e-44e3-b040-c826717e3b76 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:50.541011 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 794/1594] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:22:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:22:50.542305 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a972b47-3971-4d23-a0ad-567f8f4af353 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:50.542593 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a972b47-3971-4d23-a0ad-567f8f4af353 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:50.542873 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a972b47-3971-4d23-a0ad-567f8f4af353 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:50.544232 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 795/1595] 10.222.0.57 () {54 vars in 912 bytes} [Sat Jun 4 08:22:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:22:50.544409 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642dad40-5564-4e1c-a72b-74239b10565a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:50.544925 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a972b47-3971-4d23-a0ad-567f8f4af353 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:50.545074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dad40-5564-4e1c-a72b-74239b10565a admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:50.545239 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dad40-5564-4e1c-a72b-74239b10565a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:50.545518 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dad40-5564-4e1c-a72b-74239b10565a admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:50.546319 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642dad40-5564-4e1c-a72b-74239b10565a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:50.548758 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642dad40-5564-4e1c-a72b-74239b10565a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:50.559287 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a972b47-3971-4d23-a0ad-567f8f4af353 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:50.565811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26504b9f-e012-45ad-8835-2bff5cfa0766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:50.566578 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26504b9f-e012-45ad-8835-2bff5cfa0766 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:50.566920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26504b9f-e012-45ad-8835-2bff5cfa0766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:50.567660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26504b9f-e012-45ad-8835-2bff5cfa0766 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:50.568234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26504b9f-e012-45ad-8835-2bff5cfa0766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:50.569867 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26504b9f-e012-45ad-8835-2bff5cfa0766 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:50.573192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 801/1596] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:22:50 2022] POST /identity/v3/users => generated 292 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:22:50.573192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642dad40-5564-4e1c-a72b-74239b10565a admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:50.580541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642dad40-5564-4e1c-a72b-74239b10565a admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:50.582516 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 796/1597] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:22:50.583331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26504b9f-e012-45ad-8835-2bff5cfa0766 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:50.585963 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5773356-6512-4d12-9e43-79173e890dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:50.586525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5773356-6512-4d12-9e43-79173e890dcd admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:50.586882 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5773356-6512-4d12-9e43-79173e890dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:50.587084 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5773356-6512-4d12-9e43-79173e890dcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:50.587791 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5773356-6512-4d12-9e43-79173e890dcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:50.589405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5773356-6512-4d12-9e43-79173e890dcd admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:50.594171 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26504b9f-e012-45ad-8835-2bff5cfa0766 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:50.599708 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 802/1598] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:22:50.602844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ffc65-c6de-4f3a-8c9a-4d1c27f3b6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:50.602984 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5773356-6512-4d12-9e43-79173e890dcd admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:50.603073 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ffc65-c6de-4f3a-8c9a-4d1c27f3b6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:50.603073 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ffc65-c6de-4f3a-8c9a-4d1c27f3b6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:50.603073 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ffc65-c6de-4f3a-8c9a-4d1c27f3b6d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:50.603073 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ffc65-c6de-4f3a-8c9a-4d1c27f3b6d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:50.603863 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ffc65-c6de-4f3a-8c9a-4d1c27f3b6d8 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:50.612018 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5773356-6512-4d12-9e43-79173e890dcd admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:50.616726 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8e81f-56af-4a90-9c51-b284346a3ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:50.620037 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 797/1599] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:22:50.620190 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8e81f-56af-4a90-9c51-b284346a3ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:50.620190 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8e81f-56af-4a90-9c51-b284346a3ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:50.620359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ffc65-c6de-4f3a-8c9a-4d1c27f3b6d8 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:50.620444 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8e81f-56af-4a90-9c51-b284346a3ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:50.620444 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8e81f-56af-4a90-9c51-b284346a3ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:50.620580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8e81f-56af-4a90-9c51-b284346a3ec2 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:50.634698 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ffc65-c6de-4f3a-8c9a-4d1c27f3b6d8 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:50.634903 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 803/1600] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:22:50.634903 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d18bc-287a-48ab-a2b6-f83acd73cc68 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:50.634903 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d18bc-287a-48ab-a2b6-f83acd73cc68 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:50.634903 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d18bc-287a-48ab-a2b6-f83acd73cc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:50.640668 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435a49f-54fe-43dd-a703-b1d065f0b0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:50.641866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435a49f-54fe-43dd-a703-b1d065f0b0a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:50.642177 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435a49f-54fe-43dd-a703-b1d065f0b0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:50.642457 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435a49f-54fe-43dd-a703-b1d065f0b0a1 admin admin] PATH_INFO: `/v3/projects/8ed2f65f0a9840bea8207bc03523ae8f/users/fdcfaa21e73d4b09bf0b97989f4d291a/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:50.651767 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-155d18bc-287a-48ab-a2b6-f83acd73cc68 None None] MFA Rules not processed for user `7e64d002241242928936dd0d991ecdc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:50.652969 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-155d18bc-287a-48ab-a2b6-f83acd73cc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:50.659263 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435a49f-54fe-43dd-a703-b1d065f0b0a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ed2f65f0a9840bea8207bc03523ae8f, user_id=fdcfaa21e73d4b09bf0b97989f4d291a, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:50.660332 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: WARNING py.warnings [None req-a435a49f-54fe-43dd-a703-b1d065f0b0a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 08:22:50.660332 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: warnings.warn(msg) Jun 04 08:22:50.660332 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: Jun 04 08:22:50.662350 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 804/1601] 10.222.0.57 () {58 vars in 1009 bytes} [Sat Jun 4 08:22:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:50.662483 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435a49f-54fe-43dd-a703-b1d065f0b0a1 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:50.662970 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d18bc-287a-48ab-a2b6-f83acd73cc68 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:50.674946 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d18bc-287a-48ab-a2b6-f83acd73cc68 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:50.681302 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 798/1602] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:22:50 2022] PUT /identity/v3/projects/8ed2f65f0a9840bea8207bc03523ae8f/users/fdcfaa21e73d4b09bf0b97989f4d291a/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:22:50.682709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435a49f-54fe-43dd-a703-b1d065f0b0a1 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:50.716706 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:22:50.749008 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871fdc31-c385-4c57-bc0a-3e6f2868a784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:50.750445 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fdc31-c385-4c57-bc0a-3e6f2868a784 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:50.751114 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fdc31-c385-4c57-bc0a-3e6f2868a784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:50.751573 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fdc31-c385-4c57-bc0a-3e6f2868a784 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:50.752517 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871fdc31-c385-4c57-bc0a-3e6f2868a784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:50.754316 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871fdc31-c385-4c57-bc0a-3e6f2868a784 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:50.767088 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 805/1603] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:22:50.767987 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871fdc31-c385-4c57-bc0a-3e6f2868a784 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:50.769798 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435a49f-54fe-43dd-a703-b1d065f0b0a1 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:50.776761 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97092c-3f72-4043-bd0a-9cbe836f09b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:50.777846 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97092c-3f72-4043-bd0a-9cbe836f09b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:50.778342 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97092c-3f72-4043-bd0a-9cbe836f09b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:50.778774 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97092c-3f72-4043-bd0a-9cbe836f09b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:50.779120 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871fdc31-c385-4c57-bc0a-3e6f2868a784 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:50.780283 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97092c-3f72-4043-bd0a-9cbe836f09b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:50.783026 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97092c-3f72-4043-bd0a-9cbe836f09b9 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:50.784491 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39a9aa-287f-410a-bd7d-7800da21c923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:50.785222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39a9aa-287f-410a-bd7d-7800da21c923 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:50.785506 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39a9aa-287f-410a-bd7d-7800da21c923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:50.785784 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39a9aa-287f-410a-bd7d-7800da21c923 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:50.786555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c39a9aa-287f-410a-bd7d-7800da21c923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:50.788441 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c39a9aa-287f-410a-bd7d-7800da21c923 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:50.797153 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 799/1604] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:22:50.799178 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97092c-3f72-4043-bd0a-9cbe836f09b9 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:50.801563 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 806/1605] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:22:50.802513 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39a9aa-287f-410a-bd7d-7800da21c923 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:50.811426 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97092c-3f72-4043-bd0a-9cbe836f09b9 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:50.814675 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39a9aa-287f-410a-bd7d-7800da21c923 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:50.816693 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf018a-42b0-4ce0-843e-b16547eee6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:50.817377 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf018a-42b0-4ce0-843e-b16547eee6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:50.817692 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf018a-42b0-4ce0-843e-b16547eee6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:50.817964 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf018a-42b0-4ce0-843e-b16547eee6b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:50.818696 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf018a-42b0-4ce0-843e-b16547eee6b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:50.820322 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf018a-42b0-4ce0-843e-b16547eee6b5 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:50.821447 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df903792-5611-47cc-a26b-1c0cf8d79791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:50.822593 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df903792-5611-47cc-a26b-1c0cf8d79791 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:50.822925 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df903792-5611-47cc-a26b-1c0cf8d79791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:50.823203 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df903792-5611-47cc-a26b-1c0cf8d79791 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:50.824093 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df903792-5611-47cc-a26b-1c0cf8d79791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:50.825995 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df903792-5611-47cc-a26b-1c0cf8d79791 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:50.834051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 800/1606] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:22:50.835665 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf018a-42b0-4ce0-843e-b16547eee6b5 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:50.838896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 807/1607] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:22:50.840261 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c6c94-420a-46f2-b382-7e8b5fcdb883 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:50.840549 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c6c94-420a-46f2-b382-7e8b5fcdb883 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:50.840822 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c6c94-420a-46f2-b382-7e8b5fcdb883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:50.868582 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f17c6c94-420a-46f2-b382-7e8b5fcdb883 None None] MFA Rules not processed for user `fdcfaa21e73d4b09bf0b97989f4d291a`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:50.869789 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f17c6c94-420a-46f2-b382-7e8b5fcdb883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:50.898625 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf018a-42b0-4ce0-843e-b16547eee6b5 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:50.902442 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5776b4-f63a-46d5-a1ac-d59cc139eb03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:50.903091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5776b4-f63a-46d5-a1ac-d59cc139eb03 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:50.903411 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5776b4-f63a-46d5-a1ac-d59cc139eb03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:50.903644 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5776b4-f63a-46d5-a1ac-d59cc139eb03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:50.941422 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:22:50.943707 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 808/1608] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:50 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:50.947457 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c6c94-420a-46f2-b382-7e8b5fcdb883 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:50.957975 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c6c94-420a-46f2-b382-7e8b5fcdb883 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:50.964135 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb56c27-3e6a-4a25-9434-ba34d3d81b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:50.964812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb56c27-3e6a-4a25-9434-ba34d3d81b25 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:50.965577 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb56c27-3e6a-4a25-9434-ba34d3d81b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:50.965577 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb56c27-3e6a-4a25-9434-ba34d3d81b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:50.966401 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb56c27-3e6a-4a25-9434-ba34d3d81b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:50.967880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb56c27-3e6a-4a25-9434-ba34d3d81b25 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:50.981919 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 809/1609] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:22:50.983837 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb56c27-3e6a-4a25-9434-ba34d3d81b25 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:50.995496 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb56c27-3e6a-4a25-9434-ba34d3d81b25 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:51.000397 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42977b09-1f53-4cda-8210-b80b8bfe8b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:51.001385 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42977b09-1f53-4cda-8210-b80b8bfe8b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:51.001726 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42977b09-1f53-4cda-8210-b80b8bfe8b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:51.002117 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42977b09-1f53-4cda-8210-b80b8bfe8b53 admin admin] PATH_INFO: `/v3/projects/880551882c5748278978d5a7586d1f30/users/45692f4ec1254103a5b0132b3b42b60b/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:51.007228 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5776b4-f63a-46d5-a1ac-d59cc139eb03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:51.009273 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5776b4-f63a-46d5-a1ac-d59cc139eb03 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:51.018399 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42977b09-1f53-4cda-8210-b80b8bfe8b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=880551882c5748278978d5a7586d1f30, user_id=45692f4ec1254103a5b0132b3b42b60b, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:51.021149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42977b09-1f53-4cda-8210-b80b8bfe8b53 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:51.022434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 801/1610] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:22:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:22:51.035931 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5776b4-f63a-46d5-a1ac-d59cc139eb03 service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:51.038553 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 810/1611] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:22:50 2022] PUT /identity/v3/projects/880551882c5748278978d5a7586d1f30/users/45692f4ec1254103a5b0132b3b42b60b/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:22:51.039285 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42977b09-1f53-4cda-8210-b80b8bfe8b53 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:51.062414 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5776b4-f63a-46d5-a1ac-d59cc139eb03 service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:51.109045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42977b09-1f53-4cda-8210-b80b8bfe8b53 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:51.116103 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af28ca-486a-44a3-aa1d-73e48487b7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:51.117211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af28ca-486a-44a3-aa1d-73e48487b7c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:51.117418 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af28ca-486a-44a3-aa1d-73e48487b7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:51.117769 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af28ca-486a-44a3-aa1d-73e48487b7c9 admin admin] PATH_INFO: `/v3/projects/bb59e7902bf94c62a6f9b5e7e4cbabe3/users/e1e8c33d40ee43c693c28beaf794dff5/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:51.137598 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:22:51.152556 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af28ca-486a-44a3-aa1d-73e48487b7c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb59e7902bf94c62a6f9b5e7e4cbabe3, user_id=e1e8c33d40ee43c693c28beaf794dff5, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:51.158139 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af28ca-486a-44a3-aa1d-73e48487b7c9 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:51.158882 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58819fdb-5f55-4830-9c0e-ca69a2f52656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:51.160496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58819fdb-5f55-4830-9c0e-ca69a2f52656 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:51.160496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58819fdb-5f55-4830-9c0e-ca69a2f52656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:51.160496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58819fdb-5f55-4830-9c0e-ca69a2f52656 admin admin] PATH_INFO: `/v3/projects/bada48f0853f4642b538bab7eae486e6/users/93baaa9e849b40b199d567615f7e1c94/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:51.180780 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 811/1612] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:22:51 2022] PUT /identity/v3/projects/bb59e7902bf94c62a6f9b5e7e4cbabe3/users/e1e8c33d40ee43c693c28beaf794dff5/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:22:51.181504 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af28ca-486a-44a3-aa1d-73e48487b7c9 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:51.186360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58819fdb-5f55-4830-9c0e-ca69a2f52656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bada48f0853f4642b538bab7eae486e6, user_id=93baaa9e849b40b199d567615f7e1c94, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:51.191554 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58819fdb-5f55-4830-9c0e-ca69a2f52656 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:51.209129 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 802/1613] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:22:51 2022] PUT /identity/v3/projects/bada48f0853f4642b538bab7eae486e6/users/93baaa9e849b40b199d567615f7e1c94/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:22:51.210712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58819fdb-5f55-4830-9c0e-ca69a2f52656 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:51.256701 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af28ca-486a-44a3-aa1d-73e48487b7c9 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:51.284688 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58819fdb-5f55-4830-9c0e-ca69a2f52656 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:51.290251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13afd0-a0b3-4afe-8d87-5d0422a7454e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:51.290920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13afd0-a0b3-4afe-8d87-5d0422a7454e admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:51.291210 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13afd0-a0b3-4afe-8d87-5d0422a7454e admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:51.291483 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13afd0-a0b3-4afe-8d87-5d0422a7454e admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:51.292210 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13afd0-a0b3-4afe-8d87-5d0422a7454e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:51.294125 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13afd0-a0b3-4afe-8d87-5d0422a7454e admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:51.320796 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e772e-e1ea-494a-a344-bc993abe4e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:51.321884 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e772e-e1ea-494a-a344-bc993abe4e0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:51.322178 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e772e-e1ea-494a-a344-bc993abe4e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:51.322460 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e772e-e1ea-494a-a344-bc993abe4e0f admin admin] PATH_INFO: `/v3/projects/d5a99059e0694a6f91e0cffa23ec52d8/users/3b943ba0c640461e94943764f95458f8/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:51.323496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 803/1614] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:22:51 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:22:51.324288 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13afd0-a0b3-4afe-8d87-5d0422a7454e admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:51.341920 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e772e-e1ea-494a-a344-bc993abe4e0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5a99059e0694a6f91e0cffa23ec52d8, user_id=3b943ba0c640461e94943764f95458f8, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:51.345435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e772e-e1ea-494a-a344-bc993abe4e0f admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:51.357962 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:22:51.361780 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 812/1615] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:22:51 2022] PUT /identity/v3/projects/d5a99059e0694a6f91e0cffa23ec52d8/users/3b943ba0c640461e94943764f95458f8/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:22:51.366851 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef860631-c3b9-42a2-9bd6-edb9749d1947 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:51.367182 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef860631-c3b9-42a2-9bd6-edb9749d1947 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:51.367442 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef860631-c3b9-42a2-9bd6-edb9749d1947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:51.384989 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-ef860631-c3b9-42a2-9bd6-edb9749d1947 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:51.386275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ef860631-c3b9-42a2-9bd6-edb9749d1947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:51.405568 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13afd0-a0b3-4afe-8d87-5d0422a7454e admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:51.463455 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 813/1616] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:51.464922 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c7421-3082-4ea8-918f-8434be62a14d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:51.465280 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c7421-3082-4ea8-918f-8434be62a14d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:51.465847 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c7421-3082-4ea8-918f-8434be62a14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:51.474618 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a7073-7c4e-4049-9370-408585114c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:51.475763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a7073-7c4e-4049-9370-408585114c42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:51.476391 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a7073-7c4e-4049-9370-408585114c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:51.476391 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a7073-7c4e-4049-9370-408585114c42 admin admin] PATH_INFO: `/v3/projects/8035faea1d8347028ba7d2955f247d83/users/5c5e96bd766a458a9c576b631c73a783/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:51.489393 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-124c7421-3082-4ea8-918f-8434be62a14d None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:51.490634 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-124c7421-3082-4ea8-918f-8434be62a14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:51.497452 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a7073-7c4e-4049-9370-408585114c42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8035faea1d8347028ba7d2955f247d83, user_id=5c5e96bd766a458a9c576b631c73a783, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:51.502333 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a7073-7c4e-4049-9370-408585114c42 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:51.502481 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 814/1617] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:51.503795 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e208e-8213-4b84-8895-1b78fed91215 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:51.504088 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e208e-8213-4b84-8895-1b78fed91215 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:51.504367 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e208e-8213-4b84-8895-1b78fed91215 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:51.506012 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 815/1618] 10.222.0.57 () {54 vars in 912 bytes} [Sat Jun 4 08:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:22:51.506943 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c2aac-04d4-4b6d-885f-333a2e0b01d6 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:51.507229 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c2aac-04d4-4b6d-885f-333a2e0b01d6 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:51.507506 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c2aac-04d4-4b6d-885f-333a2e0b01d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:51.521134 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 804/1619] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:22:51 2022] PUT /identity/v3/projects/8035faea1d8347028ba7d2955f247d83/users/5c5e96bd766a458a9c576b631c73a783/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:22:51.522581 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a7073-7c4e-4049-9370-408585114c42 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:51.538647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e86c2aac-04d4-4b6d-885f-333a2e0b01d6 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:51.539848 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e86c2aac-04d4-4b6d-885f-333a2e0b01d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:51.550810 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:22:51.604058 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a7073-7c4e-4049-9370-408585114c42 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:51.608413 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 816/1620] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:51.609653 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75479b-4ff6-4879-8048-ec8be664e6f8 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:51.609984 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75479b-4ff6-4879-8048-ec8be664e6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:51.610388 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75479b-4ff6-4879-8048-ec8be664e6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:51.612404 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e6aec-cd3c-491f-8fb5-db4dbf4a6cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:51.612919 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e6aec-cd3c-491f-8fb5-db4dbf4a6cae admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:51.613210 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e6aec-cd3c-491f-8fb5-db4dbf4a6cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:51.613508 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e6aec-cd3c-491f-8fb5-db4dbf4a6cae admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:51.614873 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e6aec-cd3c-491f-8fb5-db4dbf4a6cae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:51.617060 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e6aec-cd3c-491f-8fb5-db4dbf4a6cae admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:51.630126 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-fc75479b-4ff6-4879-8048-ec8be664e6f8 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:51.631419 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-fc75479b-4ff6-4879-8048-ec8be664e6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:51.639435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 817/1621] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:51.641780 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75479b-4ff6-4879-8048-ec8be664e6f8 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:51.644990 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 805/1622] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:22:51 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:22:51.644990 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9287b37-30e8-478f-a363-a9dd80a278de None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:51.644990 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9287b37-30e8-478f-a363-a9dd80a278de None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:51.644990 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9287b37-30e8-478f-a363-a9dd80a278de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:51.664260 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-b9287b37-30e8-478f-a363-a9dd80a278de None None] MFA Rules not processed for user `7e64d002241242928936dd0d991ecdc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:51.665882 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-b9287b37-30e8-478f-a363-a9dd80a278de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:51.706259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75479b-4ff6-4879-8048-ec8be664e6f8 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:51.710257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a68df-f77d-4936-ae6e-64d6e264f975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:51.711037 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a68df-f77d-4936-ae6e-64d6e264f975 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:51.711326 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a68df-f77d-4936-ae6e-64d6e264f975 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:51.711605 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a68df-f77d-4936-ae6e-64d6e264f975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:51.717646 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:22:51.721703 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a68df-f77d-4936-ae6e-64d6e264f975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:51.723230 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a68df-f77d-4936-ae6e-64d6e264f975 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:51.733125 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 818/1623] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:22:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:22:51.733803 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a68df-f77d-4936-ae6e-64d6e264f975 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:51.735156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-584a68df-f77d-4936-ae6e-64d6e264f975 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:51.745962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a68df-f77d-4936-ae6e-64d6e264f975 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:51.749706 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769d144-0405-4e84-a107-1c7036d1acd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:51.750935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769d144-0405-4e84-a107-1c7036d1acd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:51.751215 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769d144-0405-4e84-a107-1c7036d1acd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:51.751337 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 806/1624] 10.222.0.57 () {58 vars in 1009 bytes} [Sat Jun 4 08:22:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:51.751540 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769d144-0405-4e84-a107-1c7036d1acd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:51.752675 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95e537-c8cd-49e4-9c0e-95e105a4dfcb None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:51.752970 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95e537-c8cd-49e4-9c0e-95e105a4dfcb None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:51.753248 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95e537-c8cd-49e4-9c0e-95e105a4dfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:51.762879 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769d144-0405-4e84-a107-1c7036d1acd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:51.764526 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769d144-0405-4e84-a107-1c7036d1acd2 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:51.775924 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 819/1625] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:22:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:22:51.777095 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae70665-7e28-46e6-989e-422d4c4869b3 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:51.777382 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae70665-7e28-46e6-989e-422d4c4869b3 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:51.777663 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae70665-7e28-46e6-989e-422d4c4869b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:51.788345 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-ae95e537-c8cd-49e4-9c0e-95e105a4dfcb None None] MFA Rules not processed for user `5c5e96bd766a458a9c576b631c73a783`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:51.789922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ae95e537-c8cd-49e4-9c0e-95e105a4dfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:51.806767 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-9ae70665-7e28-46e6-989e-422d4c4869b3 None None] MFA Rules not processed for user `a45dac4f789d4e6188da3b7574fb8a57`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:51.807985 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9ae70665-7e28-46e6-989e-422d4c4869b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:51.886262 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 807/1626] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:51.887477 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95e537-c8cd-49e4-9c0e-95e105a4dfcb None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:51.903651 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95e537-c8cd-49e4-9c0e-95e105a4dfcb None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:51.909047 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d24dce-0a18-41f2-9908-efb2da010fad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:51.915405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 820/1627] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:51.918562 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d24dce-0a18-41f2-9908-efb2da010fad service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:51.918686 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae70665-7e28-46e6-989e-422d4c4869b3 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:51.918909 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d24dce-0a18-41f2-9908-efb2da010fad service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:51.919136 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d24dce-0a18-41f2-9908-efb2da010fad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:51.935020 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d24dce-0a18-41f2-9908-efb2da010fad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:51.936330 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae70665-7e28-46e6-989e-422d4c4869b3 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:51.937012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d24dce-0a18-41f2-9908-efb2da010fad service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:51.944333 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4bb32-e7bf-4b10-ab20-7f144a3faaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:51.944930 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4bb32-e7bf-4b10-ab20-7f144a3faaa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:51.945211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4bb32-e7bf-4b10-ab20-7f144a3faaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:51.945486 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4bb32-e7bf-4b10-ab20-7f144a3faaa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:51.946453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4bb32-e7bf-4b10-ab20-7f144a3faaa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:51.948182 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4bb32-e7bf-4b10-ab20-7f144a3faaa2 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:51.951738 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 808/1628] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:22:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:22:51.953190 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d24dce-0a18-41f2-9908-efb2da010fad service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:51.961203 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 821/1629] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:22:51.962248 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4bb32-e7bf-4b10-ab20-7f144a3faaa2 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:51.963932 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d24dce-0a18-41f2-9908-efb2da010fad service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:51.982888 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:22:51.991519 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705a74b-81b3-4fd6-b15b-c4e7fe188e1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:51.994248 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705a74b-81b3-4fd6-b15b-c4e7fe188e1b service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:51.994778 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705a74b-81b3-4fd6-b15b-c4e7fe188e1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:51.995833 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705a74b-81b3-4fd6-b15b-c4e7fe188e1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:52.024968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705a74b-81b3-4fd6-b15b-c4e7fe188e1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:52.027169 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705a74b-81b3-4fd6-b15b-c4e7fe188e1b service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:52.030337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4bb32-e7bf-4b10-ab20-7f144a3faaa2 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:52.035666 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc3dcf-4ad5-4974-a51c-67556ca1111d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:52.036471 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc3dcf-4ad5-4974-a51c-67556ca1111d service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:52.036677 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc3dcf-4ad5-4974-a51c-67556ca1111d service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:52.036857 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc3dcf-4ad5-4974-a51c-67556ca1111d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:52.042624 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 809/1630] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:22:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:22:52.043545 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705a74b-81b3-4fd6-b15b-c4e7fe188e1b service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:52.052249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc3dcf-4ad5-4974-a51c-67556ca1111d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:52.054556 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc3dcf-4ad5-4974-a51c-67556ca1111d service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:52.062325 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705a74b-81b3-4fd6-b15b-c4e7fe188e1b service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:52.070432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0d5ba-23a3-4c25-93c7-7b7b7d3602c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:52.071412 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0d5ba-23a3-4c25-93c7-7b7b7d3602c8 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:52.071802 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0d5ba-23a3-4c25-93c7-7b7b7d3602c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:52.072181 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0d5ba-23a3-4c25-93c7-7b7b7d3602c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:52.084051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca0d5ba-23a3-4c25-93c7-7b7b7d3602c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:52.084228 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 822/1631] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:22:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:22:52.086532 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca0d5ba-23a3-4c25-93c7-7b7b7d3602c8 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:52.089041 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e8313-b1c6-4005-be25-b3b18ded3140 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:52.089466 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e8313-b1c6-4005-be25-b3b18ded3140 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:52.089987 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e8313-b1c6-4005-be25-b3b18ded3140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:52.103369 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 810/1632] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:22:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:22:52.105107 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0d5ba-23a3-4c25-93c7-7b7b7d3602c8 service nova] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:52.120161 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0d5ba-23a3-4c25-93c7-7b7b7d3602c8 service nova] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:52.127544 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8352f9-b4f0-432f-8c48-cac3aa02f20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:52.129386 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8352f9-b4f0-432f-8c48-cac3aa02f20e admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:52.129940 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8352f9-b4f0-432f-8c48-cac3aa02f20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:52.130794 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8352f9-b4f0-432f-8c48-cac3aa02f20e admin admin] PATH_INFO: `/v3/projects/54060c9224ca4702aaad60d31cde4d18/users/6151a3829d0c408a855ae9c74754823a/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:52.136184 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-b90e8313-b1c6-4005-be25-b3b18ded3140 None None] MFA Rules not processed for user `a45dac4f789d4e6188da3b7574fb8a57`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:52.137574 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b90e8313-b1c6-4005-be25-b3b18ded3140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:52.150415 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 823/1633] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:52.152023 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8352f9-b4f0-432f-8c48-cac3aa02f20e admin admin] RBAC: Authorizing `identity:create_grant(project_id=54060c9224ca4702aaad60d31cde4d18, user_id=6151a3829d0c408a855ae9c74754823a, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:52.155293 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8352f9-b4f0-432f-8c48-cac3aa02f20e admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:52.199660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 811/1634] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:22:52 2022] PUT /identity/v3/projects/54060c9224ca4702aaad60d31cde4d18/users/6151a3829d0c408a855ae9c74754823a/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:22:52.202833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e8313-b1c6-4005-be25-b3b18ded3140 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:52.204204 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8352f9-b4f0-432f-8c48-cac3aa02f20e admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:52.215422 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e8313-b1c6-4005-be25-b3b18ded3140 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:52.276711 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:22:52.296839 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8352f9-b4f0-432f-8c48-cac3aa02f20e admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:52.304051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c03e4-44c9-4254-a7fb-f43a1f7e5d3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:52.304767 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c03e4-44c9-4254-a7fb-f43a1f7e5d3d service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:52.305066 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c03e4-44c9-4254-a7fb-f43a1f7e5d3d service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:52.305344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c03e4-44c9-4254-a7fb-f43a1f7e5d3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:52.360282 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229c5f1-0b5f-44be-86a6-036624ff36b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:52.362461 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229c5f1-0b5f-44be-86a6-036624ff36b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:52.363496 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229c5f1-0b5f-44be-86a6-036624ff36b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:52.363931 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229c5f1-0b5f-44be-86a6-036624ff36b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:52.366268 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229c5f1-0b5f-44be-86a6-036624ff36b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:52.368092 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229c5f1-0b5f-44be-86a6-036624ff36b0 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:52.384779 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c03e4-44c9-4254-a7fb-f43a1f7e5d3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:52.387213 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c03e4-44c9-4254-a7fb-f43a1f7e5d3d service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:52.396711 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 824/1635] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:22:52.400870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229c5f1-0b5f-44be-86a6-036624ff36b0 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:52.407500 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 812/1636] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:22:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:22:52.419411 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229c5f1-0b5f-44be-86a6-036624ff36b0 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:52.437174 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f4f04-0d6b-4321-b0e1-86cdbc373982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:52.438638 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f4f04-0d6b-4321-b0e1-86cdbc373982 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:52.438957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f4f04-0d6b-4321-b0e1-86cdbc373982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:52.439347 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f4f04-0d6b-4321-b0e1-86cdbc373982 admin admin] PATH_INFO: `/v3/projects/54060c9224ca4702aaad60d31cde4d18/users/6151a3829d0c408a855ae9c74754823a/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:52.444315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f4f04-0d6b-4321-b0e1-86cdbc373982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54060c9224ca4702aaad60d31cde4d18, user_id=6151a3829d0c408a855ae9c74754823a, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:52.450573 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f4f04-0d6b-4321-b0e1-86cdbc373982 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:52.485869 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 825/1637] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:22:52 2022] PUT /identity/v3/projects/54060c9224ca4702aaad60d31cde4d18/users/6151a3829d0c408a855ae9c74754823a/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:22:52.489291 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99656c0a-b475-475a-bb2b-21e59208a03a None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:52.489676 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99656c0a-b475-475a-bb2b-21e59208a03a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:52.490072 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99656c0a-b475-475a-bb2b-21e59208a03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:52.530778 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-99656c0a-b475-475a-bb2b-21e59208a03a None None] MFA Rules not processed for user `6151a3829d0c408a855ae9c74754823a`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:52.532855 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-99656c0a-b475-475a-bb2b-21e59208a03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:52.642291 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 813/1638] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:52 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:52.655752 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f4f04-0d6b-4321-b0e1-86cdbc373982 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:52.785515 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f4f04-0d6b-4321-b0e1-86cdbc373982 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:52.794869 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ce906-a9f6-41ea-8708-91b6049b37f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:52.795925 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ce906-a9f6-41ea-8708-91b6049b37f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:52.796280 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ce906-a9f6-41ea-8708-91b6049b37f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:52.796633 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ce906-a9f6-41ea-8708-91b6049b37f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:52.820325 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ce906-a9f6-41ea-8708-91b6049b37f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:52.821865 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ce906-a9f6-41ea-8708-91b6049b37f0 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:52.846095 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 826/1639] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:22:52 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:22:53.130491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99656c0a-b475-475a-bb2b-21e59208a03a None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:53.199116 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37200997-f28c-4f02-a950-88c3dcd9d195 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:53.199406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37200997-f28c-4f02-a950-88c3dcd9d195 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:53.199683 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37200997-f28c-4f02-a950-88c3dcd9d195 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:53.201416 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 827/1640] 10.222.0.57 () {54 vars in 912 bytes} [Sat Jun 4 08:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:22:53.206878 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d3444-d2c5-4a2e-8d34-9a8b9281b7c8 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:53.207165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d3444-d2c5-4a2e-8d34-9a8b9281b7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:53.207447 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d3444-d2c5-4a2e-8d34-9a8b9281b7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:53.283535 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99656c0a-b475-475a-bb2b-21e59208a03a None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:53.289508 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359c21d-bcff-415e-a779-702463f6bf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:53.290758 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359c21d-bcff-415e-a779-702463f6bf7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:53.291330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359c21d-bcff-415e-a779-702463f6bf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:53.291819 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359c21d-bcff-415e-a779-702463f6bf7b admin admin] PATH_INFO: `/v3/users/13801179e3b145f1af900ab9c3d0317b` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:53.294611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359c21d-bcff-415e-a779-702463f6bf7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=13801179e3b145f1af900ab9c3d0317b)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:53.295894 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: WARNING py.warnings [None req-2359c21d-bcff-415e-a779-702463f6bf7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 08:22:53.295894 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: warnings.warn(msg) Jun 04 08:22:53.295894 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: Jun 04 08:22:53.296722 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-d83d3444-d2c5-4a2e-8d34-9a8b9281b7c8 None None] MFA Rules not processed for user `5fd5768a512c4177abae05f4ccd5c59f`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:53.306682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359c21d-bcff-415e-a779-702463f6bf7b admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:53.306975 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d83d3444-d2c5-4a2e-8d34-9a8b9281b7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:53.382660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:22:53.384550 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:22:53.444542 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 828/1641] 10.222.0.57 () {58 vars in 1009 bytes} [Sat Jun 4 08:22:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:22:53.461014 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2359c21d-bcff-415e-a779-702463f6bf7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13801179e3b145f1af900ab9c3d0317b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:22:53.484843 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2359c21d-bcff-415e-a779-702463f6bf7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13801179e3b145f1af900ab9c3d0317b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:22:53.489178 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2359c21d-bcff-415e-a779-702463f6bf7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13801179e3b145f1af900ab9c3d0317b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:22:53.526881 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2359c21d-bcff-415e-a779-702463f6bf7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13801179e3b145f1af900ab9c3d0317b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:22:53.528300 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2359c21d-bcff-415e-a779-702463f6bf7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13801179e3b145f1af900ab9c3d0317b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:22:53.549856 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 814/1642] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:22:53 2022] DELETE /identity/v3/users/13801179e3b145f1af900ab9c3d0317b => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:22:53.552962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad6092-4d03-4d22-9cb8-44c6178c7b2e None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:53.553265 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad6092-4d03-4d22-9cb8-44c6178c7b2e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:53.553547 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad6092-4d03-4d22-9cb8-44c6178c7b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:53.569130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359c21d-bcff-415e-a779-702463f6bf7b admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:53.571037 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2359c21d-bcff-415e-a779-702463f6bf7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:53.593087 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-d5ad6092-4d03-4d22-9cb8-44c6178c7b2e None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:53.594393 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d5ad6092-4d03-4d22-9cb8-44c6178c7b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:53.674279 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359c21d-bcff-415e-a779-702463f6bf7b admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:53.682936 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620d3b5-33a1-4f3b-81db-e74c41c034e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:53.683698 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620d3b5-33a1-4f3b-81db-e74c41c034e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:53.683986 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620d3b5-33a1-4f3b-81db-e74c41c034e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:53.684287 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620d3b5-33a1-4f3b-81db-e74c41c034e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:53.691149 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4620d3b5-33a1-4f3b-81db-e74c41c034e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:53.711826 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620d3b5-33a1-4f3b-81db-e74c41c034e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:53.713294 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620d3b5-33a1-4f3b-81db-e74c41c034e7 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:53.724086 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 815/1643] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:22:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:22:53.760799 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 829/1644] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:53.824418 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620d3b5-33a1-4f3b-81db-e74c41c034e7 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:53.835823 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620d3b5-33a1-4f3b-81db-e74c41c034e7 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:53.848000 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456ba30-95ff-499b-b7d7-b3a5ea960c55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:53.848726 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456ba30-95ff-499b-b7d7-b3a5ea960c55 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:53.849076 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456ba30-95ff-499b-b7d7-b3a5ea960c55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:53.849351 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456ba30-95ff-499b-b7d7-b3a5ea960c55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:53.878982 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456ba30-95ff-499b-b7d7-b3a5ea960c55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:53.881136 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456ba30-95ff-499b-b7d7-b3a5ea960c55 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:53.895541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad6092-4d03-4d22-9cb8-44c6178c7b2e None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:53.896946 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 816/1645] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:22:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:22:53.898201 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d5ad6092-4d03-4d22-9cb8-44c6178c7b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:53.941456 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad6092-4d03-4d22-9cb8-44c6178c7b2e None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:53.953045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96baaa4d-4379-4bf5-94d2-07715a203bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:53.955823 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96baaa4d-4379-4bf5-94d2-07715a203bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:53.956129 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96baaa4d-4379-4bf5-94d2-07715a203bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:53.957060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96baaa4d-4379-4bf5-94d2-07715a203bdb admin admin] PATH_INFO: `/v3/users/fdcfaa21e73d4b09bf0b97989f4d291a` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:53.959516 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96baaa4d-4379-4bf5-94d2-07715a203bdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdcfaa21e73d4b09bf0b97989f4d291a)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:53.964804 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96baaa4d-4379-4bf5-94d2-07715a203bdb admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:54.055488 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-96baaa4d-4379-4bf5-94d2-07715a203bdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdcfaa21e73d4b09bf0b97989f4d291a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:22:54.064405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-96baaa4d-4379-4bf5-94d2-07715a203bdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdcfaa21e73d4b09bf0b97989f4d291a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:22:54.065191 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-96baaa4d-4379-4bf5-94d2-07715a203bdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdcfaa21e73d4b09bf0b97989f4d291a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:22:54.066320 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-96baaa4d-4379-4bf5-94d2-07715a203bdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdcfaa21e73d4b09bf0b97989f4d291a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:22:54.085966 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-96baaa4d-4379-4bf5-94d2-07715a203bdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdcfaa21e73d4b09bf0b97989f4d291a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:22:54.108795 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 830/1646] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:22:53 2022] DELETE /identity/v3/users/fdcfaa21e73d4b09bf0b97989f4d291a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:22:54.115147 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033133e-57b4-40ee-b022-407cf21e738c None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:54.115466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033133e-57b4-40ee-b022-407cf21e738c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:54.115803 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033133e-57b4-40ee-b022-407cf21e738c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:54.138776 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-e033133e-57b4-40ee-b022-407cf21e738c None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:54.140243 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e033133e-57b4-40ee-b022-407cf21e738c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:54.241514 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 817/1647] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:54.311426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96baaa4d-4379-4bf5-94d2-07715a203bdb admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:54.315628 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-96baaa4d-4379-4bf5-94d2-07715a203bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:54.420751 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:22:54.427487 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96baaa4d-4379-4bf5-94d2-07715a203bdb admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:54.439002 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0f206-5325-4ae9-a134-ac6afaba83a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:54.439758 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0f206-5325-4ae9-a134-ac6afaba83a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:54.439875 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0f206-5325-4ae9-a134-ac6afaba83a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:54.440139 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0f206-5325-4ae9-a134-ac6afaba83a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:54.471845 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0f206-5325-4ae9-a134-ac6afaba83a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:54.473299 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0f206-5325-4ae9-a134-ac6afaba83a6 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:54.493321 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 831/1648] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:22:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:22:55.466734 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033133e-57b4-40ee-b022-407cf21e738c None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:55.466734 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e033133e-57b4-40ee-b022-407cf21e738c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:55.474281 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033133e-57b4-40ee-b022-407cf21e738c None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:55.491560 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd5ee3-d039-4a99-b2dd-585596e9018d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:55.492454 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd5ee3-d039-4a99-b2dd-585596e9018d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:55.492738 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd5ee3-d039-4a99-b2dd-585596e9018d admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:55.493017 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd5ee3-d039-4a99-b2dd-585596e9018d admin admin] PATH_INFO: `/v3/projects/728e5065908f47189cb9300d280b1c8f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:55.494305 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd5ee3-d039-4a99-b2dd-585596e9018d admin admin] RBAC: Authorizing `identity:delete_project(project_id=728e5065908f47189cb9300d280b1c8f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:55.497259 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd5ee3-d039-4a99-b2dd-585596e9018d admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:55.590791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:22:55.647708 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-8fdd5ee3-d039-4a99-b2dd-585596e9018d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '728e5065908f47189cb9300d280b1c8f', 'request_id': 'req-8fdd5ee3-d039-4a99-b2dd-585596e9018d'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:22:55.661386 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-8fdd5ee3-d039-4a99-b2dd-585596e9018d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '728e5065908f47189cb9300d280b1c8f', 'request_id': 'req-8fdd5ee3-d039-4a99-b2dd-585596e9018d'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:22:55.680038 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-8fdd5ee3-d039-4a99-b2dd-585596e9018d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '728e5065908f47189cb9300d280b1c8f', 'request_id': 'req-8fdd5ee3-d039-4a99-b2dd-585596e9018d'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:22:55.702328 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-8fdd5ee3-d039-4a99-b2dd-585596e9018d admin admin] The token cache is being invalidate because project 728e5065908f47189cb9300d280b1c8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:22:55.702745 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-8fdd5ee3-d039-4a99-b2dd-585596e9018d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:22:55.704438 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-8fdd5ee3-d039-4a99-b2dd-585596e9018d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:22:55.705566 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481db12f-8b33-42dc-9b4f-31737cea1bee None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:55.706055 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481db12f-8b33-42dc-9b4f-31737cea1bee None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:55.706207 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481db12f-8b33-42dc-9b4f-31737cea1bee None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:55.707376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 818/1649] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:22:55 2022] DELETE /identity/v3/projects/728e5065908f47189cb9300d280b1c8f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:22:55.707856 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 832/1650] 10.222.0.57 () {54 vars in 960 bytes} [Sat Jun 4 08:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:22:55.714450 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bdc51-4865-4a7d-a410-d6a3d47680e5 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:55.714771 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bdc51-4865-4a7d-a410-d6a3d47680e5 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:55.715057 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bdc51-4865-4a7d-a410-d6a3d47680e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:55.716018 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff5291-acc3-48e1-bf93-2415a6ac283d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:55.716440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff5291-acc3-48e1-bf93-2415a6ac283d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:55.716868 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff5291-acc3-48e1-bf93-2415a6ac283d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:55.746615 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-d67bdc51-4865-4a7d-a410-d6a3d47680e5 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:55.748685 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d67bdc51-4865-4a7d-a410-d6a3d47680e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:55.755744 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-ccff5291-acc3-48e1-bf93-2415a6ac283d None None] MFA Rules not processed for user `6fb6720f0d0141fea795cecfbf6f2538`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:55.757164 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ccff5291-acc3-48e1-bf93-2415a6ac283d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:55.930716 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 819/1651] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:55.931483 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bdc51-4865-4a7d-a410-d6a3d47680e5 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:55.939242 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d67bdc51-4865-4a7d-a410-d6a3d47680e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:55.942089 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 833/1652] 10.222.0.57 () {58 vars in 1057 bytes} [Sat Jun 4 08:22:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:22:55.943570 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5c243-bbea-41bd-a412-e149313ffbd7 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:55.943868 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5c243-bbea-41bd-a412-e149313ffbd7 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:55.944332 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5c243-bbea-41bd-a412-e149313ffbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:55.997745 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-a2b5c243-bbea-41bd-a412-e149313ffbd7 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:56.002089 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a2b5c243-bbea-41bd-a412-e149313ffbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:56.004431 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bdc51-4865-4a7d-a410-d6a3d47680e5 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:56.016492 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b497c2b-a66e-48b1-b5ec-6cbe38ba1393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:56.021525 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b497c2b-a66e-48b1-b5ec-6cbe38ba1393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:56.022224 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b497c2b-a66e-48b1-b5ec-6cbe38ba1393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:56.022612 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b497c2b-a66e-48b1-b5ec-6cbe38ba1393 admin admin] PATH_INFO: `/v3/projects/8ed2f65f0a9840bea8207bc03523ae8f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:56.026519 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 834/1653] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:56.027368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5c243-bbea-41bd-a412-e149313ffbd7 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:56.029802 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b497c2b-a66e-48b1-b5ec-6cbe38ba1393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ed2f65f0a9840bea8207bc03523ae8f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:56.033602 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b497c2b-a66e-48b1-b5ec-6cbe38ba1393 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:56.061992 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5c243-bbea-41bd-a412-e149313ffbd7 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:56.082624 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b6ce0-c8ca-4564-92a1-22760b576413 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fb6720f0d0141fea795cecfbf6f2538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:56.085388 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b6ce0-c8ca-4564-92a1-22760b576413 service placement] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:56.086273 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b6ce0-c8ca-4564-92a1-22760b576413 service placement] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:56.088029 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b6ce0-c8ca-4564-92a1-22760b576413 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:56.098323 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9d7b6ce0-c8ca-4564-92a1-22760b576413 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:56.130627 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b6ce0-c8ca-4564-92a1-22760b576413 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:56.136347 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b6ce0-c8ca-4564-92a1-22760b576413 service placement] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:56.161108 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 835/1654] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:22:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:22:56.174424 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b6ce0-c8ca-4564-92a1-22760b576413 service placement] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:56.199093 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2b497c2b-a66e-48b1-b5ec-6cbe38ba1393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ed2f65f0a9840bea8207bc03523ae8f', 'request_id': 'req-2b497c2b-a66e-48b1-b5ec-6cbe38ba1393'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:22:56.204028 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b6ce0-c8ca-4564-92a1-22760b576413 service placement] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:56.220175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2b497c2b-a66e-48b1-b5ec-6cbe38ba1393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ed2f65f0a9840bea8207bc03523ae8f', 'request_id': 'req-2b497c2b-a66e-48b1-b5ec-6cbe38ba1393'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:22:56.247657 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2b497c2b-a66e-48b1-b5ec-6cbe38ba1393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ed2f65f0a9840bea8207bc03523ae8f', 'request_id': 'req-2b497c2b-a66e-48b1-b5ec-6cbe38ba1393'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:22:56.267953 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2b497c2b-a66e-48b1-b5ec-6cbe38ba1393 admin admin] The token cache is being invalidate because project 8ed2f65f0a9840bea8207bc03523ae8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:22:56.270128 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2b497c2b-a66e-48b1-b5ec-6cbe38ba1393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:22:56.271082 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2b497c2b-a66e-48b1-b5ec-6cbe38ba1393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:22:56.273195 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 820/1655] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:22:55 2022] DELETE /identity/v3/projects/8ed2f65f0a9840bea8207bc03523ae8f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:22:56.279558 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b497c2b-a66e-48b1-b5ec-6cbe38ba1393 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:56.288934 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2b497c2b-a66e-48b1-b5ec-6cbe38ba1393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:56.346688 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a71f4a-4ae1-444b-9f4b-1ea365d2b93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:56.347490 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a71f4a-4ae1-444b-9f4b-1ea365d2b93a admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:56.347988 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a71f4a-4ae1-444b-9f4b-1ea365d2b93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:56.348341 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a71f4a-4ae1-444b-9f4b-1ea365d2b93a admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:56.349151 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a71f4a-4ae1-444b-9f4b-1ea365d2b93a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:22:56.349527 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a71f4a-4ae1-444b-9f4b-1ea365d2b93a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:56.352329 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a71f4a-4ae1-444b-9f4b-1ea365d2b93a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:56.374862 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 836/1656] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:22:56.377311 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a71f4a-4ae1-444b-9f4b-1ea365d2b93a admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:56.379585 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-82a71f4a-4ae1-444b-9f4b-1ea365d2b93a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:56.423508 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a71f4a-4ae1-444b-9f4b-1ea365d2b93a admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:56.430257 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:22:56.442358 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd9c39-6aa6-4538-a787-6435abb98ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:56.443047 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd9c39-6aa6-4538-a787-6435abb98ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:56.443329 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd9c39-6aa6-4538-a787-6435abb98ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:56.443644 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd9c39-6aa6-4538-a787-6435abb98ee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:56.444292 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd9c39-6aa6-4538-a787-6435abb98ee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:56.446286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd9c39-6aa6-4538-a787-6435abb98ee8 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:56.512308 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 837/1657] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:22:56 2022] POST /identity/v3/projects => generated 403 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:22:56.516415 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd9c39-6aa6-4538-a787-6435abb98ee8 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:56.539173 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b497c2b-a66e-48b1-b5ec-6cbe38ba1393 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:56.645748 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:22:56.654814 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62937cdf-7406-425d-b1ea-279e548e9034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:56.656002 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62937cdf-7406-425d-b1ea-279e548e9034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:56.656492 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62937cdf-7406-425d-b1ea-279e548e9034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:56.657428 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62937cdf-7406-425d-b1ea-279e548e9034 admin admin] PATH_INFO: `/v3/users/6151a3829d0c408a855ae9c74754823a` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:56.660738 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62937cdf-7406-425d-b1ea-279e548e9034 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6151a3829d0c408a855ae9c74754823a)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:56.662779 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62937cdf-7406-425d-b1ea-279e548e9034 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:56.746731 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd9c39-6aa6-4538-a787-6435abb98ee8 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:56.761234 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672376ef-1164-4d87-8f44-b5ebda1e0783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:56.764045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672376ef-1164-4d87-8f44-b5ebda1e0783 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:56.764359 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672376ef-1164-4d87-8f44-b5ebda1e0783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:56.764646 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672376ef-1164-4d87-8f44-b5ebda1e0783 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:56.765370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672376ef-1164-4d87-8f44-b5ebda1e0783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:56.775942 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672376ef-1164-4d87-8f44-b5ebda1e0783 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:56.808893 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-62937cdf-7406-425d-b1ea-279e548e9034 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6151a3829d0c408a855ae9c74754823a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:22:56.825363 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 838/1658] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:22:56 2022] POST /identity/v3/users => generated 302 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:22:56.829545 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672376ef-1164-4d87-8f44-b5ebda1e0783 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:56.830360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-62937cdf-7406-425d-b1ea-279e548e9034 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6151a3829d0c408a855ae9c74754823a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:22:56.833228 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-62937cdf-7406-425d-b1ea-279e548e9034 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6151a3829d0c408a855ae9c74754823a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:22:56.845117 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672376ef-1164-4d87-8f44-b5ebda1e0783 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:56.867759 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-62937cdf-7406-425d-b1ea-279e548e9034 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6151a3829d0c408a855ae9c74754823a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:22:56.868696 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-62937cdf-7406-425d-b1ea-279e548e9034 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6151a3829d0c408a855ae9c74754823a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:22:56.870295 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e492de-e21b-4671-b5b9-6547e02924ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:56.870987 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e492de-e21b-4671-b5b9-6547e02924ae admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:56.871273 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e492de-e21b-4671-b5b9-6547e02924ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:56.871549 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e492de-e21b-4671-b5b9-6547e02924ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:56.872280 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e492de-e21b-4671-b5b9-6547e02924ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:56.873932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e492de-e21b-4671-b5b9-6547e02924ae admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:56.896343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 821/1659] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:22:56 2022] DELETE /identity/v3/users/6151a3829d0c408a855ae9c74754823a => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:22:56.905980 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 839/1660] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:22:56.909735 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62937cdf-7406-425d-b1ea-279e548e9034 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:56.913240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-62937cdf-7406-425d-b1ea-279e548e9034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:57.089511 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62937cdf-7406-425d-b1ea-279e548e9034 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:57.099865 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15ec49-44ed-49f3-8dd6-2a8f2b7ed6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:57.100619 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15ec49-44ed-49f3-8dd6-2a8f2b7ed6c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:57.100910 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15ec49-44ed-49f3-8dd6-2a8f2b7ed6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:57.101341 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15ec49-44ed-49f3-8dd6-2a8f2b7ed6c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:57.102112 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea15ec49-44ed-49f3-8dd6-2a8f2b7ed6c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:57.106915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea15ec49-44ed-49f3-8dd6-2a8f2b7ed6c5 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:57.118550 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:22:57.135491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 822/1661] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:22:57.137275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e492de-e21b-4671-b5b9-6547e02924ae admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:57.157869 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e492de-e21b-4671-b5b9-6547e02924ae admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:57.163284 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25ebc2-9f99-46aa-a789-f70cbc45f348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:57.164188 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25ebc2-9f99-46aa-a789-f70cbc45f348 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:57.164482 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25ebc2-9f99-46aa-a789-f70cbc45f348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:57.164736 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25ebc2-9f99-46aa-a789-f70cbc45f348 admin admin] PATH_INFO: `/v3/projects/caa9ec61ae3e437e8bd8208e5c4a6331/users/75f7408bca714eaba8e0a7093c211333/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:57.208854 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25ebc2-9f99-46aa-a789-f70cbc45f348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caa9ec61ae3e437e8bd8208e5c4a6331, user_id=75f7408bca714eaba8e0a7093c211333, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:57.217263 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25ebc2-9f99-46aa-a789-f70cbc45f348 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:57.245085 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 840/1662] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:22:57 2022] PUT /identity/v3/projects/caa9ec61ae3e437e8bd8208e5c4a6331/users/75f7408bca714eaba8e0a7093c211333/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:22:57.251611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d544a-95fd-4d97-8a55-1d81fcbe2d7c None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:57.251901 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d544a-95fd-4d97-8a55-1d81fcbe2d7c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:57.252176 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d544a-95fd-4d97-8a55-1d81fcbe2d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:57.285944 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-855d544a-95fd-4d97-8a55-1d81fcbe2d7c None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:57.287206 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-855d544a-95fd-4d97-8a55-1d81fcbe2d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:57.427213 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 823/1663] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:57.480963 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25ebc2-9f99-46aa-a789-f70cbc45f348 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:57.483363 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6d25ebc2-9f99-46aa-a789-f70cbc45f348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:57.671631 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25ebc2-9f99-46aa-a789-f70cbc45f348 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:57.675839 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809a956-839f-4af8-a68a-26a73b71c1cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:57.676901 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809a956-839f-4af8-a68a-26a73b71c1cd service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:57.677284 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809a956-839f-4af8-a68a-26a73b71c1cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:57.677660 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809a956-839f-4af8-a68a-26a73b71c1cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:57.693713 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809a956-839f-4af8-a68a-26a73b71c1cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:57.695553 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809a956-839f-4af8-a68a-26a73b71c1cd service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:57.709570 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 841/1664] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:22:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:22:57.943691 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d544a-95fd-4d97-8a55-1d81fcbe2d7c None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:57.945801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-855d544a-95fd-4d97-8a55-1d81fcbe2d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:57.975277 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d544a-95fd-4d97-8a55-1d81fcbe2d7c None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:57.990247 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d46c0-64c0-405d-bad8-ccee57895771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:57.991454 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d46c0-64c0-405d-bad8-ccee57895771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:57.993939 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d46c0-64c0-405d-bad8-ccee57895771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:57.996189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d46c0-64c0-405d-bad8-ccee57895771 admin admin] PATH_INFO: `/v3/projects/54060c9224ca4702aaad60d31cde4d18` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:57.999845 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d46c0-64c0-405d-bad8-ccee57895771 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54060c9224ca4702aaad60d31cde4d18)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:58.007384 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d46c0-64c0-405d-bad8-ccee57895771 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:58.101770 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-623d46c0-64c0-405d-bad8-ccee57895771 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54060c9224ca4702aaad60d31cde4d18', 'request_id': 'req-623d46c0-64c0-405d-bad8-ccee57895771'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:22:58.110273 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-623d46c0-64c0-405d-bad8-ccee57895771 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54060c9224ca4702aaad60d31cde4d18', 'request_id': 'req-623d46c0-64c0-405d-bad8-ccee57895771'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:22:58.137663 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-623d46c0-64c0-405d-bad8-ccee57895771 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54060c9224ca4702aaad60d31cde4d18', 'request_id': 'req-623d46c0-64c0-405d-bad8-ccee57895771'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:22:58.156571 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-623d46c0-64c0-405d-bad8-ccee57895771 admin admin] The token cache is being invalidate because project 54060c9224ca4702aaad60d31cde4d18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:22:58.156994 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-623d46c0-64c0-405d-bad8-ccee57895771 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:22:58.158776 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-623d46c0-64c0-405d-bad8-ccee57895771 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:22:58.164628 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 824/1665] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:22:57 2022] DELETE /identity/v3/projects/54060c9224ca4702aaad60d31cde4d18 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:22:58.166864 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521014c-f787-4e76-aede-44d084c0a4b1 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:58.167355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521014c-f787-4e76-aede-44d084c0a4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:58.167580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521014c-f787-4e76-aede-44d084c0a4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:58.216450 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-0521014c-f787-4e76-aede-44d084c0a4b1 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:58.220777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0521014c-f787-4e76-aede-44d084c0a4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:58.429467 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 842/1666] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:58.431633 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff2a63-3299-43fe-b619-55719e308b1b None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:58.432352 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff2a63-3299-43fe-b619-55719e308b1b None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:58.432510 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff2a63-3299-43fe-b619-55719e308b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:58.487625 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-a3ff2a63-3299-43fe-b619-55719e308b1b None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:58.489106 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a3ff2a63-3299-43fe-b619-55719e308b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:58.512183 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 825/1667] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:58.515222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521014c-f787-4e76-aede-44d084c0a4b1 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:58.530092 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521014c-f787-4e76-aede-44d084c0a4b1 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:58.541398 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed899ed4-7ff7-4c68-927b-437d91d6aaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:58.542346 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed899ed4-7ff7-4c68-927b-437d91d6aaec admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:58.542632 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed899ed4-7ff7-4c68-927b-437d91d6aaec admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:58.542945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed899ed4-7ff7-4c68-927b-437d91d6aaec admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:58.543634 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed899ed4-7ff7-4c68-927b-437d91d6aaec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:22:58.543947 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed899ed4-7ff7-4c68-927b-437d91d6aaec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:58.545744 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed899ed4-7ff7-4c68-927b-437d91d6aaec admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:58.599709 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 843/1668] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:22:58.604161 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff2a63-3299-43fe-b619-55719e308b1b None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:58.637628 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff2a63-3299-43fe-b619-55719e308b1b None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:58.646572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2219e8-5510-45e9-91cf-7575650d86e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:58.647316 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2219e8-5510-45e9-91cf-7575650d86e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:58.647605 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2219e8-5510-45e9-91cf-7575650d86e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:58.647881 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2219e8-5510-45e9-91cf-7575650d86e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:58.648582 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2219e8-5510-45e9-91cf-7575650d86e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:58.653019 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2219e8-5510-45e9-91cf-7575650d86e9 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:58.722961 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed899ed4-7ff7-4c68-927b-437d91d6aaec admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:58.729977 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 826/1669] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:22:58 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:22:58.736206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed899ed4-7ff7-4c68-927b-437d91d6aaec admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:58.855636 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:22:58.955216 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f0719-946a-4ff9-b920-1289996b90aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:58.958354 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f0719-946a-4ff9-b920-1289996b90aa admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:58.958354 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f0719-946a-4ff9-b920-1289996b90aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:58.958354 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f0719-946a-4ff9-b920-1289996b90aa admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:58.958354 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f0719-946a-4ff9-b920-1289996b90aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:58.961483 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f0719-946a-4ff9-b920-1289996b90aa admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:59.000305 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 844/1670] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:22:58 2022] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:22:59.002680 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2219e8-5510-45e9-91cf-7575650d86e9 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:59.038340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2219e8-5510-45e9-91cf-7575650d86e9 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:59.056259 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba566e-207a-4c2a-b45d-a748d1384406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:59.057882 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba566e-207a-4c2a-b45d-a748d1384406 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:59.058390 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba566e-207a-4c2a-b45d-a748d1384406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:59.058710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba566e-207a-4c2a-b45d-a748d1384406 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:59.059872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba566e-207a-4c2a-b45d-a748d1384406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:59.061667 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba566e-207a-4c2a-b45d-a748d1384406 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:59.079382 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 827/1671] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:22:59.084382 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f0719-946a-4ff9-b920-1289996b90aa admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:59.114514 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f0719-946a-4ff9-b920-1289996b90aa admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:59.147107 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48163e-5587-40cf-a339-fd483a2e24c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:59.148052 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48163e-5587-40cf-a339-fd483a2e24c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:59.148610 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48163e-5587-40cf-a339-fd483a2e24c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:59.149476 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48163e-5587-40cf-a339-fd483a2e24c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:59.151854 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48163e-5587-40cf-a339-fd483a2e24c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:59.160578 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48163e-5587-40cf-a339-fd483a2e24c8 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:59.187892 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 845/1672] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:22:59.193321 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba566e-207a-4c2a-b45d-a748d1384406 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:59.220660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba566e-207a-4c2a-b45d-a748d1384406 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:59.244371 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d234d9c-f95f-4d98-97ee-4a44958a67ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:59.254096 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d234d9c-f95f-4d98-97ee-4a44958a67ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:59.256016 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d234d9c-f95f-4d98-97ee-4a44958a67ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:59.256964 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d234d9c-f95f-4d98-97ee-4a44958a67ee admin admin] PATH_INFO: `/v3/projects/71da9cf8dd7c4c549539f8a3641f18d1/users/287c2f74d0304e7d8345113e593ad04c/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:59.313780 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d234d9c-f95f-4d98-97ee-4a44958a67ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=71da9cf8dd7c4c549539f8a3641f18d1, user_id=287c2f74d0304e7d8345113e593ad04c, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:59.317279 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d234d9c-f95f-4d98-97ee-4a44958a67ee admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:22:59.355561 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 828/1673] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:22:59 2022] PUT /identity/v3/projects/71da9cf8dd7c4c549539f8a3641f18d1/users/287c2f74d0304e7d8345113e593ad04c/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:22:59.368153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57ae8c-48d5-4604-83c7-746f2e754857 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:59.371931 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57ae8c-48d5-4604-83c7-746f2e754857 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:59.372733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57ae8c-48d5-4604-83c7-746f2e754857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:59.484211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-1d57ae8c-48d5-4604-83c7-746f2e754857 None None] MFA Rules not processed for user `287c2f74d0304e7d8345113e593ad04c`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:59.486908 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-1d57ae8c-48d5-4604-83c7-746f2e754857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:59.710633 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 846/1674] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:22:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:22:59.711414 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d234d9c-f95f-4d98-97ee-4a44958a67ee admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:22:59.770989 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049ba00-7999-41ed-8561-2182137548e1 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:59.771282 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049ba00-7999-41ed-8561-2182137548e1 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:59.771723 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049ba00-7999-41ed-8561-2182137548e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:59.774092 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:22:59.852818 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-d049ba00-7999-41ed-8561-2182137548e1 None None] MFA Rules not processed for user `aff5d82384e84b669eeb00089ab8e09a`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:22:59.860974 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d049ba00-7999-41ed-8561-2182137548e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:22:59.925165 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d234d9c-f95f-4d98-97ee-4a44958a67ee admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:22:59.943375 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cfe1b-840b-437a-8bab-8a2401a8fdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:22:59.945090 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cfe1b-840b-437a-8bab-8a2401a8fdd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:22:59.945090 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cfe1b-840b-437a-8bab-8a2401a8fdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:22:59.947827 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cfe1b-840b-437a-8bab-8a2401a8fdd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:22:59.950346 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02cfe1b-840b-437a-8bab-8a2401a8fdd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:22:59.958176 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02cfe1b-840b-437a-8bab-8a2401a8fdd8 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:00.032507 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 829/1675] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:22:59 2022] POST /identity/v3/projects => generated 385 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:23:00.033413 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cfe1b-840b-437a-8bab-8a2401a8fdd8 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:00.081220 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 847/1676] 10.222.0.57 () {58 vars in 1009 bytes} [Sat Jun 4 08:22:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:23:00.284934 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cfe1b-840b-437a-8bab-8a2401a8fdd8 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:00.292119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863853bb-6e36-4667-b770-f542d8a3ed1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:00.293439 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863853bb-6e36-4667-b770-f542d8a3ed1f admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:00.293726 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863853bb-6e36-4667-b770-f542d8a3ed1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:00.294031 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863853bb-6e36-4667-b770-f542d8a3ed1f admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:00.294733 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863853bb-6e36-4667-b770-f542d8a3ed1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:00.296692 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863853bb-6e36-4667-b770-f542d8a3ed1f admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:00.340164 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 830/1677] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:23:00 2022] POST /identity/v3/users => generated 299 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:23:00.346240 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049ba00-7999-41ed-8561-2182137548e1 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:00.366412 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049ba00-7999-41ed-8561-2182137548e1 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:00.374177 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854d502-150c-46b2-a07c-fd67fd7fdad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:00.374879 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854d502-150c-46b2-a07c-fd67fd7fdad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:00.375258 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854d502-150c-46b2-a07c-fd67fd7fdad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:00.375457 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854d502-150c-46b2-a07c-fd67fd7fdad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:00.376195 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854d502-150c-46b2-a07c-fd67fd7fdad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:00.377971 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854d502-150c-46b2-a07c-fd67fd7fdad3 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:00.378460 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863853bb-6e36-4667-b770-f542d8a3ed1f admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:00.380201 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-863853bb-6e36-4667-b770-f542d8a3ed1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:00.416093 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 848/1678] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:23:00.421286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854d502-150c-46b2-a07c-fd67fd7fdad3 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:00.458879 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854d502-150c-46b2-a07c-fd67fd7fdad3 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:00.481676 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091da648-1474-4019-9580-812cec8d9d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:00.485382 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091da648-1474-4019-9580-812cec8d9d34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:00.485692 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091da648-1474-4019-9580-812cec8d9d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:00.486013 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091da648-1474-4019-9580-812cec8d9d34 admin admin] PATH_INFO: `/v3/projects/93f0d090538c4d5b9f44074de7b6e000/users/7ec3b5fd973846da932aaa7293105d94/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:00.525875 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091da648-1474-4019-9580-812cec8d9d34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93f0d090538c4d5b9f44074de7b6e000, user_id=7ec3b5fd973846da932aaa7293105d94, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:00.537703 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091da648-1474-4019-9580-812cec8d9d34 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:00.542066 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863853bb-6e36-4667-b770-f542d8a3ed1f admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:00.549065 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1162cac-1cc5-43d4-ab1a-18368a36c161 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05ea412cab4244c58a2670c66f5a311c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:00.549532 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1162cac-1cc5-43d4-ab1a-18368a36c161 service swift] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:00.549942 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1162cac-1cc5-43d4-ab1a-18368a36c161 service swift] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:00.550226 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1162cac-1cc5-43d4-ab1a-18368a36c161 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:00.589539 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 849/1679] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:23:00 2022] PUT /identity/v3/projects/93f0d090538c4d5b9f44074de7b6e000/users/7ec3b5fd973846da932aaa7293105d94/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:00.595146 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091da648-1474-4019-9580-812cec8d9d34 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:00.599752 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:00.603957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:00.637346 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1162cac-1cc5-43d4-ab1a-18368a36c161 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:00.639746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1162cac-1cc5-43d4-ab1a-18368a36c161 service swift] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:00.673046 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 831/1680] 10.222.0.57 () {60 vars in 1384 bytes} [Sat Jun 4 08:23:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 04 08:23:00.826250 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091da648-1474-4019-9580-812cec8d9d34 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:00.851426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02945aa5-e10e-4ad8-8fed-99277937c1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:00.852139 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02945aa5-e10e-4ad8-8fed-99277937c1dd admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:00.852484 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02945aa5-e10e-4ad8-8fed-99277937c1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:00.852738 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02945aa5-e10e-4ad8-8fed-99277937c1dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:00.853542 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02945aa5-e10e-4ad8-8fed-99277937c1dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:00.855321 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02945aa5-e10e-4ad8-8fed-99277937c1dd admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:00.898804 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 850/1681] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:23:00.900097 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1162cac-1cc5-43d4-ab1a-18368a36c161 service swift] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:00.955386 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1162cac-1cc5-43d4-ab1a-18368a36c161 service swift] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:00.972922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b488d-1afb-4a32-8cc3-8c575351f307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:00.978734 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b488d-1afb-4a32-8cc3-8c575351f307 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:00.979131 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b488d-1afb-4a32-8cc3-8c575351f307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:00.979419 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b488d-1afb-4a32-8cc3-8c575351f307 admin admin] PATH_INFO: `/v3/projects/93f0d090538c4d5b9f44074de7b6e000/users/7ec3b5fd973846da932aaa7293105d94/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:00.989116 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b488d-1afb-4a32-8cc3-8c575351f307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93f0d090538c4d5b9f44074de7b6e000, user_id=7ec3b5fd973846da932aaa7293105d94, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:00.997351 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b488d-1afb-4a32-8cc3-8c575351f307 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:01.040366 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 832/1682] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:23:00 2022] PUT /identity/v3/projects/93f0d090538c4d5b9f44074de7b6e000/users/7ec3b5fd973846da932aaa7293105d94/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:01.055193 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b47af-b6d3-4363-a241-362b30016ba2 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:01.055804 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b47af-b6d3-4363-a241-362b30016ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:01.056510 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b47af-b6d3-4363-a241-362b30016ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:01.156546 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-d60b47af-b6d3-4363-a241-362b30016ba2 None None] MFA Rules not processed for user `7ec3b5fd973846da932aaa7293105d94`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:01.159331 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d60b47af-b6d3-4363-a241-362b30016ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:01.203773 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b488d-1afb-4a32-8cc3-8c575351f307 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:01.205250 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-595b488d-1afb-4a32-8cc3-8c575351f307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:01.372039 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 851/1683] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:01.390921 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b47af-b6d3-4363-a241-362b30016ba2 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:01.393765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d60b47af-b6d3-4363-a241-362b30016ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:01.427759 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b488d-1afb-4a32-8cc3-8c575351f307 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:01.453469 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6e42c-078d-424f-9158-11f3dabf8e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:01.454581 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6e42c-078d-424f-9158-11f3dabf8e44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:01.454940 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6e42c-078d-424f-9158-11f3dabf8e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:01.455320 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6e42c-078d-424f-9158-11f3dabf8e44 admin admin] PATH_INFO: `/v3/users/5c5e96bd766a458a9c576b631c73a783` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:01.459762 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6e42c-078d-424f-9158-11f3dabf8e44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c5e96bd766a458a9c576b631c73a783)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:01.462103 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6e42c-078d-424f-9158-11f3dabf8e44 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:01.567938 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-17a6e42c-078d-424f-9158-11f3dabf8e44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c5e96bd766a458a9c576b631c73a783'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:01.597630 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-17a6e42c-078d-424f-9158-11f3dabf8e44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c5e96bd766a458a9c576b631c73a783'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:01.598379 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-17a6e42c-078d-424f-9158-11f3dabf8e44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c5e96bd766a458a9c576b631c73a783'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:01.602833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b47af-b6d3-4363-a241-362b30016ba2 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:01.615905 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c4976-4a3b-42dc-830d-01defc6e6ec0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:01.616596 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c4976-4a3b-42dc-830d-01defc6e6ec0 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:01.619304 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c4976-4a3b-42dc-830d-01defc6e6ec0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:01.619640 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c4976-4a3b-42dc-830d-01defc6e6ec0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:01.634532 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-17a6e42c-078d-424f-9158-11f3dabf8e44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c5e96bd766a458a9c576b631c73a783'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:01.637016 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-17a6e42c-078d-424f-9158-11f3dabf8e44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c5e96bd766a458a9c576b631c73a783'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:01.665952 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c4976-4a3b-42dc-830d-01defc6e6ec0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:01.678949 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c4976-4a3b-42dc-830d-01defc6e6ec0 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:01.681009 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 833/1684] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:23:01 2022] DELETE /identity/v3/users/5c5e96bd766a458a9c576b631c73a783 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:23:01.685453 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76725e-1c7d-497c-9cfe-54d858f08d10 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:01.685896 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76725e-1c7d-497c-9cfe-54d858f08d10 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:01.686518 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76725e-1c7d-497c-9cfe-54d858f08d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:01.725025 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 852/1685] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:23:01.761338 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-5c76725e-1c7d-497c-9cfe-54d858f08d10 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:01.767333 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-5c76725e-1c7d-497c-9cfe-54d858f08d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:01.932368 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:01.966016 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c4976-4a3b-42dc-830d-01defc6e6ec0 service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:01.985490 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c4976-4a3b-42dc-830d-01defc6e6ec0 service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:02.002859 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02835db3-7d94-4d5b-a238-988eeaa7d918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:02.003775 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02835db3-7d94-4d5b-a238-988eeaa7d918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:02.005045 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 834/1686] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:02.007019 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02835db3-7d94-4d5b-a238-988eeaa7d918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:02.007370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02835db3-7d94-4d5b-a238-988eeaa7d918 admin admin] PATH_INFO: `/v3/users/287c2f74d0304e7d8345113e593ad04c` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:02.021010 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02835db3-7d94-4d5b-a238-988eeaa7d918 admin admin] RBAC: Authorizing `identity:delete_user(user_id=287c2f74d0304e7d8345113e593ad04c)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:02.023186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02835db3-7d94-4d5b-a238-988eeaa7d918 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:02.121529 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:02.209939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-02835db3-7d94-4d5b-a238-988eeaa7d918 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '287c2f74d0304e7d8345113e593ad04c'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:02.229033 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76725e-1c7d-497c-9cfe-54d858f08d10 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:02.230721 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-5c76725e-1c7d-497c-9cfe-54d858f08d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:02.270720 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-02835db3-7d94-4d5b-a238-988eeaa7d918 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '287c2f74d0304e7d8345113e593ad04c'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:02.271691 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-02835db3-7d94-4d5b-a238-988eeaa7d918 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '287c2f74d0304e7d8345113e593ad04c'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:02.272334 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-02835db3-7d94-4d5b-a238-988eeaa7d918 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '287c2f74d0304e7d8345113e593ad04c'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:02.342275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-02835db3-7d94-4d5b-a238-988eeaa7d918 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '287c2f74d0304e7d8345113e593ad04c'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:02.368795 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 853/1687] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:23:01 2022] DELETE /identity/v3/users/287c2f74d0304e7d8345113e593ad04c => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:02.374418 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc4508-d91f-4813-8b8c-dcabd2e120fb None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:02.375646 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc4508-d91f-4813-8b8c-dcabd2e120fb None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:02.375891 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc4508-d91f-4813-8b8c-dcabd2e120fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:02.420221 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-30fc4508-d91f-4813-8b8c-dcabd2e120fb None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:02.426758 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-30fc4508-d91f-4813-8b8c-dcabd2e120fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:02.443356 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76725e-1c7d-497c-9cfe-54d858f08d10 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:02.570215 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42f98f-8d99-49cd-8337-80f3f6bd8251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:02.570780 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42f98f-8d99-49cd-8337-80f3f6bd8251 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:02.571494 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42f98f-8d99-49cd-8337-80f3f6bd8251 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:02.571918 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42f98f-8d99-49cd-8337-80f3f6bd8251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:02.575832 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-db42f98f-8d99-49cd-8337-80f3f6bd8251 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:02.596540 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 854/1688] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:02.660980 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc4508-d91f-4813-8b8c-dcabd2e120fb None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:02.663907 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-30fc4508-d91f-4813-8b8c-dcabd2e120fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:02.707758 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc4508-d91f-4813-8b8c-dcabd2e120fb None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:02.719514 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b5fc9-f319-4c7c-90bc-45a7a87858b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:02.720281 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b5fc9-f319-4c7c-90bc-45a7a87858b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:02.722782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b5fc9-f319-4c7c-90bc-45a7a87858b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:02.723093 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b5fc9-f319-4c7c-90bc-45a7a87858b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:02.747321 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b5fc9-f319-4c7c-90bc-45a7a87858b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:02.748800 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b5fc9-f319-4c7c-90bc-45a7a87858b9 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:02.782335 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 855/1689] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:23:02.802659 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42f98f-8d99-49cd-8337-80f3f6bd8251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:02.804283 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42f98f-8d99-49cd-8337-80f3f6bd8251 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:02.822592 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 835/1690] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:23:04.384428 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2df971-d4e0-44fb-b3b6-567c974e9ffc None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:04.385008 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2df971-d4e0-44fb-b3b6-567c974e9ffc None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:04.386126 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2df971-d4e0-44fb-b3b6-567c974e9ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:04.436057 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-0f2df971-d4e0-44fb-b3b6-567c974e9ffc None None] MFA Rules not processed for user `5fd5768a512c4177abae05f4ccd5c59f`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:04.439554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0f2df971-d4e0-44fb-b3b6-567c974e9ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:04.467554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 856/1691] 10.222.0.77 () {58 vars in 1015 bytes} [Sat Jun 4 08:23:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:04.566181 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42f98f-8d99-49cd-8337-80f3f6bd8251 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:04.570301 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-db42f98f-8d99-49cd-8337-80f3f6bd8251 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:04.603383 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42f98f-8d99-49cd-8337-80f3f6bd8251 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:04.621999 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc9042-4046-472d-9077-7e665f36b04c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:04.622626 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc9042-4046-472d-9077-7e665f36b04c service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:04.622957 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc9042-4046-472d-9077-7e665f36b04c service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:04.623297 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc9042-4046-472d-9077-7e665f36b04c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:04.667459 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc9042-4046-472d-9077-7e665f36b04c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:04.679926 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc9042-4046-472d-9077-7e665f36b04c service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:04.712565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 836/1692] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:23:05.043891 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2df971-d4e0-44fb-b3b6-567c974e9ffc None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:05.045637 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0f2df971-d4e0-44fb-b3b6-567c974e9ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:05.080323 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2df971-d4e0-44fb-b3b6-567c974e9ffc None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:05.110916 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279a4c9-a04c-451f-9843-47d66c2f613b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:05.112160 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279a4c9-a04c-451f-9843-47d66c2f613b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:05.114428 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279a4c9-a04c-451f-9843-47d66c2f613b admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:05.115234 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279a4c9-a04c-451f-9843-47d66c2f613b admin admin] PATH_INFO: `/v3/projects/71da9cf8dd7c4c549539f8a3641f18d1` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:05.120895 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279a4c9-a04c-451f-9843-47d66c2f613b admin admin] RBAC: Authorizing `identity:delete_project(project_id=71da9cf8dd7c4c549539f8a3641f18d1)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:05.123450 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: WARNING py.warnings [None req-5279a4c9-a04c-451f-9843-47d66c2f613b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 08:23:05.123450 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: warnings.warn(msg) Jun 04 08:23:05.123450 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: Jun 04 08:23:05.127398 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279a4c9-a04c-451f-9843-47d66c2f613b admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:05.219387 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc9042-4046-472d-9077-7e665f36b04c service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:05.221850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-30cc9042-4046-472d-9077-7e665f36b04c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:05.274879 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc9042-4046-472d-9077-7e665f36b04c service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:05.302310 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde1b03-4a09-4c63-ab5e-3a1b9493b047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:05.305966 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde1b03-4a09-4c63-ab5e-3a1b9493b047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:05.307294 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde1b03-4a09-4c63-ab5e-3a1b9493b047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:05.308200 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde1b03-4a09-4c63-ab5e-3a1b9493b047 admin admin] PATH_INFO: `/v3/projects/8035faea1d8347028ba7d2955f247d83` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:05.314221 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde1b03-4a09-4c63-ab5e-3a1b9493b047 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8035faea1d8347028ba7d2955f247d83)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:05.334659 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde1b03-4a09-4c63-ab5e-3a1b9493b047 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:05.392124 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-5279a4c9-a04c-451f-9843-47d66c2f613b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71da9cf8dd7c4c549539f8a3641f18d1', 'request_id': 'req-5279a4c9-a04c-451f-9843-47d66c2f613b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:05.429173 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-5279a4c9-a04c-451f-9843-47d66c2f613b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71da9cf8dd7c4c549539f8a3641f18d1', 'request_id': 'req-5279a4c9-a04c-451f-9843-47d66c2f613b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:05.454723 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-5279a4c9-a04c-451f-9843-47d66c2f613b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71da9cf8dd7c4c549539f8a3641f18d1', 'request_id': 'req-5279a4c9-a04c-451f-9843-47d66c2f613b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:05.467051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:05.482295 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-5279a4c9-a04c-451f-9843-47d66c2f613b admin admin] The token cache is being invalidate because project 71da9cf8dd7c4c549539f8a3641f18d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:23:05.482653 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-5279a4c9-a04c-451f-9843-47d66c2f613b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:05.486277 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-5279a4c9-a04c-451f-9843-47d66c2f613b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:05.488544 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 857/1693] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:23:05 2022] DELETE /identity/v3/projects/71da9cf8dd7c4c549539f8a3641f18d1 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:05.493480 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279a4c9-a04c-451f-9843-47d66c2f613b admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:05.506370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-5279a4c9-a04c-451f-9843-47d66c2f613b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:05.516970 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:05.517721 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-6dde1b03-4a09-4c63-ab5e-3a1b9493b047 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8035faea1d8347028ba7d2955f247d83', 'request_id': 'req-6dde1b03-4a09-4c63-ab5e-3a1b9493b047'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:05.545413 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-6dde1b03-4a09-4c63-ab5e-3a1b9493b047 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8035faea1d8347028ba7d2955f247d83', 'request_id': 'req-6dde1b03-4a09-4c63-ab5e-3a1b9493b047'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:05.579624 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-6dde1b03-4a09-4c63-ab5e-3a1b9493b047 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8035faea1d8347028ba7d2955f247d83', 'request_id': 'req-6dde1b03-4a09-4c63-ab5e-3a1b9493b047'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:05.598958 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-6dde1b03-4a09-4c63-ab5e-3a1b9493b047 admin admin] The token cache is being invalidate because project 8035faea1d8347028ba7d2955f247d83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:23:05.599599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-6dde1b03-4a09-4c63-ab5e-3a1b9493b047 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:05.600650 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-6dde1b03-4a09-4c63-ab5e-3a1b9493b047 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:05.604390 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 837/1694] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:23:05 2022] DELETE /identity/v3/projects/8035faea1d8347028ba7d2955f247d83 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:05.611079 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c49387-9a7d-412a-8648-8c5e09f547a6 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:05.611612 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c49387-9a7d-412a-8648-8c5e09f547a6 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:05.612827 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c49387-9a7d-412a-8648-8c5e09f547a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:05.673011 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279a4c9-a04c-451f-9843-47d66c2f613b admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:05.716035 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-a8c49387-9a7d-412a-8648-8c5e09f547a6 None None] MFA Rules not processed for user `75f7408bca714eaba8e0a7093c211333`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:05.719802 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a8c49387-9a7d-412a-8648-8c5e09f547a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:05.828674 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f843dc0-492a-4c25-a348-40d3ea293715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:05.829963 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f843dc0-492a-4c25-a348-40d3ea293715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:05.830127 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f843dc0-492a-4c25-a348-40d3ea293715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:05.830409 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f843dc0-492a-4c25-a348-40d3ea293715 admin admin] PATH_INFO: `/v3/users/7ec3b5fd973846da932aaa7293105d94` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:05.831809 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f843dc0-492a-4c25-a348-40d3ea293715 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ec3b5fd973846da932aaa7293105d94)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:05.835258 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f843dc0-492a-4c25-a348-40d3ea293715 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:05.976551 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0f843dc0-492a-4c25-a348-40d3ea293715 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ec3b5fd973846da932aaa7293105d94'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:05.982569 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 838/1695] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:05.985361 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c64e9f-6d60-4ba0-a379-33c57b2ca28c None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:05.985610 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c64e9f-6d60-4ba0-a379-33c57b2ca28c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:05.988350 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c64e9f-6d60-4ba0-a379-33c57b2ca28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:05.998578 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0f843dc0-492a-4c25-a348-40d3ea293715 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ec3b5fd973846da932aaa7293105d94'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:06.001667 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0f843dc0-492a-4c25-a348-40d3ea293715 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ec3b5fd973846da932aaa7293105d94'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:06.006028 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0f843dc0-492a-4c25-a348-40d3ea293715 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ec3b5fd973846da932aaa7293105d94'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:06.032852 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0f843dc0-492a-4c25-a348-40d3ea293715 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ec3b5fd973846da932aaa7293105d94'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:06.062609 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 858/1696] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:23:05 2022] DELETE /identity/v3/users/7ec3b5fd973846da932aaa7293105d94 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:23:06.063626 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f843dc0-492a-4c25-a348-40d3ea293715 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:06.068449 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0f843dc0-492a-4c25-a348-40d3ea293715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:06.073023 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-c0c64e9f-6d60-4ba0-a379-33c57b2ca28c None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:06.074276 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c0c64e9f-6d60-4ba0-a379-33c57b2ca28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:06.149554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:06.231640 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f843dc0-492a-4c25-a348-40d3ea293715 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:06.243240 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a8237-814e-4b55-bb1d-421556ee75ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:06.243991 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a8237-814e-4b55-bb1d-421556ee75ef admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:06.244277 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a8237-814e-4b55-bb1d-421556ee75ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:06.244624 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a8237-814e-4b55-bb1d-421556ee75ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:06.245384 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a8237-814e-4b55-bb1d-421556ee75ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:06.249973 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a8237-814e-4b55-bb1d-421556ee75ef admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:06.303431 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 839/1697] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:06.313350 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26054cd-850b-4b6f-a7a1-1ad6d53559c4 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:06.313761 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26054cd-850b-4b6f-a7a1-1ad6d53559c4 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:06.314139 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 859/1698] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:23:06 2022] POST /identity/v3/projects => generated 405 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:23:06.314289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26054cd-850b-4b6f-a7a1-1ad6d53559c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:06.315227 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a8237-814e-4b55-bb1d-421556ee75ef admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:06.372842 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-f26054cd-850b-4b6f-a7a1-1ad6d53559c4 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:06.374292 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f26054cd-850b-4b6f-a7a1-1ad6d53559c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:06.405223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a8237-814e-4b55-bb1d-421556ee75ef admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:06.412635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da902e12-6cde-4206-a033-5d19196e23ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:06.413424 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da902e12-6cde-4206-a033-5d19196e23ba admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:06.413656 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da902e12-6cde-4206-a033-5d19196e23ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:06.414132 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da902e12-6cde-4206-a033-5d19196e23ba admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:06.415253 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da902e12-6cde-4206-a033-5d19196e23ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:06.417015 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da902e12-6cde-4206-a033-5d19196e23ba admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:06.459569 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 860/1699] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:23:06 2022] POST /identity/v3/users => generated 309 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:23:06.460625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da902e12-6cde-4206-a033-5d19196e23ba admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:06.484883 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da902e12-6cde-4206-a033-5d19196e23ba admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:06.499145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfc473-df80-4820-8ddc-1c1fac47c669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:06.499528 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfc473-df80-4820-8ddc-1c1fac47c669 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:06.500362 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfc473-df80-4820-8ddc-1c1fac47c669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:06.502078 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfc473-df80-4820-8ddc-1c1fac47c669 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:06.503594 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cfc473-df80-4820-8ddc-1c1fac47c669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:06.508644 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cfc473-df80-4820-8ddc-1c1fac47c669 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:06.517245 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:06.542015 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 861/1700] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:23:06.551165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfc473-df80-4820-8ddc-1c1fac47c669 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:06.574108 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 840/1701] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:06.578891 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26054cd-850b-4b6f-a7a1-1ad6d53559c4 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:06.581311 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfc473-df80-4820-8ddc-1c1fac47c669 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:06.600473 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26054cd-850b-4b6f-a7a1-1ad6d53559c4 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:06.603752 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a490cb-b15d-4e2c-b78e-6de886f7334a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:06.604723 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a490cb-b15d-4e2c-b78e-6de886f7334a admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:06.605242 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a490cb-b15d-4e2c-b78e-6de886f7334a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:06.605547 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a490cb-b15d-4e2c-b78e-6de886f7334a admin admin] PATH_INFO: `/v3/projects/ecddcc9579614c689584e857e2d3e3e9/users/a92f463178274eb38b3c2fdb67a62afb/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:06.612919 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125d79f-b8a3-4878-927f-af032e3c028a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:06.614097 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125d79f-b8a3-4878-927f-af032e3c028a admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:06.614097 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125d79f-b8a3-4878-927f-af032e3c028a admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:06.614313 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125d79f-b8a3-4878-927f-af032e3c028a admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:06.615264 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125d79f-b8a3-4878-927f-af032e3c028a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:23:06.615584 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125d79f-b8a3-4878-927f-af032e3c028a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:06.618246 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125d79f-b8a3-4878-927f-af032e3c028a admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:06.644248 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 841/1702] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:23:06.648625 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125d79f-b8a3-4878-927f-af032e3c028a admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:06.667433 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a490cb-b15d-4e2c-b78e-6de886f7334a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecddcc9579614c689584e857e2d3e3e9, user_id=a92f463178274eb38b3c2fdb67a62afb, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:06.670358 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a490cb-b15d-4e2c-b78e-6de886f7334a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:06.678273 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125d79f-b8a3-4878-927f-af032e3c028a admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:06.691361 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013cf7c-f212-42e3-b23c-4b8c78fa16fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:06.694420 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013cf7c-f212-42e3-b23c-4b8c78fa16fb admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:06.696068 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013cf7c-f212-42e3-b23c-4b8c78fa16fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:06.696615 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013cf7c-f212-42e3-b23c-4b8c78fa16fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:06.697610 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013cf7c-f212-42e3-b23c-4b8c78fa16fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:06.706634 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013cf7c-f212-42e3-b23c-4b8c78fa16fb admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:06.706957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 862/1703] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:23:06 2022] PUT /identity/v3/projects/ecddcc9579614c689584e857e2d3e3e9/users/a92f463178274eb38b3c2fdb67a62afb/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:06.710934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a490cb-b15d-4e2c-b78e-6de886f7334a admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:06.776642 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 842/1704] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:23:06 2022] POST /identity/v3/projects => generated 393 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:23:06.778023 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013cf7c-f212-42e3-b23c-4b8c78fa16fb admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:06.893519 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a490cb-b15d-4e2c-b78e-6de886f7334a admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:06.932294 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:07.009273 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013cf7c-f212-42e3-b23c-4b8c78fa16fb admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:07.024656 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002f4b5-9cf0-45fe-bbcd-cb65f9cbd2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:07.027606 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002f4b5-9cf0-45fe-bbcd-cb65f9cbd2f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:07.028843 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002f4b5-9cf0-45fe-bbcd-cb65f9cbd2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:07.030168 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002f4b5-9cf0-45fe-bbcd-cb65f9cbd2f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:07.035831 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a002f4b5-9cf0-45fe-bbcd-cb65f9cbd2f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:07.039103 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a002f4b5-9cf0-45fe-bbcd-cb65f9cbd2f6 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:07.067507 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f6425-339a-422b-bcdb-fa3a6180f293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:07.068219 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f6425-339a-422b-bcdb-fa3a6180f293 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:07.068507 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f6425-339a-422b-bcdb-fa3a6180f293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:07.068791 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f6425-339a-422b-bcdb-fa3a6180f293 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:07.069538 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f6425-339a-422b-bcdb-fa3a6180f293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:07.071400 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f6425-339a-422b-bcdb-fa3a6180f293 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:07.097614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 863/1705] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:23:07.102050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f6425-339a-422b-bcdb-fa3a6180f293 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:07.127170 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 843/1706] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:23:06 2022] POST /identity/v3/users => generated 297 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:23:07.131080 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002f4b5-9cf0-45fe-bbcd-cb65f9cbd2f6 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:07.136058 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f6425-339a-422b-bcdb-fa3a6180f293 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:07.155123 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002f4b5-9cf0-45fe-bbcd-cb65f9cbd2f6 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:07.165525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee91a1-68b2-4508-a4e7-e9542d8059a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:07.166597 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee91a1-68b2-4508-a4e7-e9542d8059a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:07.166887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee91a1-68b2-4508-a4e7-e9542d8059a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:07.167171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee91a1-68b2-4508-a4e7-e9542d8059a7 admin admin] PATH_INFO: `/v3/projects/ecddcc9579614c689584e857e2d3e3e9/users/a92f463178274eb38b3c2fdb67a62afb/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:07.168293 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f85a9d-1401-4245-91b8-552cb1c47061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:07.168978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f85a9d-1401-4245-91b8-552cb1c47061 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:07.169258 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f85a9d-1401-4245-91b8-552cb1c47061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:07.169535 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f85a9d-1401-4245-91b8-552cb1c47061 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:07.170396 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee91a1-68b2-4508-a4e7-e9542d8059a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecddcc9579614c689584e857e2d3e3e9, user_id=a92f463178274eb38b3c2fdb67a62afb, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:07.170515 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f85a9d-1401-4245-91b8-552cb1c47061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:07.172867 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f85a9d-1401-4245-91b8-552cb1c47061 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:07.174720 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee91a1-68b2-4508-a4e7-e9542d8059a7 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:07.208044 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 844/1707] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:23:07.213049 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f85a9d-1401-4245-91b8-552cb1c47061 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:07.223366 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 864/1708] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:23:07 2022] PUT /identity/v3/projects/ecddcc9579614c689584e857e2d3e3e9/users/a92f463178274eb38b3c2fdb67a62afb/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:07.247491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f85a9d-1401-4245-91b8-552cb1c47061 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:07.488381 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b2bf2-c923-46de-8018-54aa9b263e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:07.488381 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b2bf2-c923-46de-8018-54aa9b263e31 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:07.488381 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b2bf2-c923-46de-8018-54aa9b263e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:07.488381 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b2bf2-c923-46de-8018-54aa9b263e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:07.488801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b2bf2-c923-46de-8018-54aa9b263e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:07.492356 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b2bf2-c923-46de-8018-54aa9b263e31 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:07.532742 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 845/1709] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:23:07.533139 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee91a1-68b2-4508-a4e7-e9542d8059a7 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:07.550107 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee91a1-68b2-4508-a4e7-e9542d8059a7 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:07.566919 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee00bb-532d-47f5-a632-17ee63a44f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:07.568003 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee00bb-532d-47f5-a632-17ee63a44f81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:07.568292 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee00bb-532d-47f5-a632-17ee63a44f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:07.568572 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee00bb-532d-47f5-a632-17ee63a44f81 admin admin] PATH_INFO: `/v3/projects/12afe03794ec495a903676b563ab47b1/users/85ba18fa5de0469a93fcda742971618a/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:07.589856 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee00bb-532d-47f5-a632-17ee63a44f81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12afe03794ec495a903676b563ab47b1, user_id=85ba18fa5de0469a93fcda742971618a, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:07.595097 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee00bb-532d-47f5-a632-17ee63a44f81 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:07.634331 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 865/1710] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:23:07 2022] PUT /identity/v3/projects/12afe03794ec495a903676b563ab47b1/users/85ba18fa5de0469a93fcda742971618a/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:23:07.645875 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ded6ba-8e71-4c1f-ba48-ea43d75a0ce5 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:07.646440 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ded6ba-8e71-4c1f-ba48-ea43d75a0ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:07.646440 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ded6ba-8e71-4c1f-ba48-ea43d75a0ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:07.707322 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-f1ded6ba-8e71-4c1f-ba48-ea43d75a0ce5 None None] MFA Rules not processed for user `85ba18fa5de0469a93fcda742971618a`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:07.709104 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f1ded6ba-8e71-4c1f-ba48-ea43d75a0ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:07.740143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:07.935508 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 846/1711] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:07.940568 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee00bb-532d-47f5-a632-17ee63a44f81 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:08.075197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee00bb-532d-47f5-a632-17ee63a44f81 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:08.090764 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac0118-ac95-4322-b513-5d4adc4c4276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:08.092211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac0118-ac95-4322-b513-5d4adc4c4276 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:08.092959 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac0118-ac95-4322-b513-5d4adc4c4276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:08.093557 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac0118-ac95-4322-b513-5d4adc4c4276 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:08.095576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac0118-ac95-4322-b513-5d4adc4c4276 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:08.099248 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac0118-ac95-4322-b513-5d4adc4c4276 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:08.164152 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 866/1712] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:23:07 2022] POST /identity/v3/projects => generated 393 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:23:08.168321 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ded6ba-8e71-4c1f-ba48-ea43d75a0ce5 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:08.183882 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ded6ba-8e71-4c1f-ba48-ea43d75a0ce5 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:08.299699 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435da3b4-5049-4be9-a021-426bb985e4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:08.304919 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435da3b4-5049-4be9-a021-426bb985e4de admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:08.309076 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435da3b4-5049-4be9-a021-426bb985e4de admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:08.309586 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435da3b4-5049-4be9-a021-426bb985e4de admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:08.312609 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435da3b4-5049-4be9-a021-426bb985e4de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:08.320650 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435da3b4-5049-4be9-a021-426bb985e4de admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:08.380708 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666f66c-6d75-4f85-a4ad-c4cb4c98d7a1 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:08.381152 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666f66c-6d75-4f85-a4ad-c4cb4c98d7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:08.381901 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666f66c-6d75-4f85-a4ad-c4cb4c98d7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:08.385520 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 847/1713] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:23:08 2022] POST /identity/v3/users => generated 303 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:23:08.388574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435da3b4-5049-4be9-a021-426bb985e4de admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:08.432065 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435da3b4-5049-4be9-a021-426bb985e4de admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:08.447846 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a151b-a548-4e62-bb01-354963e5bea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:08.450307 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a151b-a548-4e62-bb01-354963e5bea0 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:08.451706 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-3666f66c-6d75-4f85-a4ad-c4cb4c98d7a1 None None] MFA Rules not processed for user `45692f4ec1254103a5b0132b3b42b60b`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:08.452552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a151b-a548-4e62-bb01-354963e5bea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:08.453954 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a151b-a548-4e62-bb01-354963e5bea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:08.456539 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a151b-a548-4e62-bb01-354963e5bea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:08.463907 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3666f66c-6d75-4f85-a4ad-c4cb4c98d7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:08.470734 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a151b-a548-4e62-bb01-354963e5bea0 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:08.502982 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 848/1714] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:23:08.508369 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a151b-a548-4e62-bb01-354963e5bea0 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:08.541361 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a151b-a548-4e62-bb01-354963e5bea0 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:08.546034 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:08.568357 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e7fc2-35ea-4805-bc29-61c8067e235f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:08.569628 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e7fc2-35ea-4805-bc29-61c8067e235f admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:08.578290 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e7fc2-35ea-4805-bc29-61c8067e235f admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:08.578834 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e7fc2-35ea-4805-bc29-61c8067e235f admin admin] PATH_INFO: `/v3/projects/20d82d7a969c4f7bb173aa5a4b4ad58e/users/e0705ef0fc974c02a47b67923318c2ba/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:08.626949 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 867/1715] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:08.642535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666f66c-6d75-4f85-a4ad-c4cb4c98d7a1 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:08.643753 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e7fc2-35ea-4805-bc29-61c8067e235f admin admin] RBAC: Authorizing `identity:create_grant(project_id=20d82d7a969c4f7bb173aa5a4b4ad58e, user_id=e0705ef0fc974c02a47b67923318c2ba, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:08.643907 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3666f66c-6d75-4f85-a4ad-c4cb4c98d7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:08.650298 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e7fc2-35ea-4805-bc29-61c8067e235f admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:08.690283 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 849/1716] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:23:08 2022] PUT /identity/v3/projects/20d82d7a969c4f7bb173aa5a4b4ad58e/users/e0705ef0fc974c02a47b67923318c2ba/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:08.695591 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e7fc2-35ea-4805-bc29-61c8067e235f admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:08.945898 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e7fc2-35ea-4805-bc29-61c8067e235f admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:08.955255 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666f66c-6d75-4f85-a4ad-c4cb4c98d7a1 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:08.959129 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc004169-8d38-434d-a692-11abcd5783ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:08.959815 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc004169-8d38-434d-a692-11abcd5783ad admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:08.960289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc004169-8d38-434d-a692-11abcd5783ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:08.961079 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc004169-8d38-434d-a692-11abcd5783ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:08.961936 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc004169-8d38-434d-a692-11abcd5783ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:08.964022 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc004169-8d38-434d-a692-11abcd5783ad admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:09.014240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 850/1717] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:23:09.018655 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc004169-8d38-434d-a692-11abcd5783ad admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:09.059307 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc004169-8d38-434d-a692-11abcd5783ad admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:09.083444 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477a264-5459-4bce-96b9-f4871806996a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:09.084383 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477a264-5459-4bce-96b9-f4871806996a admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:09.084670 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477a264-5459-4bce-96b9-f4871806996a admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:09.084947 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477a264-5459-4bce-96b9-f4871806996a admin admin] PATH_INFO: `/v3/projects/20d82d7a969c4f7bb173aa5a4b4ad58e/users/e0705ef0fc974c02a47b67923318c2ba/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:09.091480 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477a264-5459-4bce-96b9-f4871806996a admin admin] RBAC: Authorizing `identity:create_grant(project_id=20d82d7a969c4f7bb173aa5a4b4ad58e, user_id=e0705ef0fc974c02a47b67923318c2ba, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:09.094339 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477a264-5459-4bce-96b9-f4871806996a admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:09.142189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:09.165670 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 851/1718] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:23:09 2022] PUT /identity/v3/projects/20d82d7a969c4f7bb173aa5a4b4ad58e/users/e0705ef0fc974c02a47b67923318c2ba/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:09.174552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477a264-5459-4bce-96b9-f4871806996a admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:09.177193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-5477a264-5459-4bce-96b9-f4871806996a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:09.203770 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fed5f-383a-45e1-8d0b-364efbe4591e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:09.205479 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fed5f-383a-45e1-8d0b-364efbe4591e service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:09.205716 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fed5f-383a-45e1-8d0b-364efbe4591e service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:09.206020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fed5f-383a-45e1-8d0b-364efbe4591e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:09.329988 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fed5f-383a-45e1-8d0b-364efbe4591e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:09.332406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fed5f-383a-45e1-8d0b-364efbe4591e service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:09.355874 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 868/1719] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:23:09.360741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbccf20-3377-42f1-b3f3-c3f19066245e None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:09.361114 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbccf20-3377-42f1-b3f3-c3f19066245e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:09.361395 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbccf20-3377-42f1-b3f3-c3f19066245e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:09.439931 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-5cbccf20-3377-42f1-b3f3-c3f19066245e None None] MFA Rules not processed for user `e0705ef0fc974c02a47b67923318c2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:09.456560 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-5cbccf20-3377-42f1-b3f3-c3f19066245e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:09.472045 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477a264-5459-4bce-96b9-f4871806996a admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:09.486244 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10097a-5b98-4a85-9634-bd7166fc12d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:09.487143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10097a-5b98-4a85-9634-bd7166fc12d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:09.487595 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10097a-5b98-4a85-9634-bd7166fc12d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:09.487892 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10097a-5b98-4a85-9634-bd7166fc12d0 admin admin] PATH_INFO: `/v3/projects/93f0d090538c4d5b9f44074de7b6e000` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:09.497678 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10097a-5b98-4a85-9634-bd7166fc12d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93f0d090538c4d5b9f44074de7b6e000)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:09.502040 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:09.507192 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10097a-5b98-4a85-9634-bd7166fc12d0 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:09.734931 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-cf10097a-5b98-4a85-9634-bd7166fc12d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93f0d090538c4d5b9f44074de7b6e000', 'request_id': 'req-cf10097a-5b98-4a85-9634-bd7166fc12d0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:09.751415 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-cf10097a-5b98-4a85-9634-bd7166fc12d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93f0d090538c4d5b9f44074de7b6e000', 'request_id': 'req-cf10097a-5b98-4a85-9634-bd7166fc12d0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:09.783196 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-cf10097a-5b98-4a85-9634-bd7166fc12d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93f0d090538c4d5b9f44074de7b6e000', 'request_id': 'req-cf10097a-5b98-4a85-9634-bd7166fc12d0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:09.822075 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 869/1720] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:09 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:09.841769 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbccf20-3377-42f1-b3f3-c3f19066245e None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:09.844026 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-5cbccf20-3377-42f1-b3f3-c3f19066245e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:09.851266 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-cf10097a-5b98-4a85-9634-bd7166fc12d0 admin admin] The token cache is being invalidate because project 93f0d090538c4d5b9f44074de7b6e000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:23:09.851803 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-cf10097a-5b98-4a85-9634-bd7166fc12d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:09.871051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-cf10097a-5b98-4a85-9634-bd7166fc12d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:09.876620 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 852/1721] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:23:09 2022] DELETE /identity/v3/projects/93f0d090538c4d5b9f44074de7b6e000 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:09.884695 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd971f3-0eb6-42d4-a83b-b4464087a491 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:09.884695 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd971f3-0eb6-42d4-a83b-b4464087a491 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:09.885021 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd971f3-0eb6-42d4-a83b-b4464087a491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:09.960823 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-bdd971f3-0eb6-42d4-a83b-b4464087a491 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:09.962679 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-bdd971f3-0eb6-42d4-a83b-b4464087a491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:10.047666 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbccf20-3377-42f1-b3f3-c3f19066245e None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:10.198596 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a6ca3-1633-486b-a13a-1674e2f71380 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:10.200661 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a6ca3-1633-486b-a13a-1674e2f71380 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:10.202093 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a6ca3-1633-486b-a13a-1674e2f71380 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:10.205364 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a6ca3-1633-486b-a13a-1674e2f71380 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:10.213609 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-769a6ca3-1633-486b-a13a-1674e2f71380 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:10.227779 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 853/1722] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:23:10.232374 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed9e77-77ae-409b-aa8c-980134e30ecd None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:10.232658 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed9e77-77ae-409b-aa8c-980134e30ecd None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:10.232936 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed9e77-77ae-409b-aa8c-980134e30ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:10.314595 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-96ed9e77-77ae-409b-aa8c-980134e30ecd None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:10.321909 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-96ed9e77-77ae-409b-aa8c-980134e30ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:10.365714 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 854/1723] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:10.370869 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed9e77-77ae-409b-aa8c-980134e30ecd None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:10.404339 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed9e77-77ae-409b-aa8c-980134e30ecd None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:10.418503 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34072405-257c-4cb5-9965-ae493f939e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:10.421125 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34072405-257c-4cb5-9965-ae493f939e0f admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:10.421771 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34072405-257c-4cb5-9965-ae493f939e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:10.423342 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34072405-257c-4cb5-9965-ae493f939e0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:10.424600 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34072405-257c-4cb5-9965-ae493f939e0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:23:10.427140 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34072405-257c-4cb5-9965-ae493f939e0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:10.434631 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34072405-257c-4cb5-9965-ae493f939e0f admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:10.488850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 855/1724] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:23:10.493241 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34072405-257c-4cb5-9965-ae493f939e0f admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:10.499032 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a6ca3-1633-486b-a13a-1674e2f71380 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:10.501490 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a6ca3-1633-486b-a13a-1674e2f71380 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:10.526268 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34072405-257c-4cb5-9965-ae493f939e0f admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:10.532652 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 870/1725] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:09 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 691 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:23:10.558736 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebcee42-a106-4798-a96a-661ff9568b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:10.559849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcee42-a106-4798-a96a-661ff9568b1b admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:10.569845 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcee42-a106-4798-a96a-661ff9568b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:10.569845 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcee42-a106-4798-a96a-661ff9568b1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:10.569845 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebcee42-a106-4798-a96a-661ff9568b1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:10.572186 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebcee42-a106-4798-a96a-661ff9568b1b admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:10.591669 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:10.678798 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a6ca3-1633-486b-a13a-1674e2f71380 service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:10.684772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 856/1726] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:23:10 2022] POST /identity/v3/projects => generated 377 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:23:10.714847 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a6ca3-1633-486b-a13a-1674e2f71380 service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:10.755492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:10.768702 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebcee42-a106-4798-a96a-661ff9568b1b admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:10.771483 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0ebcee42-a106-4798-a96a-661ff9568b1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:10.939782 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebcee42-a106-4798-a96a-661ff9568b1b admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:10.959464 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b394537-880d-4b63-a3b7-e1ef3c528941 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:10.960553 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b394537-880d-4b63-a3b7-e1ef3c528941 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:10.960987 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b394537-880d-4b63-a3b7-e1ef3c528941 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:10.961424 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b394537-880d-4b63-a3b7-e1ef3c528941 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:10.964418 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4b394537-880d-4b63-a3b7-e1ef3c528941 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:10.993332 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bce895-df53-483b-a885-90a7e53a7847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:10.994222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bce895-df53-483b-a885-90a7e53a7847 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:10.994390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bce895-df53-483b-a885-90a7e53a7847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:10.994585 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bce895-df53-483b-a885-90a7e53a7847 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:10.995292 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bce895-df53-483b-a885-90a7e53a7847 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:10.997251 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bce895-df53-483b-a885-90a7e53a7847 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:11.085065 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 871/1727] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:23:10 2022] POST /identity/v3/users => generated 289 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:23:11.087650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bce895-df53-483b-a885-90a7e53a7847 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:11.110997 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bce895-df53-483b-a885-90a7e53a7847 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:11.141066 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf51dbf-6389-41ae-ab00-0ae2ae5bea47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:11.141896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf51dbf-6389-41ae-ab00-0ae2ae5bea47 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:11.142065 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf51dbf-6389-41ae-ab00-0ae2ae5bea47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:11.142336 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf51dbf-6389-41ae-ab00-0ae2ae5bea47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:11.143070 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf51dbf-6389-41ae-ab00-0ae2ae5bea47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:11.149728 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf51dbf-6389-41ae-ab00-0ae2ae5bea47 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:11.205234 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 872/1728] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:23:11.210706 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf51dbf-6389-41ae-ab00-0ae2ae5bea47 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:11.251312 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b394537-880d-4b63-a3b7-e1ef3c528941 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:11.253140 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b394537-880d-4b63-a3b7-e1ef3c528941 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:11.257437 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf51dbf-6389-41ae-ab00-0ae2ae5bea47 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:11.278447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 857/1729] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:23:11.291619 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b37a01-7d18-4946-9c72-85eaf7132899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:11.292818 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b37a01-7d18-4946-9c72-85eaf7132899 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:11.294300 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b37a01-7d18-4946-9c72-85eaf7132899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:11.294684 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b37a01-7d18-4946-9c72-85eaf7132899 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:11.299003 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b37a01-7d18-4946-9c72-85eaf7132899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:11.307292 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b37a01-7d18-4946-9c72-85eaf7132899 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:11.354761 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 873/1730] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:23:11.355459 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3a5af-6413-4c6d-b446-276b8ef21eb1 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:11.355800 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3a5af-6413-4c6d-b446-276b8ef21eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:11.356032 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b37a01-7d18-4946-9c72-85eaf7132899 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:11.356184 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3a5af-6413-4c6d-b446-276b8ef21eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:11.381895 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b37a01-7d18-4946-9c72-85eaf7132899 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:11.395773 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea48e7-7088-4435-9d52-7f413bceaf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:11.396699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea48e7-7088-4435-9d52-7f413bceaf85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:11.396991 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea48e7-7088-4435-9d52-7f413bceaf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:11.397272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea48e7-7088-4435-9d52-7f413bceaf85 admin admin] PATH_INFO: `/v3/projects/3ccadd8aee574a1e936eb328227d1520/users/bbc53d692224444cae7b590a0bc7b6aa/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:11.445788 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea48e7-7088-4435-9d52-7f413bceaf85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ccadd8aee574a1e936eb328227d1520, user_id=bbc53d692224444cae7b590a0bc7b6aa, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:11.453804 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea48e7-7088-4435-9d52-7f413bceaf85 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:11.474302 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-bbf3a5af-6413-4c6d-b446-276b8ef21eb1 None None] MFA Rules not processed for user `3b943ba0c640461e94943764f95458f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:11.479785 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-bbf3a5af-6413-4c6d-b446-276b8ef21eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:11.484556 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 874/1731] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:23:11 2022] PUT /identity/v3/projects/3ccadd8aee574a1e936eb328227d1520/users/bbc53d692224444cae7b590a0bc7b6aa/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:11.496002 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aba468-63a4-4065-9323-d65c3986937e None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:11.500635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aba468-63a4-4065-9323-d65c3986937e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:11.501006 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aba468-63a4-4065-9323-d65c3986937e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:11.612023 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-b3aba468-63a4-4065-9323-d65c3986937e None None] MFA Rules not processed for user `bbc53d692224444cae7b590a0bc7b6aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:11.614940 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b3aba468-63a4-4065-9323-d65c3986937e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:11.748354 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 875/1732] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:11.762595 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aba468-63a4-4065-9323-d65c3986937e None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:11.764538 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b3aba468-63a4-4065-9323-d65c3986937e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:11.776191 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 858/1733] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:11.785814 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb09697-3047-4a0f-b2b2-cb487f2cfd81 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:11.786290 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb09697-3047-4a0f-b2b2-cb487f2cfd81 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:11.786765 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb09697-3047-4a0f-b2b2-cb487f2cfd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:11.870913 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-eeb09697-3047-4a0f-b2b2-cb487f2cfd81 None None] MFA Rules not processed for user `3b943ba0c640461e94943764f95458f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:11.873064 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-eeb09697-3047-4a0f-b2b2-cb487f2cfd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:11.888085 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 859/1734] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:11.907470 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb09697-3047-4a0f-b2b2-cb487f2cfd81 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:11.910179 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-eeb09697-3047-4a0f-b2b2-cb487f2cfd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:12.042685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:12.044737 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:12.066029 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aba468-63a4-4065-9323-d65c3986937e None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:12.083207 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b979c7-8581-4f98-a60b-8db7b442e47e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cd24a726e4e4ce687d150a3bdc5948f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:12.083935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b979c7-8581-4f98-a60b-8db7b442e47e service glance] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:12.084205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b979c7-8581-4f98-a60b-8db7b442e47e service glance] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:12.089102 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b979c7-8581-4f98-a60b-8db7b442e47e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:12.148745 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b979c7-8581-4f98-a60b-8db7b442e47e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:12.150244 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b979c7-8581-4f98-a60b-8db7b442e47e service glance] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:12.220041 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb09697-3047-4a0f-b2b2-cb487f2cfd81 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:12.237207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274657e9-b6df-4941-88ee-8ac929789822 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:12.238324 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274657e9-b6df-4941-88ee-8ac929789822 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:12.238707 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274657e9-b6df-4941-88ee-8ac929789822 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:12.239127 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274657e9-b6df-4941-88ee-8ac929789822 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:12.248783 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 876/1735] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:23:12.251315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823f29e-57cd-4c35-83f9-14aad7fa19cb None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:12.258826 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823f29e-57cd-4c35-83f9-14aad7fa19cb None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:12.259646 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823f29e-57cd-4c35-83f9-14aad7fa19cb None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:12.260331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274657e9-b6df-4941-88ee-8ac929789822 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:12.273678 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274657e9-b6df-4941-88ee-8ac929789822 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:12.282723 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 877/1736] 10.222.0.57 () {54 vars in 921 bytes} [Sat Jun 4 08:23:12 2022] GET /identity => generated 270 bytes in 33 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:23:12.339431 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 860/1737] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:23:12.767096 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691bd01-1e08-4909-9495-da30a5d7de92 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:12.767622 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691bd01-1e08-4909-9495-da30a5d7de92 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:12.767906 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691bd01-1e08-4909-9495-da30a5d7de92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:12.843886 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-9691bd01-1e08-4909-9495-da30a5d7de92 None None] MFA Rules not processed for user `7e64d002241242928936dd0d991ecdc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:12.851762 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9691bd01-1e08-4909-9495-da30a5d7de92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:12.894188 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 878/1738] 10.222.0.57 () {58 vars in 1018 bytes} [Sat Jun 4 08:23:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:23:13.410743 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274657e9-b6df-4941-88ee-8ac929789822 service nova] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:13.417781 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-274657e9-b6df-4941-88ee-8ac929789822 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:13.484741 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274657e9-b6df-4941-88ee-8ac929789822 service nova] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:13.533525 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e1f1f-8cc6-43cd-aff2-9f4202230b80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:13.537388 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e1f1f-8cc6-43cd-aff2-9f4202230b80 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:13.540341 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e1f1f-8cc6-43cd-aff2-9f4202230b80 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:13.541043 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e1f1f-8cc6-43cd-aff2-9f4202230b80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:13.612332 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e1f1f-8cc6-43cd-aff2-9f4202230b80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:13.637763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e1f1f-8cc6-43cd-aff2-9f4202230b80 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:13.763716 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 861/1739] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:23:14.261479 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460d2a8-cf25-414f-86b8-1bb4340dd40a None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:14.262352 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460d2a8-cf25-414f-86b8-1bb4340dd40a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:14.262787 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460d2a8-cf25-414f-86b8-1bb4340dd40a None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:14.266041 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 879/1740] 10.222.0.57 () {54 vars in 912 bytes} [Sat Jun 4 08:23:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:23:14.275292 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe0daf-f4a3-4ed0-a359-ac796f160d63 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:14.275757 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe0daf-f4a3-4ed0-a359-ac796f160d63 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:14.276150 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe0daf-f4a3-4ed0-a359-ac796f160d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:14.326939 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-48fe0daf-f4a3-4ed0-a359-ac796f160d63 None None] MFA Rules not processed for user `5fd5768a512c4177abae05f4ccd5c59f`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:14.332856 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-48fe0daf-f4a3-4ed0-a359-ac796f160d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:14.378856 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda4e7e-e86b-4f9f-9e59-4715569c79f2 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:14.379385 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda4e7e-e86b-4f9f-9e59-4715569c79f2 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:14.379839 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda4e7e-e86b-4f9f-9e59-4715569c79f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:14.443837 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-8dda4e7e-e86b-4f9f-9e59-4715569c79f2 None None] MFA Rules not processed for user `aff5d82384e84b669eeb00089ab8e09a`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:14.448726 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8dda4e7e-e86b-4f9f-9e59-4715569c79f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:14.471743 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 862/1741] 10.222.0.57 () {58 vars in 1009 bytes} [Sat Jun 4 08:23:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:14.541664 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe0daf-f4a3-4ed0-a359-ac796f160d63 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:14.543256 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-48fe0daf-f4a3-4ed0-a359-ac796f160d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:14.570137 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe0daf-f4a3-4ed0-a359-ac796f160d63 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:14.578382 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd08509-3a4c-4fc8-9174-28050fd0782a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:14.579644 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd08509-3a4c-4fc8-9174-28050fd0782a service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:14.579938 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd08509-3a4c-4fc8-9174-28050fd0782a service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:14.580793 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd08509-3a4c-4fc8-9174-28050fd0782a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:14.603425 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd08509-3a4c-4fc8-9174-28050fd0782a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:14.607971 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd08509-3a4c-4fc8-9174-28050fd0782a service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:14.634952 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 863/1742] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:23:14.660555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 880/1743] 10.222.0.57 () {58 vars in 1009 bytes} [Sat Jun 4 08:23:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:14.676811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd08509-3a4c-4fc8-9174-28050fd0782a service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:14.679157 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4cd08509-3a4c-4fc8-9174-28050fd0782a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:15.008349 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd08509-3a4c-4fc8-9174-28050fd0782a service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:15.043100 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aac2d4-9a46-4945-885b-b85598f3f2ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05ea412cab4244c58a2670c66f5a311c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:15.043775 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aac2d4-9a46-4945-885b-b85598f3f2ca service swift] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:15.044061 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aac2d4-9a46-4945-885b-b85598f3f2ca service swift] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:15.044344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aac2d4-9a46-4945-885b-b85598f3f2ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:15.084099 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aac2d4-9a46-4945-885b-b85598f3f2ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:15.086985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aac2d4-9a46-4945-885b-b85598f3f2ca service swift] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:15.110610 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 864/1744] 10.222.0.57 () {60 vars in 1384 bytes} [Sat Jun 4 08:23:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 08:23:16.019790 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ac4c6-4595-4e17-b28f-812eb6617aa9 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:16.020721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ac4c6-4595-4e17-b28f-812eb6617aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:16.021163 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ac4c6-4595-4e17-b28f-812eb6617aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:16.091109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-946ac4c6-4595-4e17-b28f-812eb6617aa9 None None] MFA Rules not processed for user `e1e8c33d40ee43c693c28beaf794dff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:16.092778 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-946ac4c6-4595-4e17-b28f-812eb6617aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:16.282694 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 881/1745] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:16.291218 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aac2d4-9a46-4945-885b-b85598f3f2ca service swift] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:16.309173 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aac2d4-9a46-4945-885b-b85598f3f2ca service swift] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:16.329201 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a3c6c-0b50-4e18-843d-f273248fa6fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:16.329980 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a3c6c-0b50-4e18-843d-f273248fa6fb service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:16.330273 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a3c6c-0b50-4e18-843d-f273248fa6fb service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:16.330555 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a3c6c-0b50-4e18-843d-f273248fa6fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:16.351080 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a3c6c-0b50-4e18-843d-f273248fa6fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:16.354211 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a3c6c-0b50-4e18-843d-f273248fa6fb service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:16.377428 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 865/1746] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:23:16.412732 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fd26b-0281-4816-a8c3-ee0890af267e None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:16.413243 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fd26b-0281-4816-a8c3-ee0890af267e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:16.413681 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fd26b-0281-4816-a8c3-ee0890af267e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:16.500141 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-487fd26b-0281-4816-a8c3-ee0890af267e None None] MFA Rules not processed for user `a92f463178274eb38b3c2fdb67a62afb`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:16.501397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b8a60-20bf-4f91-8966-e42e69a5bb9f None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:16.501691 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b8a60-20bf-4f91-8966-e42e69a5bb9f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:16.501991 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-487fd26b-0281-4816-a8c3-ee0890af267e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:16.502115 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b8a60-20bf-4f91-8966-e42e69a5bb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:16.549431 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:16.568755 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-1a3b8a60-20bf-4f91-8966-e42e69a5bb9f None None] MFA Rules not processed for user `3b943ba0c640461e94943764f95458f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:16.579874 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1a3b8a60-20bf-4f91-8966-e42e69a5bb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:16.603910 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 866/1747] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:16.715650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 882/1748] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:16 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:17.420368 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b8a60-20bf-4f91-8966-e42e69a5bb9f None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:17.422540 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1a3b8a60-20bf-4f91-8966-e42e69a5bb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:17.486505 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ef7a3-bcb0-4689-8382-84af3ebce8c3 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:17.488074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ef7a3-bcb0-4689-8382-84af3ebce8c3 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:17.488518 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ef7a3-bcb0-4689-8382-84af3ebce8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:17.496348 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:17.554721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-7b3ef7a3-bcb0-4689-8382-84af3ebce8c3 None None] MFA Rules not processed for user `45692f4ec1254103a5b0132b3b42b60b`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:17.564072 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-7b3ef7a3-bcb0-4689-8382-84af3ebce8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:17.705651 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b8a60-20bf-4f91-8966-e42e69a5bb9f None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:17.722047 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86c9a2-8ebe-4d30-b2f5-74aea9701949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:17.723644 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86c9a2-8ebe-4d30-b2f5-74aea9701949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:17.724080 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86c9a2-8ebe-4d30-b2f5-74aea9701949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:17.724524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86c9a2-8ebe-4d30-b2f5-74aea9701949 admin admin] PATH_INFO: `/v3/users/85ba18fa5de0469a93fcda742971618a` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:17.728224 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86c9a2-8ebe-4d30-b2f5-74aea9701949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85ba18fa5de0469a93fcda742971618a)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:17.736136 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86c9a2-8ebe-4d30-b2f5-74aea9701949 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:17.785676 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 883/1749] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:17.876953 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-bc86c9a2-8ebe-4d30-b2f5-74aea9701949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85ba18fa5de0469a93fcda742971618a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:17.897872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-bc86c9a2-8ebe-4d30-b2f5-74aea9701949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85ba18fa5de0469a93fcda742971618a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:17.898999 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-bc86c9a2-8ebe-4d30-b2f5-74aea9701949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85ba18fa5de0469a93fcda742971618a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:17.946150 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-bc86c9a2-8ebe-4d30-b2f5-74aea9701949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85ba18fa5de0469a93fcda742971618a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:17.951032 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-bc86c9a2-8ebe-4d30-b2f5-74aea9701949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85ba18fa5de0469a93fcda742971618a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:17.992622 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 867/1750] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:23:17 2022] DELETE /identity/v3/users/85ba18fa5de0469a93fcda742971618a => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:17.994193 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2131eaf-906e-4029-b0c9-45a783b4c144 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:17.994496 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2131eaf-906e-4029-b0c9-45a783b4c144 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:17.994781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2131eaf-906e-4029-b0c9-45a783b4c144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:18.044239 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e2131eaf-906e-4029-b0c9-45a783b4c144 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:18.045491 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e2131eaf-906e-4029-b0c9-45a783b4c144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:18.380588 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 884/1751] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:19.035177 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86c9a2-8ebe-4d30-b2f5-74aea9701949 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:19.036655 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-bc86c9a2-8ebe-4d30-b2f5-74aea9701949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:19.225028 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86c9a2-8ebe-4d30-b2f5-74aea9701949 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:19.246568 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9fd18b-5a30-4f20-8457-31440e2b8fe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:19.246870 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fd18b-5a30-4f20-8457-31440e2b8fe0 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:19.247157 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fd18b-5a30-4f20-8457-31440e2b8fe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:19.247438 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fd18b-5a30-4f20-8457-31440e2b8fe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:19.263250 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9fd18b-5a30-4f20-8457-31440e2b8fe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:19.265413 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9fd18b-5a30-4f20-8457-31440e2b8fe0 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:19.284857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 868/1752] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:23:20.097029 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839008a2-9abb-47fc-ad2e-064629d88998 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:20.097591 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839008a2-9abb-47fc-ad2e-064629d88998 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:20.097591 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839008a2-9abb-47fc-ad2e-064629d88998 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:20.099866 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 885/1753] 10.222.0.57 () {54 vars in 921 bytes} [Sat Jun 4 08:23:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:23:20.210472 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a1a0c-28fc-4cc1-93ea-ee1fd7136dee None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:20.210986 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a1a0c-28fc-4cc1-93ea-ee1fd7136dee None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:20.211090 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a1a0c-28fc-4cc1-93ea-ee1fd7136dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:20.278334 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-980a1a0c-28fc-4cc1-93ea-ee1fd7136dee None None] MFA Rules not processed for user `6fb6720f0d0141fea795cecfbf6f2538`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:20.283261 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-980a1a0c-28fc-4cc1-93ea-ee1fd7136dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:20.327916 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:20.460934 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 869/1754] 10.222.0.57 () {58 vars in 1018 bytes} [Sat Jun 4 08:23:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:20.511764 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839008a2-9abb-47fc-ad2e-064629d88998 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:20.513868 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-839008a2-9abb-47fc-ad2e-064629d88998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:20.546898 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839008a2-9abb-47fc-ad2e-064629d88998 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:20.556034 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a960cbd-dc5f-4811-a896-8e7bae691335 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fb6720f0d0141fea795cecfbf6f2538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:20.556878 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a960cbd-dc5f-4811-a896-8e7bae691335 service placement] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:20.557167 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a960cbd-dc5f-4811-a896-8e7bae691335 service placement] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:20.557445 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a960cbd-dc5f-4811-a896-8e7bae691335 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:20.575324 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a960cbd-dc5f-4811-a896-8e7bae691335 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:20.577923 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a960cbd-dc5f-4811-a896-8e7bae691335 service placement] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:20.595206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 886/1755] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:23:22.010542 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a1a0c-28fc-4cc1-93ea-ee1fd7136dee None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:22.012672 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-980a1a0c-28fc-4cc1-93ea-ee1fd7136dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:22.061455 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a1a0c-28fc-4cc1-93ea-ee1fd7136dee None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:22.078990 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0d451-1ecf-40f6-a93f-1ea802e90ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:22.085585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0d451-1ecf-40f6-a93f-1ea802e90ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:22.087011 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0d451-1ecf-40f6-a93f-1ea802e90ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:22.087418 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0d451-1ecf-40f6-a93f-1ea802e90ee9 admin admin] PATH_INFO: `/v3/projects/12afe03794ec495a903676b563ab47b1` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:22.089171 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0d451-1ecf-40f6-a93f-1ea802e90ee9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12afe03794ec495a903676b563ab47b1)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:22.091470 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0d451-1ecf-40f6-a93f-1ea802e90ee9 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:22.227182 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-36c0d451-1ecf-40f6-a93f-1ea802e90ee9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12afe03794ec495a903676b563ab47b1', 'request_id': 'req-36c0d451-1ecf-40f6-a93f-1ea802e90ee9'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:22.241632 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-36c0d451-1ecf-40f6-a93f-1ea802e90ee9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12afe03794ec495a903676b563ab47b1', 'request_id': 'req-36c0d451-1ecf-40f6-a93f-1ea802e90ee9'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:22.250767 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-36c0d451-1ecf-40f6-a93f-1ea802e90ee9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12afe03794ec495a903676b563ab47b1', 'request_id': 'req-36c0d451-1ecf-40f6-a93f-1ea802e90ee9'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:22.281521 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-36c0d451-1ecf-40f6-a93f-1ea802e90ee9 admin admin] The token cache is being invalidate because project 12afe03794ec495a903676b563ab47b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:23:22.281858 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-36c0d451-1ecf-40f6-a93f-1ea802e90ee9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:22.282550 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-36c0d451-1ecf-40f6-a93f-1ea802e90ee9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:22.287216 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 870/1756] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:23:22 2022] DELETE /identity/v3/projects/12afe03794ec495a903676b563ab47b1 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:22.290161 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a960cbd-dc5f-4811-a896-8e7bae691335 service placement] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:22.303640 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a960cbd-dc5f-4811-a896-8e7bae691335 service placement] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:22.428826 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b07876-5b65-4bee-8e8e-17cabafab1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:22.429721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b07876-5b65-4bee-8e8e-17cabafab1bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:22.431648 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b07876-5b65-4bee-8e8e-17cabafab1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:22.432482 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b07876-5b65-4bee-8e8e-17cabafab1bd admin admin] PATH_INFO: `/v3/users/e0705ef0fc974c02a47b67923318c2ba` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:22.455311 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b07876-5b65-4bee-8e8e-17cabafab1bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0705ef0fc974c02a47b67923318c2ba)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:22.464171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b07876-5b65-4bee-8e8e-17cabafab1bd admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:22.561362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53440a-ec57-4d4d-8476-92bfd078fce6 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:22.562797 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53440a-ec57-4d4d-8476-92bfd078fce6 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:22.563287 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53440a-ec57-4d4d-8476-92bfd078fce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:22.570632 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:22.588831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-81b07876-5b65-4bee-8e8e-17cabafab1bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0705ef0fc974c02a47b67923318c2ba'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:22.606364 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-81b07876-5b65-4bee-8e8e-17cabafab1bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0705ef0fc974c02a47b67923318c2ba'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:22.607093 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-81b07876-5b65-4bee-8e8e-17cabafab1bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0705ef0fc974c02a47b67923318c2ba'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:22.609358 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-81b07876-5b65-4bee-8e8e-17cabafab1bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0705ef0fc974c02a47b67923318c2ba'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:22.638882 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-8a53440a-ec57-4d4d-8476-92bfd078fce6 None None] MFA Rules not processed for user `93baaa9e849b40b199d567615f7e1c94`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:22.641728 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-81b07876-5b65-4bee-8e8e-17cabafab1bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0705ef0fc974c02a47b67923318c2ba'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:22.643343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8a53440a-ec57-4d4d-8476-92bfd078fce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:22.668831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 887/1757] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:23:22 2022] DELETE /identity/v3/users/e0705ef0fc974c02a47b67923318c2ba => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:22.808530 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 871/1758] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:23:23.290330 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b07876-5b65-4bee-8e8e-17cabafab1bd admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:23.291777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-81b07876-5b65-4bee-8e8e-17cabafab1bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:23.492035 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b07876-5b65-4bee-8e8e-17cabafab1bd admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:23.492449 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53440a-ec57-4d4d-8476-92bfd078fce6 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:23.494051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8a53440a-ec57-4d4d-8476-92bfd078fce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:23.502183 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b2758-88bd-4318-85d9-59507c151e7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:23.503248 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b2758-88bd-4318-85d9-59507c151e7d service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:23.503730 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b2758-88bd-4318-85d9-59507c151e7d service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:23.504243 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b2758-88bd-4318-85d9-59507c151e7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:23.549354 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53440a-ec57-4d4d-8476-92bfd078fce6 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:23.584545 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b2758-88bd-4318-85d9-59507c151e7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:23.586436 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b2758-88bd-4318-85d9-59507c151e7d service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:23.598139 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 888/1759] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:23:23.645010 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:23.703566 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc960910-7cf5-4641-9d04-b8d4bc64eca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:23.704519 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc960910-7cf5-4641-9d04-b8d4bc64eca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:23.704813 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc960910-7cf5-4641-9d04-b8d4bc64eca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:23.705093 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc960910-7cf5-4641-9d04-b8d4bc64eca3 admin admin] PATH_INFO: `/v3/projects/20d82d7a969c4f7bb173aa5a4b4ad58e` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:23.706399 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc960910-7cf5-4641-9d04-b8d4bc64eca3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20d82d7a969c4f7bb173aa5a4b4ad58e)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:23.708625 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc960910-7cf5-4641-9d04-b8d4bc64eca3 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:23.830428 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-dc960910-7cf5-4641-9d04-b8d4bc64eca3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20d82d7a969c4f7bb173aa5a4b4ad58e', 'request_id': 'req-dc960910-7cf5-4641-9d04-b8d4bc64eca3'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:23.841405 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-dc960910-7cf5-4641-9d04-b8d4bc64eca3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20d82d7a969c4f7bb173aa5a4b4ad58e', 'request_id': 'req-dc960910-7cf5-4641-9d04-b8d4bc64eca3'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:23.862190 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-dc960910-7cf5-4641-9d04-b8d4bc64eca3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20d82d7a969c4f7bb173aa5a4b4ad58e', 'request_id': 'req-dc960910-7cf5-4641-9d04-b8d4bc64eca3'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:23.886233 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-dc960910-7cf5-4641-9d04-b8d4bc64eca3 admin admin] The token cache is being invalidate because project 20d82d7a969c4f7bb173aa5a4b4ad58e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:23:23.886608 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-dc960910-7cf5-4641-9d04-b8d4bc64eca3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:23.887657 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-dc960910-7cf5-4641-9d04-b8d4bc64eca3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:23.897089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 872/1760] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:23:23 2022] DELETE /identity/v3/projects/20d82d7a969c4f7bb173aa5a4b4ad58e => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:23:23.899439 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71caeb5e-b0dd-4f31-a577-5dc2576cf551 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:23.899871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71caeb5e-b0dd-4f31-a577-5dc2576cf551 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:23.900258 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71caeb5e-b0dd-4f31-a577-5dc2576cf551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:23.933431 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-71caeb5e-b0dd-4f31-a577-5dc2576cf551 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:23.935197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-71caeb5e-b0dd-4f31-a577-5dc2576cf551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:24.069109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:24.096031 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 889/1761] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:24.104611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e8f27-db38-4bde-b2e3-cb57df1b0b8e None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:24.106009 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e8f27-db38-4bde-b2e3-cb57df1b0b8e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:24.106501 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e8f27-db38-4bde-b2e3-cb57df1b0b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:24.151770 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-922e8f27-db38-4bde-b2e3-cb57df1b0b8e None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:24.156808 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-922e8f27-db38-4bde-b2e3-cb57df1b0b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:24.181302 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 873/1762] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:24.183804 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71caeb5e-b0dd-4f31-a577-5dc2576cf551 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:24.196924 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71caeb5e-b0dd-4f31-a577-5dc2576cf551 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:24.203749 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e24e8-f3e3-48ec-bcea-70212a90731c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:24.204799 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e24e8-f3e3-48ec-bcea-70212a90731c admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:24.204799 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e24e8-f3e3-48ec-bcea-70212a90731c admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:24.205094 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e24e8-f3e3-48ec-bcea-70212a90731c admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:24.206387 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e24e8-f3e3-48ec-bcea-70212a90731c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:23:24.206707 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e24e8-f3e3-48ec-bcea-70212a90731c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:24.208964 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e24e8-f3e3-48ec-bcea-70212a90731c admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:24.237907 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 890/1763] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:23:24.240576 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e8f27-db38-4bde-b2e3-cb57df1b0b8e None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:24.256610 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e8f27-db38-4bde-b2e3-cb57df1b0b8e None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:24.264593 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e10789-b50d-4c41-8706-ebf1e910c874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:24.266190 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e10789-b50d-4c41-8706-ebf1e910c874 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:24.266538 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e10789-b50d-4c41-8706-ebf1e910c874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:24.266895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e10789-b50d-4c41-8706-ebf1e910c874 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:24.267762 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e10789-b50d-4c41-8706-ebf1e910c874 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:24.270675 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e10789-b50d-4c41-8706-ebf1e910c874 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:24.335712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 874/1764] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:23:24 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:23:24.339829 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e24e8-f3e3-48ec-bcea-70212a90731c admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:24.353703 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e24e8-f3e3-48ec-bcea-70212a90731c admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:24.407122 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f183f-acc5-40f1-9512-071737f838f5 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:24.407325 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f183f-acc5-40f1-9512-071737f838f5 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:24.407606 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f183f-acc5-40f1-9512-071737f838f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:24.436225 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-583f183f-acc5-40f1-9512-071737f838f5 None None] MFA Rules not processed for user `e1e8c33d40ee43c693c28beaf794dff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:24.440105 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-583f183f-acc5-40f1-9512-071737f838f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:24.500575 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b44184-a528-4d66-9a57-c126726cd4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:24.501287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b44184-a528-4d66-9a57-c126726cd4d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:24.501572 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b44184-a528-4d66-9a57-c126726cd4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:24.501911 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b44184-a528-4d66-9a57-c126726cd4d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:24.503572 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b44184-a528-4d66-9a57-c126726cd4d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:24.506532 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b44184-a528-4d66-9a57-c126726cd4d6 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:24.537854 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 891/1765] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:23:24 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:23:24.538948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 875/1766] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:24.540107 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad59aee-e944-4386-86cd-e516f5f876ad None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:24.540425 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad59aee-e944-4386-86cd-e516f5f876ad None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:24.540678 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad59aee-e944-4386-86cd-e516f5f876ad None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:24.542247 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 892/1767] 10.222.0.57 () {54 vars in 921 bytes} [Sat Jun 4 08:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:23:24.547614 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f183f-acc5-40f1-9512-071737f838f5 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:24.571749 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f183f-acc5-40f1-9512-071737f838f5 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:24.578829 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b9d9d-d38b-49a0-8fd7-35bebeb261df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:24.579973 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b9d9d-d38b-49a0-8fd7-35bebeb261df admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:24.580347 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b9d9d-d38b-49a0-8fd7-35bebeb261df admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:24.580660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b9d9d-d38b-49a0-8fd7-35bebeb261df admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:24.581738 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b9d9d-d38b-49a0-8fd7-35bebeb261df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:24.584971 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b9d9d-d38b-49a0-8fd7-35bebeb261df admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:24.603174 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b045c-8f93-4f42-a5c8-3ae7c576a5bd None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:24.603509 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b045c-8f93-4f42-a5c8-3ae7c576a5bd None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:24.603745 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b045c-8f93-4f42-a5c8-3ae7c576a5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:24.613639 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 876/1768] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:23:24.614839 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b9d9d-d38b-49a0-8fd7-35bebeb261df admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:24.654447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b9d9d-d38b-49a0-8fd7-35bebeb261df admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:24.656759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e57b045c-8f93-4f42-a5c8-3ae7c576a5bd None None] MFA Rules not processed for user `6fb6720f0d0141fea795cecfbf6f2538`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:24.659917 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e57b045c-8f93-4f42-a5c8-3ae7c576a5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:24.666700 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1450482-2bda-4364-961a-05293fde9703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:24.669529 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1450482-2bda-4364-961a-05293fde9703 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:24.669992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1450482-2bda-4364-961a-05293fde9703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:24.670279 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1450482-2bda-4364-961a-05293fde9703 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:24.682066 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1450482-2bda-4364-961a-05293fde9703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:24.683830 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1450482-2bda-4364-961a-05293fde9703 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:24.752561 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 877/1769] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:23:24.754967 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1450482-2bda-4364-961a-05293fde9703 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:24.758839 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f1450482-2bda-4364-961a-05293fde9703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:24.795620 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1450482-2bda-4364-961a-05293fde9703 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:24.812475 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea2baa-8d6a-4ea2-a117-bda30594cfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:24.814734 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea2baa-8d6a-4ea2-a117-bda30594cfa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:24.816832 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea2baa-8d6a-4ea2-a117-bda30594cfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:24.817806 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea2baa-8d6a-4ea2-a117-bda30594cfa6 admin admin] PATH_INFO: `/v3/users/75f7408bca714eaba8e0a7093c211333` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:24.822079 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea2baa-8d6a-4ea2-a117-bda30594cfa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75f7408bca714eaba8e0a7093c211333)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:24.828146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea2baa-8d6a-4ea2-a117-bda30594cfa6 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:24.843316 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:24.899383 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 893/1770] 10.222.0.57 () {58 vars in 1018 bytes} [Sat Jun 4 08:23:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:24.900421 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b045c-8f93-4f42-a5c8-3ae7c576a5bd None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:24.919765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b045c-8f93-4f42-a5c8-3ae7c576a5bd None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:24.931903 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c2250-26cf-4288-b790-549019086e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:24.932925 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c2250-26cf-4288-b790-549019086e46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:24.933314 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c2250-26cf-4288-b790-549019086e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:24.933715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c2250-26cf-4288-b790-549019086e46 admin admin] PATH_INFO: `/v3/projects/0786beece4924bcdbff4be0b9555dff5/users/1c55f422b8dc42eab92105dcf8e8012e/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:24.950659 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-81ea2baa-8d6a-4ea2-a117-bda30594cfa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75f7408bca714eaba8e0a7093c211333'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:24.968470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c2250-26cf-4288-b790-549019086e46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0786beece4924bcdbff4be0b9555dff5, user_id=1c55f422b8dc42eab92105dcf8e8012e, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:24.968628 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-81ea2baa-8d6a-4ea2-a117-bda30594cfa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75f7408bca714eaba8e0a7093c211333'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:24.970257 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-81ea2baa-8d6a-4ea2-a117-bda30594cfa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75f7408bca714eaba8e0a7093c211333'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:24.971830 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c2250-26cf-4288-b790-549019086e46 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:25.010810 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-81ea2baa-8d6a-4ea2-a117-bda30594cfa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75f7408bca714eaba8e0a7093c211333'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:25.014481 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-81ea2baa-8d6a-4ea2-a117-bda30594cfa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75f7408bca714eaba8e0a7093c211333'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:25.016070 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 894/1771] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:23:24 2022] PUT /identity/v3/projects/0786beece4924bcdbff4be0b9555dff5/users/1c55f422b8dc42eab92105dcf8e8012e/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:25.017259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c2250-26cf-4288-b790-549019086e46 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:25.020291 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-7d9c2250-26cf-4288-b790-549019086e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:25.062388 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 878/1772] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:23:24 2022] DELETE /identity/v3/users/75f7408bca714eaba8e0a7093c211333 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:25.071727 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0425e-83da-44ad-9acf-a06db2a77a05 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:25.071727 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0425e-83da-44ad-9acf-a06db2a77a05 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:25.073291 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0425e-83da-44ad-9acf-a06db2a77a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:25.148404 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-12a0425e-83da-44ad-9acf-a06db2a77a05 None None] MFA Rules not processed for user `1c55f422b8dc42eab92105dcf8e8012e`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:25.149807 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-12a0425e-83da-44ad-9acf-a06db2a77a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:25.167719 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:25.236183 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c2250-26cf-4288-b790-549019086e46 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:25.281566 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 879/1773] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:25.285887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0425e-83da-44ad-9acf-a06db2a77a05 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:25.289974 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-12a0425e-83da-44ad-9acf-a06db2a77a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:25.397716 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973c266-0c99-46a1-b024-7a8f6ddbe133 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fb6720f0d0141fea795cecfbf6f2538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:25.399003 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973c266-0c99-46a1-b024-7a8f6ddbe133 service placement] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:25.400083 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973c266-0c99-46a1-b024-7a8f6ddbe133 service placement] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:25.400529 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973c266-0c99-46a1-b024-7a8f6ddbe133 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:25.403548 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-7973c266-0c99-46a1-b024-7a8f6ddbe133 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:25.427705 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973c266-0c99-46a1-b024-7a8f6ddbe133 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:25.430301 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973c266-0c99-46a1-b024-7a8f6ddbe133 service placement] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:25.460932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 895/1774] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:23:25.530956 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0425e-83da-44ad-9acf-a06db2a77a05 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:25.537665 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c4540-2567-49b0-af12-b773a52f2720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:25.538691 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c4540-2567-49b0-af12-b773a52f2720 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:25.539122 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c4540-2567-49b0-af12-b773a52f2720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:25.541575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c4540-2567-49b0-af12-b773a52f2720 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:25.541575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c4540-2567-49b0-af12-b773a52f2720 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:25.543138 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c4540-2567-49b0-af12-b773a52f2720 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:25.596376 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973c266-0c99-46a1-b024-7a8f6ddbe133 service placement] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:25.607021 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 880/1775] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:23:25 2022] POST /identity/v3/projects => generated 377 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:23:25.610331 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973c266-0c99-46a1-b024-7a8f6ddbe133 service placement] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:25.778827 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f95cd9-b796-433c-a945-87b37f9c2d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:25.779529 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f95cd9-b796-433c-a945-87b37f9c2d5a admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:25.779816 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f95cd9-b796-433c-a945-87b37f9c2d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:25.780208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f95cd9-b796-433c-a945-87b37f9c2d5a admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:25.783734 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f95cd9-b796-433c-a945-87b37f9c2d5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:25.789813 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f95cd9-b796-433c-a945-87b37f9c2d5a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:25.831091 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 896/1776] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:23:25 2022] POST /identity/v3/users => generated 289 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:23:25.832565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c4540-2567-49b0-af12-b773a52f2720 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:25.847488 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:25.855816 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c4540-2567-49b0-af12-b773a52f2720 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:25.871491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123d810-691f-48cd-bfcc-670ca296e774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:25.876555 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123d810-691f-48cd-bfcc-670ca296e774 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:25.877252 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123d810-691f-48cd-bfcc-670ca296e774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:25.878948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123d810-691f-48cd-bfcc-670ca296e774 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:25.880115 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123d810-691f-48cd-bfcc-670ca296e774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:25.884935 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123d810-691f-48cd-bfcc-670ca296e774 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:25.929083 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 881/1777] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:23:25.930313 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f95cd9-b796-433c-a945-87b37f9c2d5a admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:25.952604 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f95cd9-b796-433c-a945-87b37f9c2d5a admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:25.971002 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28682949-db56-4433-86fe-f5954dae4065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:25.972147 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28682949-db56-4433-86fe-f5954dae4065 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:25.972147 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28682949-db56-4433-86fe-f5954dae4065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:25.972360 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28682949-db56-4433-86fe-f5954dae4065 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:25.972970 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28682949-db56-4433-86fe-f5954dae4065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:25.974687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28682949-db56-4433-86fe-f5954dae4065 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:25.987545 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 897/1778] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:23:25.993945 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123d810-691f-48cd-bfcc-670ca296e774 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:26.027508 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123d810-691f-48cd-bfcc-670ca296e774 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:26.039753 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe3fa1-d885-4629-ab75-b7d8ed850d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:26.040448 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe3fa1-d885-4629-ab75-b7d8ed850d8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:26.040739 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe3fa1-d885-4629-ab75-b7d8ed850d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:26.041166 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe3fa1-d885-4629-ab75-b7d8ed850d8a admin admin] PATH_INFO: `/v3/projects/6c3795c0e635473495f06362c78505d2/users/29dd5987270e4830b4a6879b7d075dfb/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:26.095392 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe3fa1-d885-4629-ab75-b7d8ed850d8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c3795c0e635473495f06362c78505d2, user_id=29dd5987270e4830b4a6879b7d075dfb, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:26.103359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe3fa1-d885-4629-ab75-b7d8ed850d8a admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:26.149955 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 882/1779] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:23:25 2022] PUT /identity/v3/projects/6c3795c0e635473495f06362c78505d2/users/29dd5987270e4830b4a6879b7d075dfb/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:26.154028 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037638a-61b6-49e0-be70-3f1115b25429 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:26.156726 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037638a-61b6-49e0-be70-3f1115b25429 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:26.157018 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037638a-61b6-49e0-be70-3f1115b25429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:26.219548 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-9037638a-61b6-49e0-be70-3f1115b25429 None None] MFA Rules not processed for user `29dd5987270e4830b4a6879b7d075dfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:26.220725 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9037638a-61b6-49e0-be70-3f1115b25429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:26.226223 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd94a8-0729-43ff-97cc-53aa4ecffea1 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:26.226494 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd94a8-0729-43ff-97cc-53aa4ecffea1 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:26.226780 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd94a8-0729-43ff-97cc-53aa4ecffea1 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:26.229850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 883/1780] 10.222.0.57 () {54 vars in 921 bytes} [Sat Jun 4 08:23:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 08:23:26.259599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2a421-8721-4e83-b853-2ee9a426225d None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:26.259897 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2a421-8721-4e83-b853-2ee9a426225d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:26.260183 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2a421-8721-4e83-b853-2ee9a426225d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:26.302189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-41b2a421-8721-4e83-b853-2ee9a426225d None None] MFA Rules not processed for user `7e64d002241242928936dd0d991ecdc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:26.308001 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-41b2a421-8721-4e83-b853-2ee9a426225d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:26.324649 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:26.375485 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 898/1781] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:26.377325 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037638a-61b6-49e0-be70-3f1115b25429 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:26.487841 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 884/1782] 10.222.0.57 () {58 vars in 1018 bytes} [Sat Jun 4 08:23:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:23:26.589646 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037638a-61b6-49e0-be70-3f1115b25429 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:26.598103 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89face81-54cb-4112-b869-f26ffc8716b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:26.598969 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89face81-54cb-4112-b869-f26ffc8716b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:26.599381 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89face81-54cb-4112-b869-f26ffc8716b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:26.599866 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89face81-54cb-4112-b869-f26ffc8716b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:26.600679 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89face81-54cb-4112-b869-f26ffc8716b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:26.603367 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89face81-54cb-4112-b869-f26ffc8716b0 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:26.713964 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 899/1783] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:23:26 2022] POST /identity/v3/projects => generated 375 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:23:26.718759 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2a421-8721-4e83-b853-2ee9a426225d None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:26.743092 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2a421-8721-4e83-b853-2ee9a426225d None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:26.948600 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776dcfa-6372-45a7-9c35-c0be35e737ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:26.951065 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776dcfa-6372-45a7-9c35-c0be35e737ba admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:26.952681 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89face81-54cb-4112-b869-f26ffc8716b0 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:26.954400 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776dcfa-6372-45a7-9c35-c0be35e737ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:26.955013 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776dcfa-6372-45a7-9c35-c0be35e737ba admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:26.955538 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-89face81-54cb-4112-b869-f26ffc8716b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:26.957563 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776dcfa-6372-45a7-9c35-c0be35e737ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:26.963338 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776dcfa-6372-45a7-9c35-c0be35e737ba admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:27.040762 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 885/1784] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:23:26 2022] POST /identity/v3/users => generated 294 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:23:27.042331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0658e-ae8b-4a01-91d6-845f7e0d6383 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:27.042858 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0658e-ae8b-4a01-91d6-845f7e0d6383 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:27.043271 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0658e-ae8b-4a01-91d6-845f7e0d6383 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:27.047701 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 886/1785] 10.222.0.57 () {54 vars in 921 bytes} [Sat Jun 4 08:23:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:23:27.049200 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0658e-ae8b-4a01-91d6-845f7e0d6383 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:27.100426 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0658e-ae8b-4a01-91d6-845f7e0d6383 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:27.117602 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2319c4-d7b0-40eb-9e81-8ddb968074b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:27.118300 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2319c4-d7b0-40eb-9e81-8ddb968074b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:27.118589 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2319c4-d7b0-40eb-9e81-8ddb968074b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:27.118866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2319c4-d7b0-40eb-9e81-8ddb968074b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:27.120654 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2319c4-d7b0-40eb-9e81-8ddb968074b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:27.125455 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2319c4-d7b0-40eb-9e81-8ddb968074b2 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:27.154831 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 887/1786] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:23:27.161221 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a093e-1b23-476c-ae7a-375d5fc52678 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:27.164413 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a093e-1b23-476c-ae7a-375d5fc52678 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:27.168206 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a093e-1b23-476c-ae7a-375d5fc52678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:27.232714 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-296a093e-1b23-476c-ae7a-375d5fc52678 None None] MFA Rules not processed for user `7e64d002241242928936dd0d991ecdc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:27.234385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-296a093e-1b23-476c-ae7a-375d5fc52678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:27.300592 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89face81-54cb-4112-b869-f26ffc8716b0 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:27.315638 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178df120-8858-4a0f-a67a-1e0a68220080 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:27.316425 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178df120-8858-4a0f-a67a-1e0a68220080 service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:27.316715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178df120-8858-4a0f-a67a-1e0a68220080 service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:27.316989 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178df120-8858-4a0f-a67a-1e0a68220080 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:27.320323 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:27.372378 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178df120-8858-4a0f-a67a-1e0a68220080 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:27.376225 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178df120-8858-4a0f-a67a-1e0a68220080 service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:27.377429 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 888/1787] 10.222.0.57 () {58 vars in 1018 bytes} [Sat Jun 4 08:23:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:27.378920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a093e-1b23-476c-ae7a-375d5fc52678 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:27.401997 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 900/1788] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:23:27.402253 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a093e-1b23-476c-ae7a-375d5fc52678 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:27.407992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068cc2f-9490-4feb-a746-ac942a2ee8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:27.408961 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068cc2f-9490-4feb-a746-ac942a2ee8e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:27.409466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068cc2f-9490-4feb-a746-ac942a2ee8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:27.409988 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068cc2f-9490-4feb-a746-ac942a2ee8e9 admin admin] PATH_INFO: `/v3/projects/0fcf479dd46642979fb5dff74dce05f7/users/3e0fad200c074a04aec9cfc1779d23c4/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:27.432763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068cc2f-9490-4feb-a746-ac942a2ee8e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fcf479dd46642979fb5dff74dce05f7, user_id=3e0fad200c074a04aec9cfc1779d23c4, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:27.433150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178df120-8858-4a0f-a67a-1e0a68220080 service nova] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:27.434670 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-178df120-8858-4a0f-a67a-1e0a68220080 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:27.435691 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068cc2f-9490-4feb-a746-ac942a2ee8e9 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:27.459743 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 889/1789] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:23:27 2022] PUT /identity/v3/projects/0fcf479dd46642979fb5dff74dce05f7/users/3e0fad200c074a04aec9cfc1779d23c4/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:27.462445 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068cc2f-9490-4feb-a746-ac942a2ee8e9 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:27.496632 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178df120-8858-4a0f-a67a-1e0a68220080 service nova] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:27.598736 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068cc2f-9490-4feb-a746-ac942a2ee8e9 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:27.614916 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f56483-1acd-47c4-85d8-d268df0249da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:27.615613 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f56483-1acd-47c4-85d8-d268df0249da admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:27.616065 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f56483-1acd-47c4-85d8-d268df0249da admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:27.616330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f56483-1acd-47c4-85d8-d268df0249da admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:27.617074 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f56483-1acd-47c4-85d8-d268df0249da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:27.620829 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f56483-1acd-47c4-85d8-d268df0249da admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:27.643995 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 890/1790] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:23:27.649405 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f56483-1acd-47c4-85d8-d268df0249da admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:27.664871 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f56483-1acd-47c4-85d8-d268df0249da admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:27.670439 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e8614-ca90-4c7a-b1c1-b363c2b2b383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:27.671906 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e8614-ca90-4c7a-b1c1-b363c2b2b383 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:27.672329 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e8614-ca90-4c7a-b1c1-b363c2b2b383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:27.673187 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e8614-ca90-4c7a-b1c1-b363c2b2b383 admin admin] PATH_INFO: `/v3/projects/0fcf479dd46642979fb5dff74dce05f7/users/3e0fad200c074a04aec9cfc1779d23c4/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:27.676114 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e8614-ca90-4c7a-b1c1-b363c2b2b383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fcf479dd46642979fb5dff74dce05f7, user_id=3e0fad200c074a04aec9cfc1779d23c4, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:27.679370 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e8614-ca90-4c7a-b1c1-b363c2b2b383 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:27.694020 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 891/1791] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:23:27 2022] PUT /identity/v3/projects/0fcf479dd46642979fb5dff74dce05f7/users/3e0fad200c074a04aec9cfc1779d23c4/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:27.705697 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78cdf5-c6bc-42e8-ac25-9b08696d225f None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:27.708926 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78cdf5-c6bc-42e8-ac25-9b08696d225f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:27.709428 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78cdf5-c6bc-42e8-ac25-9b08696d225f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:27.737490 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:27.772015 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38a2ac-ea37-4b06-938c-ab2e8ed8078e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:27.773798 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38a2ac-ea37-4b06-938c-ab2e8ed8078e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:27.774576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38a2ac-ea37-4b06-938c-ab2e8ed8078e admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:27.777353 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38a2ac-ea37-4b06-938c-ab2e8ed8078e admin admin] PATH_INFO: `/v3/projects/caa9ec61ae3e437e8bd8208e5c4a6331` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:27.779219 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a38a2ac-ea37-4b06-938c-ab2e8ed8078e admin admin] RBAC: Authorizing `identity:delete_project(project_id=caa9ec61ae3e437e8bd8208e5c4a6331)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:27.783930 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a38a2ac-ea37-4b06-938c-ab2e8ed8078e admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:27.832787 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-8d78cdf5-c6bc-42e8-ac25-9b08696d225f None None] MFA Rules not processed for user `3e0fad200c074a04aec9cfc1779d23c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:27.836135 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8d78cdf5-c6bc-42e8-ac25-9b08696d225f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:27.905214 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0a38a2ac-ea37-4b06-938c-ab2e8ed8078e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caa9ec61ae3e437e8bd8208e5c4a6331', 'request_id': 'req-0a38a2ac-ea37-4b06-938c-ab2e8ed8078e'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:27.928219 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0a38a2ac-ea37-4b06-938c-ab2e8ed8078e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caa9ec61ae3e437e8bd8208e5c4a6331', 'request_id': 'req-0a38a2ac-ea37-4b06-938c-ab2e8ed8078e'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:27.945474 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0a38a2ac-ea37-4b06-938c-ab2e8ed8078e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caa9ec61ae3e437e8bd8208e5c4a6331', 'request_id': 'req-0a38a2ac-ea37-4b06-938c-ab2e8ed8078e'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:27.969268 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0a38a2ac-ea37-4b06-938c-ab2e8ed8078e admin admin] The token cache is being invalidate because project caa9ec61ae3e437e8bd8208e5c4a6331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:23:27.969568 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0a38a2ac-ea37-4b06-938c-ab2e8ed8078e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:27.972542 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0a38a2ac-ea37-4b06-938c-ab2e8ed8078e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:27.976228 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 901/1792] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:23:27 2022] DELETE /identity/v3/projects/caa9ec61ae3e437e8bd8208e5c4a6331 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:27.990382 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38a2ac-ea37-4b06-938c-ab2e8ed8078e admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:27.990382 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0a38a2ac-ea37-4b06-938c-ab2e8ed8078e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:28.037533 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 892/1793] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:28.038705 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78cdf5-c6bc-42e8-ac25-9b08696d225f None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:28.040250 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8d78cdf5-c6bc-42e8-ac25-9b08696d225f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:28.112862 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:28.201540 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38a2ac-ea37-4b06-938c-ab2e8ed8078e admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:28.231863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e86db0-d246-49ba-8e13-42f83d4e069d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:28.236527 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e86db0-d246-49ba-8e13-42f83d4e069d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:28.237793 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e86db0-d246-49ba-8e13-42f83d4e069d admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:28.238287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e86db0-d246-49ba-8e13-42f83d4e069d admin admin] PATH_INFO: `/v3/users/a92f463178274eb38b3c2fdb67a62afb` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:28.245386 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e86db0-d246-49ba-8e13-42f83d4e069d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a92f463178274eb38b3c2fdb67a62afb)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:28.261920 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e86db0-d246-49ba-8e13-42f83d4e069d admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:28.341330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78cdf5-c6bc-42e8-ac25-9b08696d225f None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:28.401201 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c9e86db0-d246-49ba-8e13-42f83d4e069d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a92f463178274eb38b3c2fdb67a62afb'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:28.416985 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c9e86db0-d246-49ba-8e13-42f83d4e069d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a92f463178274eb38b3c2fdb67a62afb'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:28.419034 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c9e86db0-d246-49ba-8e13-42f83d4e069d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a92f463178274eb38b3c2fdb67a62afb'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:28.421095 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c9e86db0-d246-49ba-8e13-42f83d4e069d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a92f463178274eb38b3c2fdb67a62afb'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:28.460340 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c9e86db0-d246-49ba-8e13-42f83d4e069d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a92f463178274eb38b3c2fdb67a62afb'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:28.490163 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 902/1794] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:23:27 2022] DELETE /identity/v3/users/a92f463178274eb38b3c2fdb67a62afb => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:28.491644 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e86db0-d246-49ba-8e13-42f83d4e069d admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:28.493336 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c9e86db0-d246-49ba-8e13-42f83d4e069d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:28.508780 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:28.523626 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebeef14-63a5-441c-bff8-e36c102c04ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:28.526475 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebeef14-63a5-441c-bff8-e36c102c04ca service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:28.526816 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebeef14-63a5-441c-bff8-e36c102c04ca service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:28.527098 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebeef14-63a5-441c-bff8-e36c102c04ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:28.538613 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4ebeef14-63a5-441c-bff8-e36c102c04ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:28.578045 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebeef14-63a5-441c-bff8-e36c102c04ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:28.580182 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebeef14-63a5-441c-bff8-e36c102c04ca service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:28.643330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 893/1795] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:23:28.736947 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e86db0-d246-49ba-8e13-42f83d4e069d admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:28.748323 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce0c5f-e3a7-4aba-8d3f-310afe71af40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:28.749853 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce0c5f-e3a7-4aba-8d3f-310afe71af40 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:28.750343 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce0c5f-e3a7-4aba-8d3f-310afe71af40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:28.750927 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce0c5f-e3a7-4aba-8d3f-310afe71af40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:28.756031 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b0ce0c5f-e3a7-4aba-8d3f-310afe71af40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:28.887558 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce0c5f-e3a7-4aba-8d3f-310afe71af40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:28.889302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce0c5f-e3a7-4aba-8d3f-310afe71af40 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:28.917485 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 903/1796] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:23:29.280760 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebeef14-63a5-441c-bff8-e36c102c04ca service nova] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:29.284295 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4ebeef14-63a5-441c-bff8-e36c102c04ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:29.326432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebeef14-63a5-441c-bff8-e36c102c04ca service nova] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:29.514866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f52735-3d98-4f78-bd90-a0cd48272c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:29.515781 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f52735-3d98-4f78-bd90-a0cd48272c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:29.516070 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f52735-3d98-4f78-bd90-a0cd48272c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:29.516364 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f52735-3d98-4f78-bd90-a0cd48272c9a admin admin] PATH_INFO: `/v3/projects/ecddcc9579614c689584e857e2d3e3e9` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:29.517834 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f52735-3d98-4f78-bd90-a0cd48272c9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecddcc9579614c689584e857e2d3e3e9)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:29.519985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f52735-3d98-4f78-bd90-a0cd48272c9a admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:29.605470 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:29.615263 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-22f52735-3d98-4f78-bd90-a0cd48272c9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecddcc9579614c689584e857e2d3e3e9', 'request_id': 'req-22f52735-3d98-4f78-bd90-a0cd48272c9a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:29.625680 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-22f52735-3d98-4f78-bd90-a0cd48272c9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecddcc9579614c689584e857e2d3e3e9', 'request_id': 'req-22f52735-3d98-4f78-bd90-a0cd48272c9a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:29.642189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-22f52735-3d98-4f78-bd90-a0cd48272c9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecddcc9579614c689584e857e2d3e3e9', 'request_id': 'req-22f52735-3d98-4f78-bd90-a0cd48272c9a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:29.663116 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-22f52735-3d98-4f78-bd90-a0cd48272c9a admin admin] The token cache is being invalidate because project ecddcc9579614c689584e857e2d3e3e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:23:29.663560 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-22f52735-3d98-4f78-bd90-a0cd48272c9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:29.665423 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-22f52735-3d98-4f78-bd90-a0cd48272c9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:29.668212 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 894/1797] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:23:29 2022] DELETE /identity/v3/projects/ecddcc9579614c689584e857e2d3e3e9 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:29.673905 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2237b-9fbc-4d49-a069-4e3b5a2abd48 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:29.673905 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2237b-9fbc-4d49-a069-4e3b5a2abd48 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:29.674205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2237b-9fbc-4d49-a069-4e3b5a2abd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:29.707785 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-79d2237b-9fbc-4d49-a069-4e3b5a2abd48 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:29.709166 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-79d2237b-9fbc-4d49-a069-4e3b5a2abd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:29.815959 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 904/1798] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:29.817598 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9154823-e118-457d-894f-e25c406218c1 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:29.817929 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9154823-e118-457d-894f-e25c406218c1 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:29.818256 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9154823-e118-457d-894f-e25c406218c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:29.845133 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-c9154823-e118-457d-894f-e25c406218c1 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:29.846273 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c9154823-e118-457d-894f-e25c406218c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:29.857179 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 895/1799] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:29.863665 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2237b-9fbc-4d49-a069-4e3b5a2abd48 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:29.875639 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2237b-9fbc-4d49-a069-4e3b5a2abd48 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:29.887373 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72998b7-89f7-4ea8-b564-a81ba13b23a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:29.888088 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72998b7-89f7-4ea8-b564-a81ba13b23a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:29.888366 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72998b7-89f7-4ea8-b564-a81ba13b23a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:29.888819 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72998b7-89f7-4ea8-b564-a81ba13b23a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:29.889617 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72998b7-89f7-4ea8-b564-a81ba13b23a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:23:29.889981 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72998b7-89f7-4ea8-b564-a81ba13b23a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:29.891798 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72998b7-89f7-4ea8-b564-a81ba13b23a1 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:29.913577 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 905/1800] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:23:29.918384 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9154823-e118-457d-894f-e25c406218c1 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:29.941724 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9154823-e118-457d-894f-e25c406218c1 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:29.956237 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb94dd2-f561-4a20-97bc-27cc6a76bbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:29.957003 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb94dd2-f561-4a20-97bc-27cc6a76bbb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:29.957358 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb94dd2-f561-4a20-97bc-27cc6a76bbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:29.957696 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb94dd2-f561-4a20-97bc-27cc6a76bbb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:29.958801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb94dd2-f561-4a20-97bc-27cc6a76bbb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:29.966419 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb94dd2-f561-4a20-97bc-27cc6a76bbb6 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:30.044702 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0245d10-8b49-48af-b46e-b5adf8d15501 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:30.044702 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0245d10-8b49-48af-b46e-b5adf8d15501 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:30.044702 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0245d10-8b49-48af-b46e-b5adf8d15501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:30.059921 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 896/1801] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:23:29 2022] POST /identity/v3/projects => generated 367 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:23:30.061864 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb94dd2-f561-4a20-97bc-27cc6a76bbb6 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:30.097105 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-a0245d10-8b49-48af-b46e-b5adf8d15501 None None] MFA Rules not processed for user `93baaa9e849b40b199d567615f7e1c94`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:30.100715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a0245d10-8b49-48af-b46e-b5adf8d15501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:30.187814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:30.209775 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 906/1802] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:23:30.211371 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb94dd2-f561-4a20-97bc-27cc6a76bbb6 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:30.217434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2bd56-1a84-4446-9a8d-25269429045e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:30.218670 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2bd56-1a84-4446-9a8d-25269429045e admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:30.219024 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2bd56-1a84-4446-9a8d-25269429045e admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:30.219375 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2bd56-1a84-4446-9a8d-25269429045e admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:30.220650 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2bd56-1a84-4446-9a8d-25269429045e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:30.222480 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2bd56-1a84-4446-9a8d-25269429045e admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:30.251802 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 897/1803] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:23:30 2022] POST /identity/v3/users => generated 284 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:23:30.252989 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0245d10-8b49-48af-b46e-b5adf8d15501 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:30.271000 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0245d10-8b49-48af-b46e-b5adf8d15501 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:30.287953 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806c0db-89c3-42b5-a861-90eb27925453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:30.288786 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806c0db-89c3-42b5-a861-90eb27925453 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:30.289069 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806c0db-89c3-42b5-a861-90eb27925453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:30.289352 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806c0db-89c3-42b5-a861-90eb27925453 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:30.290120 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b806c0db-89c3-42b5-a861-90eb27925453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:30.291779 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b806c0db-89c3-42b5-a861-90eb27925453 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:30.308448 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 907/1804] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:23:30.313962 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2bd56-1a84-4446-9a8d-25269429045e admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:30.325298 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2bd56-1a84-4446-9a8d-25269429045e admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:30.331143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54560994-91d9-4203-8b22-6268d76b7d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:30.331760 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54560994-91d9-4203-8b22-6268d76b7d8c admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:30.332046 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54560994-91d9-4203-8b22-6268d76b7d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:30.332437 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54560994-91d9-4203-8b22-6268d76b7d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:30.333190 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54560994-91d9-4203-8b22-6268d76b7d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:30.334899 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54560994-91d9-4203-8b22-6268d76b7d8c admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:30.360724 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 898/1805] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:23:30.362192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806c0db-89c3-42b5-a861-90eb27925453 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:30.377929 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806c0db-89c3-42b5-a861-90eb27925453 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:30.391749 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547e3cf-7492-4e2e-baf0-785aa52c1f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:30.392654 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547e3cf-7492-4e2e-baf0-785aa52c1f99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:30.392940 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547e3cf-7492-4e2e-baf0-785aa52c1f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:30.393214 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547e3cf-7492-4e2e-baf0-785aa52c1f99 admin admin] PATH_INFO: `/v3/projects/eadc4f3314914914be117efcf09d37ae/users/158c7e5e770e4f85b0d50741d152454a/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:30.425026 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547e3cf-7492-4e2e-baf0-785aa52c1f99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eadc4f3314914914be117efcf09d37ae, user_id=158c7e5e770e4f85b0d50741d152454a, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:30.430991 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547e3cf-7492-4e2e-baf0-785aa52c1f99 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:30.469422 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 908/1806] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:23:30 2022] PUT /identity/v3/projects/eadc4f3314914914be117efcf09d37ae/users/158c7e5e770e4f85b0d50741d152454a/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:30.479705 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3d705-fa48-4a3a-b8f7-e65b36c702bc None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:30.480001 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3d705-fa48-4a3a-b8f7-e65b36c702bc None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:30.480286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3d705-fa48-4a3a-b8f7-e65b36c702bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:30.524167 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-a9e3d705-fa48-4a3a-b8f7-e65b36c702bc None None] MFA Rules not processed for user `158c7e5e770e4f85b0d50741d152454a`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:30.525282 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a9e3d705-fa48-4a3a-b8f7-e65b36c702bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:30.630159 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 899/1807] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:30 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:30.634596 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547e3cf-7492-4e2e-baf0-785aa52c1f99 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:30.724838 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547e3cf-7492-4e2e-baf0-785aa52c1f99 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:30.730082 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e55f5b-baf2-48d2-a702-2de149a9ec6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:30.730873 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e55f5b-baf2-48d2-a702-2de149a9ec6b admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:30.731272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e55f5b-baf2-48d2-a702-2de149a9ec6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:30.731745 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e55f5b-baf2-48d2-a702-2de149a9ec6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:30.732524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e55f5b-baf2-48d2-a702-2de149a9ec6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:30.734821 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e55f5b-baf2-48d2-a702-2de149a9ec6b admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:30.803484 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 909/1808] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:23:30 2022] POST /identity/v3/projects => generated 367 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:23:30.804995 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3d705-fa48-4a3a-b8f7-e65b36c702bc None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:30.819447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3d705-fa48-4a3a-b8f7-e65b36c702bc None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:30.832250 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:30.969921 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e55f5b-baf2-48d2-a702-2de149a9ec6b admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:30.973230 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-77e55f5b-baf2-48d2-a702-2de149a9ec6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:30.986610 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f1e15-a3bd-4f0c-a1b7-881070f1a499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:30.987570 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f1e15-a3bd-4f0c-a1b7-881070f1a499 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:30.987713 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f1e15-a3bd-4f0c-a1b7-881070f1a499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:30.988107 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f1e15-a3bd-4f0c-a1b7-881070f1a499 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:30.989452 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f1e15-a3bd-4f0c-a1b7-881070f1a499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:30.993293 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f1e15-a3bd-4f0c-a1b7-881070f1a499 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:31.026876 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 900/1809] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:23:30 2022] POST /identity/v3/users => generated 290 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:23:31.031907 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f1e15-a3bd-4f0c-a1b7-881070f1a499 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:31.047275 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f1e15-a3bd-4f0c-a1b7-881070f1a499 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:31.056451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edff93-d33d-4cb9-a9c2-515bf0793add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:31.057938 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edff93-d33d-4cb9-a9c2-515bf0793add admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:31.058980 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edff93-d33d-4cb9-a9c2-515bf0793add admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:31.059380 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edff93-d33d-4cb9-a9c2-515bf0793add admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:31.060308 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edff93-d33d-4cb9-a9c2-515bf0793add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:31.068402 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edff93-d33d-4cb9-a9c2-515bf0793add admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:31.078364 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e55f5b-baf2-48d2-a702-2de149a9ec6b admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:31.082737 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70a169-a28c-45e2-a706-65e0238258df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:31.083576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70a169-a28c-45e2-a706-65e0238258df service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:31.083994 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70a169-a28c-45e2-a706-65e0238258df service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:31.084397 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70a169-a28c-45e2-a706-65e0238258df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:31.087374 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-df70a169-a28c-45e2-a706-65e0238258df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:31.088718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 901/1810] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:23:31.089731 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edff93-d33d-4cb9-a9c2-515bf0793add admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:31.103785 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edff93-d33d-4cb9-a9c2-515bf0793add admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:31.113298 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615eb3d-6ee2-4014-b8ae-826b68c98565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:31.114616 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615eb3d-6ee2-4014-b8ae-826b68c98565 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:31.115347 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615eb3d-6ee2-4014-b8ae-826b68c98565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:31.115726 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615eb3d-6ee2-4014-b8ae-826b68c98565 admin admin] PATH_INFO: `/v3/projects/e69782156b46499b85f3bff713d92faf/users/a78da349708e41329cf66411b933a71c/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:31.138231 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615eb3d-6ee2-4014-b8ae-826b68c98565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e69782156b46499b85f3bff713d92faf, user_id=a78da349708e41329cf66411b933a71c, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:31.141960 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615eb3d-6ee2-4014-b8ae-826b68c98565 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:31.169352 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 902/1811] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:23:31 2022] PUT /identity/v3/projects/e69782156b46499b85f3bff713d92faf/users/a78da349708e41329cf66411b933a71c/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:31.172271 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615eb3d-6ee2-4014-b8ae-826b68c98565 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:31.257817 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:31.262686 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70a169-a28c-45e2-a706-65e0238258df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:31.264247 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70a169-a28c-45e2-a706-65e0238258df service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:31.274722 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615eb3d-6ee2-4014-b8ae-826b68c98565 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:31.284263 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6265de-7a28-4346-bedf-e44bee4987f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:31.285104 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6265de-7a28-4346-bedf-e44bee4987f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:31.285400 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6265de-7a28-4346-bedf-e44bee4987f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:31.286570 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6265de-7a28-4346-bedf-e44bee4987f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:31.287713 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6265de-7a28-4346-bedf-e44bee4987f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:31.289435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6265de-7a28-4346-bedf-e44bee4987f6 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:31.305368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 910/1812] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:23:31.313104 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 903/1813] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:23:31.317212 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70a169-a28c-45e2-a706-65e0238258df service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:31.340068 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70a169-a28c-45e2-a706-65e0238258df service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:31.351277 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93ba64-10db-41de-aa6f-7481c750159e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:31.363400 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93ba64-10db-41de-aa6f-7481c750159e admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:31.363971 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93ba64-10db-41de-aa6f-7481c750159e admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:31.364539 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93ba64-10db-41de-aa6f-7481c750159e admin admin] PATH_INFO: `/v3/projects/e69782156b46499b85f3bff713d92faf/users/a78da349708e41329cf66411b933a71c/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:31.368381 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e93ba64-10db-41de-aa6f-7481c750159e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e69782156b46499b85f3bff713d92faf, user_id=a78da349708e41329cf66411b933a71c, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:31.374379 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e93ba64-10db-41de-aa6f-7481c750159e admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:31.423285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347e2c4-c1a3-4dfd-a7ae-84109b884ed8 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:31.425132 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347e2c4-c1a3-4dfd-a7ae-84109b884ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:31.425930 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347e2c4-c1a3-4dfd-a7ae-84109b884ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:31.427557 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 911/1814] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:23:31 2022] PUT /identity/v3/projects/e69782156b46499b85f3bff713d92faf/users/a78da349708e41329cf66411b933a71c/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:31.484289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-6347e2c4-c1a3-4dfd-a7ae-84109b884ed8 None None] MFA Rules not processed for user `a78da349708e41329cf66411b933a71c`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:31.486149 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-6347e2c4-c1a3-4dfd-a7ae-84109b884ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:31.588419 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:31.650466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 904/1815] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:31 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:31.680710 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93ba64-10db-41de-aa6f-7481c750159e admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:31.682660 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3e93ba64-10db-41de-aa6f-7481c750159e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:31.823918 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93ba64-10db-41de-aa6f-7481c750159e admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:31.832159 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6482607-b9c1-4d60-af10-6846ed156b74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:31.833793 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6482607-b9c1-4d60-af10-6846ed156b74 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:31.834362 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6482607-b9c1-4d60-af10-6846ed156b74 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:31.834853 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6482607-b9c1-4d60-af10-6846ed156b74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:31.853407 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6482607-b9c1-4d60-af10-6846ed156b74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:31.854916 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6482607-b9c1-4d60-af10-6846ed156b74 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:31.887587 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 912/1816] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:31 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:23:31.986232 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347e2c4-c1a3-4dfd-a7ae-84109b884ed8 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:31.997223 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347e2c4-c1a3-4dfd-a7ae-84109b884ed8 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:32.004038 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf2bff-ac54-4b76-91be-b9484b64d703 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:32.005097 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf2bff-ac54-4b76-91be-b9484b64d703 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:32.005565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf2bff-ac54-4b76-91be-b9484b64d703 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:32.006882 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf2bff-ac54-4b76-91be-b9484b64d703 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:32.115888 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf2bff-ac54-4b76-91be-b9484b64d703 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:32.122199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf2bff-ac54-4b76-91be-b9484b64d703 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:32.154039 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 905/1817] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:31 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:23:32.528726 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6482607-b9c1-4d60-af10-6846ed156b74 service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:32.545496 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6482607-b9c1-4d60-af10-6846ed156b74 service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:32.551376 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271236c7-9aa6-40f8-8485-625d2b937172 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:32.552266 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271236c7-9aa6-40f8-8485-625d2b937172 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:32.552800 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271236c7-9aa6-40f8-8485-625d2b937172 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:32.553307 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271236c7-9aa6-40f8-8485-625d2b937172 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:32.572314 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-271236c7-9aa6-40f8-8485-625d2b937172 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:32.719150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271236c7-9aa6-40f8-8485-625d2b937172 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:32.720695 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271236c7-9aa6-40f8-8485-625d2b937172 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:32.748172 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 913/1818] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:32 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:23:36.626127 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf2bff-ac54-4b76-91be-b9484b64d703 service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:36.627766 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d6bf2bff-ac54-4b76-91be-b9484b64d703 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:36.736562 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf2bff-ac54-4b76-91be-b9484b64d703 service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:36.747996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfe3a5-6104-4472-b0fe-0f1e00b74fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:36.749165 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfe3a5-6104-4472-b0fe-0f1e00b74fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:36.749549 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfe3a5-6104-4472-b0fe-0f1e00b74fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:36.749979 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfe3a5-6104-4472-b0fe-0f1e00b74fb9 admin admin] PATH_INFO: `/v3/users/1c55f422b8dc42eab92105dcf8e8012e` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:36.751449 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfe3a5-6104-4472-b0fe-0f1e00b74fb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c55f422b8dc42eab92105dcf8e8012e)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:36.753905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfe3a5-6104-4472-b0fe-0f1e00b74fb9 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:36.843647 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9ccfe3a5-6104-4472-b0fe-0f1e00b74fb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c55f422b8dc42eab92105dcf8e8012e'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:36.852225 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9ccfe3a5-6104-4472-b0fe-0f1e00b74fb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c55f422b8dc42eab92105dcf8e8012e'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:36.853709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9ccfe3a5-6104-4472-b0fe-0f1e00b74fb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c55f422b8dc42eab92105dcf8e8012e'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:36.869813 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9ccfe3a5-6104-4472-b0fe-0f1e00b74fb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c55f422b8dc42eab92105dcf8e8012e'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:36.870921 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9ccfe3a5-6104-4472-b0fe-0f1e00b74fb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c55f422b8dc42eab92105dcf8e8012e'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:36.894866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:36.908632 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 906/1819] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:23:36 2022] DELETE /identity/v3/users/1c55f422b8dc42eab92105dcf8e8012e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:36.909433 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271236c7-9aa6-40f8-8485-625d2b937172 service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:36.914333 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d839ff2-db3e-4c04-915e-6db2bcb894b6 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:36.915367 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d839ff2-db3e-4c04-915e-6db2bcb894b6 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:36.916895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d839ff2-db3e-4c04-915e-6db2bcb894b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:36.927408 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271236c7-9aa6-40f8-8485-625d2b937172 service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:36.939042 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-2d839ff2-db3e-4c04-915e-6db2bcb894b6 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:36.941227 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2d839ff2-db3e-4c04-915e-6db2bcb894b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:37.028213 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 907/1820] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:37.038826 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d839ff2-db3e-4c04-915e-6db2bcb894b6 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:37.040436 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2d839ff2-db3e-4c04-915e-6db2bcb894b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:37.044705 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a667e74-cee4-4e07-8b1b-dd13f7070bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:37.045734 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a667e74-cee4-4e07-8b1b-dd13f7070bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:37.046140 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a667e74-cee4-4e07-8b1b-dd13f7070bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:37.046486 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a667e74-cee4-4e07-8b1b-dd13f7070bb2 admin admin] PATH_INFO: `/v3/users/158c7e5e770e4f85b0d50741d152454a` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:37.047784 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a667e74-cee4-4e07-8b1b-dd13f7070bb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=158c7e5e770e4f85b0d50741d152454a)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:37.050032 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a667e74-cee4-4e07-8b1b-dd13f7070bb2 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:37.088213 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:37.168160 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d839ff2-db3e-4c04-915e-6db2bcb894b6 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:37.173720 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca638d90-5289-45bb-94a2-c6d98ee0772b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:37.174765 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca638d90-5289-45bb-94a2-c6d98ee0772b service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:37.175054 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca638d90-5289-45bb-94a2-c6d98ee0772b service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:37.175340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca638d90-5289-45bb-94a2-c6d98ee0772b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:37.185540 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-8a667e74-cee4-4e07-8b1b-dd13f7070bb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '158c7e5e770e4f85b0d50741d152454a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:37.188501 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca638d90-5289-45bb-94a2-c6d98ee0772b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:37.190537 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca638d90-5289-45bb-94a2-c6d98ee0772b service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:37.202509 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-8a667e74-cee4-4e07-8b1b-dd13f7070bb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '158c7e5e770e4f85b0d50741d152454a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:37.206990 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-8a667e74-cee4-4e07-8b1b-dd13f7070bb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '158c7e5e770e4f85b0d50741d152454a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:37.208390 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 908/1821] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:23:37.208885 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-8a667e74-cee4-4e07-8b1b-dd13f7070bb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '158c7e5e770e4f85b0d50741d152454a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:37.254608 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-8a667e74-cee4-4e07-8b1b-dd13f7070bb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '158c7e5e770e4f85b0d50741d152454a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:37.278112 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 914/1822] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:23:36 2022] DELETE /identity/v3/users/158c7e5e770e4f85b0d50741d152454a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:37.282802 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104ebbf-4572-4173-aac8-4a40c6f2cd37 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:37.283300 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104ebbf-4572-4173-aac8-4a40c6f2cd37 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:37.289941 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104ebbf-4572-4173-aac8-4a40c6f2cd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:37.326315 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-c104ebbf-4572-4173-aac8-4a40c6f2cd37 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:37.329047 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c104ebbf-4572-4173-aac8-4a40c6f2cd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:37.403440 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 909/1823] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:37.436614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a667e74-cee4-4e07-8b1b-dd13f7070bb2 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:37.438532 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8a667e74-cee4-4e07-8b1b-dd13f7070bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:37.516970 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a667e74-cee4-4e07-8b1b-dd13f7070bb2 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:37.524563 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558d0a3-1cc8-43bc-b2cb-d47cf34457fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:37.526151 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558d0a3-1cc8-43bc-b2cb-d47cf34457fc service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:37.526644 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558d0a3-1cc8-43bc-b2cb-d47cf34457fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:37.527123 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558d0a3-1cc8-43bc-b2cb-d47cf34457fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:37.548397 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558d0a3-1cc8-43bc-b2cb-d47cf34457fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:37.550091 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558d0a3-1cc8-43bc-b2cb-d47cf34457fc service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:37.563291 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 915/1824] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:23:37.739076 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104ebbf-4572-4173-aac8-4a40c6f2cd37 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:37.742590 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c104ebbf-4572-4173-aac8-4a40c6f2cd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:37.763592 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104ebbf-4572-4173-aac8-4a40c6f2cd37 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:37.772981 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2767344-a47b-4930-b045-196466b0b015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:37.773944 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2767344-a47b-4930-b045-196466b0b015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:37.774237 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2767344-a47b-4930-b045-196466b0b015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:37.774527 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2767344-a47b-4930-b045-196466b0b015 admin admin] PATH_INFO: `/v3/projects/0786beece4924bcdbff4be0b9555dff5` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:37.775840 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2767344-a47b-4930-b045-196466b0b015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0786beece4924bcdbff4be0b9555dff5)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:37.779892 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2767344-a47b-4930-b045-196466b0b015 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:37.837854 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:37.845951 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a2767344-a47b-4930-b045-196466b0b015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0786beece4924bcdbff4be0b9555dff5', 'request_id': 'req-a2767344-a47b-4930-b045-196466b0b015'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:37.852708 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a2767344-a47b-4930-b045-196466b0b015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0786beece4924bcdbff4be0b9555dff5', 'request_id': 'req-a2767344-a47b-4930-b045-196466b0b015'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:37.862175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a2767344-a47b-4930-b045-196466b0b015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0786beece4924bcdbff4be0b9555dff5', 'request_id': 'req-a2767344-a47b-4930-b045-196466b0b015'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:37.874417 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a2767344-a47b-4930-b045-196466b0b015 admin admin] The token cache is being invalidate because project 0786beece4924bcdbff4be0b9555dff5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:23:37.874699 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a2767344-a47b-4930-b045-196466b0b015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:37.875350 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a2767344-a47b-4930-b045-196466b0b015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:37.876909 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 910/1825] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:23:37 2022] DELETE /identity/v3/projects/0786beece4924bcdbff4be0b9555dff5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:37.881511 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558d0a3-1cc8-43bc-b2cb-d47cf34457fc service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:37.891773 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558d0a3-1cc8-43bc-b2cb-d47cf34457fc service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:38.026699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516fe445-8546-4870-b8b9-cbf353fa4625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:38.027747 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fe445-8546-4870-b8b9-cbf353fa4625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:38.028270 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fe445-8546-4870-b8b9-cbf353fa4625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:38.028582 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fe445-8546-4870-b8b9-cbf353fa4625 admin admin] PATH_INFO: `/v3/users/29dd5987270e4830b4a6879b7d075dfb` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:38.030927 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516fe445-8546-4870-b8b9-cbf353fa4625 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29dd5987270e4830b4a6879b7d075dfb)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:38.033653 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516fe445-8546-4870-b8b9-cbf353fa4625 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:38.114143 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:38.122582 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-516fe445-8546-4870-b8b9-cbf353fa4625 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29dd5987270e4830b4a6879b7d075dfb'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:38.122824 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2767344-a47b-4930-b045-196466b0b015 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:38.124711 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a2767344-a47b-4930-b045-196466b0b015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:38.135790 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-516fe445-8546-4870-b8b9-cbf353fa4625 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29dd5987270e4830b4a6879b7d075dfb'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:38.136718 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-516fe445-8546-4870-b8b9-cbf353fa4625 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29dd5987270e4830b4a6879b7d075dfb'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:38.137522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-516fe445-8546-4870-b8b9-cbf353fa4625 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29dd5987270e4830b4a6879b7d075dfb'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:38.153390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-516fe445-8546-4870-b8b9-cbf353fa4625 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29dd5987270e4830b4a6879b7d075dfb'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:38.157371 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2767344-a47b-4930-b045-196466b0b015 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:38.185661 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee2f78-7e8a-4a7d-b4d7-cbd92bf167cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:38.187132 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee2f78-7e8a-4a7d-b4d7-cbd92bf167cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:38.187420 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee2f78-7e8a-4a7d-b4d7-cbd92bf167cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:38.187805 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee2f78-7e8a-4a7d-b4d7-cbd92bf167cf admin admin] PATH_INFO: `/v3/projects/eadc4f3314914914be117efcf09d37ae` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:38.193926 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 916/1826] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:23:37 2022] DELETE /identity/v3/users/29dd5987270e4830b4a6879b7d075dfb => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:38.198375 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee2f78-7e8a-4a7d-b4d7-cbd92bf167cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=eadc4f3314914914be117efcf09d37ae)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:38.200220 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee2f78-7e8a-4a7d-b4d7-cbd92bf167cf admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:38.289402 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e6ee2f78-7e8a-4a7d-b4d7-cbd92bf167cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eadc4f3314914914be117efcf09d37ae', 'request_id': 'req-e6ee2f78-7e8a-4a7d-b4d7-cbd92bf167cf'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:38.298285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e6ee2f78-7e8a-4a7d-b4d7-cbd92bf167cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eadc4f3314914914be117efcf09d37ae', 'request_id': 'req-e6ee2f78-7e8a-4a7d-b4d7-cbd92bf167cf'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:38.308331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e6ee2f78-7e8a-4a7d-b4d7-cbd92bf167cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eadc4f3314914914be117efcf09d37ae', 'request_id': 'req-e6ee2f78-7e8a-4a7d-b4d7-cbd92bf167cf'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:38.331765 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e6ee2f78-7e8a-4a7d-b4d7-cbd92bf167cf admin admin] The token cache is being invalidate because project eadc4f3314914914be117efcf09d37ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:23:38.331957 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e6ee2f78-7e8a-4a7d-b4d7-cbd92bf167cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:38.332863 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e6ee2f78-7e8a-4a7d-b4d7-cbd92bf167cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:38.336356 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 911/1827] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:23:38 2022] DELETE /identity/v3/projects/eadc4f3314914914be117efcf09d37ae => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:23:38.340442 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516fe445-8546-4870-b8b9-cbf353fa4625 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:38.342851 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-516fe445-8546-4870-b8b9-cbf353fa4625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:38.452240 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516fe445-8546-4870-b8b9-cbf353fa4625 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:38.583538 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9418993-a7bd-4a00-9419-531cfd42476f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:38.584703 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9418993-a7bd-4a00-9419-531cfd42476f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:38.584993 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9418993-a7bd-4a00-9419-531cfd42476f admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:38.585270 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9418993-a7bd-4a00-9419-531cfd42476f admin admin] PATH_INFO: `/v3/users/a78da349708e41329cf66411b933a71c` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:38.587463 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9418993-a7bd-4a00-9419-531cfd42476f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a78da349708e41329cf66411b933a71c)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:38.590019 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9418993-a7bd-4a00-9419-531cfd42476f admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:38.767853 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b9418993-a7bd-4a00-9419-531cfd42476f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a78da349708e41329cf66411b933a71c'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:38.797108 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b9418993-a7bd-4a00-9419-531cfd42476f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a78da349708e41329cf66411b933a71c'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:38.797948 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b9418993-a7bd-4a00-9419-531cfd42476f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a78da349708e41329cf66411b933a71c'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:38.799724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b9418993-a7bd-4a00-9419-531cfd42476f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a78da349708e41329cf66411b933a71c'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:38.814019 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:38.823729 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b9418993-a7bd-4a00-9419-531cfd42476f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a78da349708e41329cf66411b933a71c'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:38.848334 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 917/1828] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:23:38 2022] DELETE /identity/v3/users/a78da349708e41329cf66411b933a71c => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:39.083187 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee2f78-7e8a-4a7d-b4d7-cbd92bf167cf admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:39.084782 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e6ee2f78-7e8a-4a7d-b4d7-cbd92bf167cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:39.098722 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee2f78-7e8a-4a7d-b4d7-cbd92bf167cf admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:39.179030 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e237c8-0d16-4831-a64f-4b137333ac35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:39.179924 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e237c8-0d16-4831-a64f-4b137333ac35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:39.180211 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e237c8-0d16-4831-a64f-4b137333ac35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:39.180494 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e237c8-0d16-4831-a64f-4b137333ac35 admin admin] PATH_INFO: `/v3/projects/6c3795c0e635473495f06362c78505d2` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:39.181915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e237c8-0d16-4831-a64f-4b137333ac35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c3795c0e635473495f06362c78505d2)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:39.183857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e237c8-0d16-4831-a64f-4b137333ac35 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:39.247301 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-03e237c8-0d16-4831-a64f-4b137333ac35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c3795c0e635473495f06362c78505d2', 'request_id': 'req-03e237c8-0d16-4831-a64f-4b137333ac35'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:39.250514 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:39.255572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-03e237c8-0d16-4831-a64f-4b137333ac35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c3795c0e635473495f06362c78505d2', 'request_id': 'req-03e237c8-0d16-4831-a64f-4b137333ac35'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:39.268238 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-03e237c8-0d16-4831-a64f-4b137333ac35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c3795c0e635473495f06362c78505d2', 'request_id': 'req-03e237c8-0d16-4831-a64f-4b137333ac35'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:39.290687 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-03e237c8-0d16-4831-a64f-4b137333ac35 admin admin] The token cache is being invalidate because project 6c3795c0e635473495f06362c78505d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:23:39.293274 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-03e237c8-0d16-4831-a64f-4b137333ac35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:39.294117 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-03e237c8-0d16-4831-a64f-4b137333ac35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:39.296400 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 912/1829] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:23:39 2022] DELETE /identity/v3/projects/6c3795c0e635473495f06362c78505d2 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:39.300179 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9418993-a7bd-4a00-9419-531cfd42476f admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:39.302120 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b9418993-a7bd-4a00-9419-531cfd42476f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:39.315957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9418993-a7bd-4a00-9419-531cfd42476f admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:39.387890 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011dfb3-f8cb-45b1-97ba-66a686c2f8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:39.388790 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011dfb3-f8cb-45b1-97ba-66a686c2f8f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:39.389635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011dfb3-f8cb-45b1-97ba-66a686c2f8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:39.390006 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011dfb3-f8cb-45b1-97ba-66a686c2f8f5 admin admin] PATH_INFO: `/v3/users/3e0fad200c074a04aec9cfc1779d23c4` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:39.391294 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011dfb3-f8cb-45b1-97ba-66a686c2f8f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e0fad200c074a04aec9cfc1779d23c4)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:39.394143 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011dfb3-f8cb-45b1-97ba-66a686c2f8f5 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:39.452954 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-6011dfb3-f8cb-45b1-97ba-66a686c2f8f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e0fad200c074a04aec9cfc1779d23c4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:39.462335 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-6011dfb3-f8cb-45b1-97ba-66a686c2f8f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e0fad200c074a04aec9cfc1779d23c4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:39.463380 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-6011dfb3-f8cb-45b1-97ba-66a686c2f8f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e0fad200c074a04aec9cfc1779d23c4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:39.464186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-6011dfb3-f8cb-45b1-97ba-66a686c2f8f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e0fad200c074a04aec9cfc1779d23c4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:39.484685 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e237c8-0d16-4831-a64f-4b137333ac35 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:39.485959 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-03e237c8-0d16-4831-a64f-4b137333ac35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:39.507189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e237c8-0d16-4831-a64f-4b137333ac35 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:39.514222 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7d01c-cfb6-464c-b81e-c55a85128a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:39.515208 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7d01c-cfb6-464c-b81e-c55a85128a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:39.515616 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7d01c-cfb6-464c-b81e-c55a85128a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:39.516002 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7d01c-cfb6-464c-b81e-c55a85128a6a admin admin] PATH_INFO: `/v3/projects/e69782156b46499b85f3bff713d92faf` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:39.517303 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7d01c-cfb6-464c-b81e-c55a85128a6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e69782156b46499b85f3bff713d92faf)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:39.519338 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7d01c-cfb6-464c-b81e-c55a85128a6a admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:39.526470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-6011dfb3-f8cb-45b1-97ba-66a686c2f8f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e0fad200c074a04aec9cfc1779d23c4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:39.555569 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 918/1830] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:23:39 2022] DELETE /identity/v3/users/3e0fad200c074a04aec9cfc1779d23c4 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:39.638330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-86e7d01c-cfb6-464c-b81e-c55a85128a6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e69782156b46499b85f3bff713d92faf', 'request_id': 'req-86e7d01c-cfb6-464c-b81e-c55a85128a6a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:39.648454 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-86e7d01c-cfb6-464c-b81e-c55a85128a6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e69782156b46499b85f3bff713d92faf', 'request_id': 'req-86e7d01c-cfb6-464c-b81e-c55a85128a6a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:39.659350 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-86e7d01c-cfb6-464c-b81e-c55a85128a6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e69782156b46499b85f3bff713d92faf', 'request_id': 'req-86e7d01c-cfb6-464c-b81e-c55a85128a6a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:39.679914 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-86e7d01c-cfb6-464c-b81e-c55a85128a6a admin admin] The token cache is being invalidate because project e69782156b46499b85f3bff713d92faf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:23:39.680378 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-86e7d01c-cfb6-464c-b81e-c55a85128a6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:39.681048 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-86e7d01c-cfb6-464c-b81e-c55a85128a6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:39.686513 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 913/1831] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:23:39 2022] DELETE /identity/v3/projects/e69782156b46499b85f3bff713d92faf => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:39.691937 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba6ee3-41e8-4734-94dd-d0fe75558654 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:39.692313 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba6ee3-41e8-4734-94dd-d0fe75558654 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:39.692665 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba6ee3-41e8-4734-94dd-d0fe75558654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:39.717131 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-a6ba6ee3-41e8-4734-94dd-d0fe75558654 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:39.718564 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a6ba6ee3-41e8-4734-94dd-d0fe75558654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:39.802469 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 919/1832] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:39.810545 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf7da4-3dd1-4c17-8d9a-a34cd2619b75 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:39.811744 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf7da4-3dd1-4c17-8d9a-a34cd2619b75 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:39.812541 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf7da4-3dd1-4c17-8d9a-a34cd2619b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:39.843370 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-15cf7da4-3dd1-4c17-8d9a-a34cd2619b75 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:39.845114 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-15cf7da4-3dd1-4c17-8d9a-a34cd2619b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:39.856327 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 914/1833] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:39.861587 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba6ee3-41e8-4734-94dd-d0fe75558654 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:39.868416 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:39.874870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba6ee3-41e8-4734-94dd-d0fe75558654 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:39.880697 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df361d7-ba55-44b8-80d1-9976739643ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:39.881457 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df361d7-ba55-44b8-80d1-9976739643ad admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:39.881804 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df361d7-ba55-44b8-80d1-9976739643ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:39.882179 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df361d7-ba55-44b8-80d1-9976739643ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:39.882970 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df361d7-ba55-44b8-80d1-9976739643ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:23:39.883344 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df361d7-ba55-44b8-80d1-9976739643ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:39.885024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df361d7-ba55-44b8-80d1-9976739643ad admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:39.897735 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 920/1834] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:23:39.902581 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf7da4-3dd1-4c17-8d9a-a34cd2619b75 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:39.912579 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf7da4-3dd1-4c17-8d9a-a34cd2619b75 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:39.919057 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675bee5-63b2-4712-a507-ece670fed9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:39.919839 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675bee5-63b2-4712-a507-ece670fed9df admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:39.920741 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675bee5-63b2-4712-a507-ece670fed9df admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:39.921264 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675bee5-63b2-4712-a507-ece670fed9df admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:39.922103 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2675bee5-63b2-4712-a507-ece670fed9df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:39.924151 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2675bee5-63b2-4712-a507-ece670fed9df admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:39.954956 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 915/1835] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:23:39 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:23:39.959360 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df361d7-ba55-44b8-80d1-9976739643ad admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:39.972199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df361d7-ba55-44b8-80d1-9976739643ad admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:40.037337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57d9cc-b29d-4692-b1de-9ccfbf6e176c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:40.038300 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57d9cc-b29d-4692-b1de-9ccfbf6e176c admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:40.038828 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57d9cc-b29d-4692-b1de-9ccfbf6e176c admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:40.039280 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57d9cc-b29d-4692-b1de-9ccfbf6e176c admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:40.040225 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57d9cc-b29d-4692-b1de-9ccfbf6e176c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:40.042928 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57d9cc-b29d-4692-b1de-9ccfbf6e176c admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:40.074880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 921/1836] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:23:39 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:23:40.076378 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675bee5-63b2-4712-a507-ece670fed9df admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:40.089881 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675bee5-63b2-4712-a507-ece670fed9df admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:40.097018 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c09e9-695d-4bad-a2bb-d0dae05fbe48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:40.097495 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c09e9-695d-4bad-a2bb-d0dae05fbe48 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:40.097777 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c09e9-695d-4bad-a2bb-d0dae05fbe48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:40.098081 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c09e9-695d-4bad-a2bb-d0dae05fbe48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:40.098946 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c09e9-695d-4bad-a2bb-d0dae05fbe48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:40.100596 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c09e9-695d-4bad-a2bb-d0dae05fbe48 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:40.108333 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57d9cc-b29d-4692-b1de-9ccfbf6e176c admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:40.110141 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-de57d9cc-b29d-4692-b1de-9ccfbf6e176c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:40.114063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 916/1837] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:23:40.116839 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c09e9-695d-4bad-a2bb-d0dae05fbe48 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:40.125833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57d9cc-b29d-4692-b1de-9ccfbf6e176c admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:40.127645 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c09e9-695d-4bad-a2bb-d0dae05fbe48 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:40.131213 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcebbc6a-db16-46bf-be16-3469cdd09355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:40.132268 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebbc6a-db16-46bf-be16-3469cdd09355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:40.132382 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a1e15-47e6-4776-94da-eb75c3a3ea1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:40.132556 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebbc6a-db16-46bf-be16-3469cdd09355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:40.132870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebbc6a-db16-46bf-be16-3469cdd09355 admin admin] PATH_INFO: `/v3/projects/0fcf479dd46642979fb5dff74dce05f7` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:40.132956 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a1e15-47e6-4776-94da-eb75c3a3ea1a admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:40.133183 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a1e15-47e6-4776-94da-eb75c3a3ea1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:40.133455 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a1e15-47e6-4776-94da-eb75c3a3ea1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:40.134050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcebbc6a-db16-46bf-be16-3469cdd09355 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fcf479dd46642979fb5dff74dce05f7)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:40.134213 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a1e15-47e6-4776-94da-eb75c3a3ea1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:40.135823 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a1e15-47e6-4776-94da-eb75c3a3ea1a admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:40.136029 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcebbc6a-db16-46bf-be16-3469cdd09355 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:40.145945 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 917/1838] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:23:40.149952 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a1e15-47e6-4776-94da-eb75c3a3ea1a admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:40.160882 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a1e15-47e6-4776-94da-eb75c3a3ea1a admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:40.167206 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daae8b5-61ba-4277-adec-339b8336fd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:40.168245 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daae8b5-61ba-4277-adec-339b8336fd62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:40.168654 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daae8b5-61ba-4277-adec-339b8336fd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:40.169102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daae8b5-61ba-4277-adec-339b8336fd62 admin admin] PATH_INFO: `/v3/projects/54c153652c4342cdb9d8cd339ddf2c31/users/ea706e92a10e421fb6bb5a520caa2b49/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:40.187510 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daae8b5-61ba-4277-adec-339b8336fd62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54c153652c4342cdb9d8cd339ddf2c31, user_id=ea706e92a10e421fb6bb5a520caa2b49, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:40.190378 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-bcebbc6a-db16-46bf-be16-3469cdd09355 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fcf479dd46642979fb5dff74dce05f7', 'request_id': 'req-bcebbc6a-db16-46bf-be16-3469cdd09355'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:40.191311 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daae8b5-61ba-4277-adec-339b8336fd62 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:40.197972 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-bcebbc6a-db16-46bf-be16-3469cdd09355 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fcf479dd46642979fb5dff74dce05f7', 'request_id': 'req-bcebbc6a-db16-46bf-be16-3469cdd09355'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:40.209535 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 918/1839] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:23:40 2022] PUT /identity/v3/projects/54c153652c4342cdb9d8cd339ddf2c31/users/ea706e92a10e421fb6bb5a520caa2b49/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:40.215715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0c06f-67e8-4b32-be12-bdb71f95d53a None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:40.216087 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0c06f-67e8-4b32-be12-bdb71f95d53a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:40.216435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0c06f-67e8-4b32-be12-bdb71f95d53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:40.230879 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-bcebbc6a-db16-46bf-be16-3469cdd09355 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fcf479dd46642979fb5dff74dce05f7', 'request_id': 'req-bcebbc6a-db16-46bf-be16-3469cdd09355'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:40.235597 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-0cd0c06f-67e8-4b32-be12-bdb71f95d53a None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:40.238916 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0cd0c06f-67e8-4b32-be12-bdb71f95d53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:40.247659 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-bcebbc6a-db16-46bf-be16-3469cdd09355 admin admin] The token cache is being invalidate because project 0fcf479dd46642979fb5dff74dce05f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:23:40.248969 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-bcebbc6a-db16-46bf-be16-3469cdd09355 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:40.249662 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-bcebbc6a-db16-46bf-be16-3469cdd09355 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:40.252264 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 922/1840] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:23:40 2022] DELETE /identity/v3/projects/0fcf479dd46642979fb5dff74dce05f7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:23:40.256771 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028bce2-1f5e-440b-8ad4-d9bdf30a766f None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:40.257061 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028bce2-1f5e-440b-8ad4-d9bdf30a766f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:40.257341 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028bce2-1f5e-440b-8ad4-d9bdf30a766f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:40.286134 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-3028bce2-1f5e-440b-8ad4-d9bdf30a766f None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:40.287378 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3028bce2-1f5e-440b-8ad4-d9bdf30a766f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:40.298498 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:40.334875 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 919/1841] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:23:40.343439 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0c06f-67e8-4b32-be12-bdb71f95d53a None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:40.344708 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0cd0c06f-67e8-4b32-be12-bdb71f95d53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:40.368121 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 923/1842] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:23:40.376611 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c702e1f-3690-458f-90b9-5ce4f07defc5 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:40.377002 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c702e1f-3690-458f-90b9-5ce4f07defc5 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:40.377314 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c702e1f-3690-458f-90b9-5ce4f07defc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:40.385579 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:40.398143 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-0c702e1f-3690-458f-90b9-5ce4f07defc5 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:40.400013 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0c702e1f-3690-458f-90b9-5ce4f07defc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:40.410739 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 924/1843] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:23:40.413574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0c06f-67e8-4b32-be12-bdb71f95d53a None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:40.414538 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c702e1f-3690-458f-90b9-5ce4f07defc5 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:40.417474 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78e886-083e-44db-a3c9-c376588d9d9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:40.417727 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78e886-083e-44db-a3c9-c376588d9d9c service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:40.418077 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78e886-083e-44db-a3c9-c376588d9d9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:40.418350 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78e886-083e-44db-a3c9-c376588d9d9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:40.425064 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c702e1f-3690-458f-90b9-5ce4f07defc5 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:40.429358 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78e886-083e-44db-a3c9-c376588d9d9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:40.430274 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91a0fc-dbcb-45b8-a837-839e76727af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:40.431003 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91a0fc-dbcb-45b8-a837-839e76727af9 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:40.431114 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78e886-083e-44db-a3c9-c376588d9d9c service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:40.431803 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91a0fc-dbcb-45b8-a837-839e76727af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:40.431803 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91a0fc-dbcb-45b8-a837-839e76727af9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:40.432640 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91a0fc-dbcb-45b8-a837-839e76727af9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:23:40.433018 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91a0fc-dbcb-45b8-a837-839e76727af9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:40.434748 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91a0fc-dbcb-45b8-a837-839e76727af9 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:40.447491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 920/1844] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:23:40.450452 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 925/1845] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:23:40.455832 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78e886-083e-44db-a3c9-c376588d9d9c service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:40.466552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78e886-083e-44db-a3c9-c376588d9d9c service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:40.474597 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1ce26-f969-4fcf-8f92-5f3aeed5fc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:40.475406 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1ce26-f969-4fcf-8f92-5f3aeed5fc89 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:40.475883 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1ce26-f969-4fcf-8f92-5f3aeed5fc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:40.476719 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1ce26-f969-4fcf-8f92-5f3aeed5fc89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:40.477078 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb1ce26-f969-4fcf-8f92-5f3aeed5fc89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:40.479217 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb1ce26-f969-4fcf-8f92-5f3aeed5fc89 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:40.509895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 921/1846] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:23:40 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:23:40.515036 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91a0fc-dbcb-45b8-a837-839e76727af9 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:40.527697 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91a0fc-dbcb-45b8-a837-839e76727af9 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:40.626609 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf7538-7f94-44bc-929c-99e75505390e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:40.627290 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf7538-7f94-44bc-929c-99e75505390e admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:40.627574 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf7538-7f94-44bc-929c-99e75505390e admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:40.628557 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf7538-7f94-44bc-929c-99e75505390e admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:40.628557 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf7538-7f94-44bc-929c-99e75505390e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:40.630471 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf7538-7f94-44bc-929c-99e75505390e admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:40.681912 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 926/1847] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:23:40 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:23:40.683213 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1ce26-f969-4fcf-8f92-5f3aeed5fc89 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:40.722834 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1ce26-f969-4fcf-8f92-5f3aeed5fc89 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:40.739484 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faecc3d4-7610-43d3-b15a-1522be0aabe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:40.740451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecc3d4-7610-43d3-b15a-1522be0aabe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:40.740904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecc3d4-7610-43d3-b15a-1522be0aabe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:40.741220 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecc3d4-7610-43d3-b15a-1522be0aabe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:40.742056 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faecc3d4-7610-43d3-b15a-1522be0aabe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:40.743802 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faecc3d4-7610-43d3-b15a-1522be0aabe9 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:40.773616 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 922/1848] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:23:40.779178 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf7538-7f94-44bc-929c-99e75505390e admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:40.802830 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf7538-7f94-44bc-929c-99e75505390e admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:40.808966 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580775c-8750-46de-bb38-a643816842e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:40.809596 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580775c-8750-46de-bb38-a643816842e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:40.810005 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580775c-8750-46de-bb38-a643816842e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:40.811053 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580775c-8750-46de-bb38-a643816842e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:40.811906 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580775c-8750-46de-bb38-a643816842e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:40.814363 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580775c-8750-46de-bb38-a643816842e9 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:40.849315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 927/1849] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:23:40.850946 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faecc3d4-7610-43d3-b15a-1522be0aabe9 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:40.863387 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faecc3d4-7610-43d3-b15a-1522be0aabe9 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:40.870051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b69481-1f11-427e-8943-f9967095a815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:40.871247 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b69481-1f11-427e-8943-f9967095a815 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:40.871537 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b69481-1f11-427e-8943-f9967095a815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:40.871815 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b69481-1f11-427e-8943-f9967095a815 admin admin] PATH_INFO: `/v3/projects/38d87a96b1394e08a8342f48eb54684c/users/b95082c9e68241c6abcbac2d1a3fb147/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:40.888810 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b69481-1f11-427e-8943-f9967095a815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d87a96b1394e08a8342f48eb54684c, user_id=b95082c9e68241c6abcbac2d1a3fb147, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:40.894212 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b69481-1f11-427e-8943-f9967095a815 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:40.933901 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 923/1850] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:23:40 2022] PUT /identity/v3/projects/38d87a96b1394e08a8342f48eb54684c/users/b95082c9e68241c6abcbac2d1a3fb147/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:23:40.944635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98409a93-9a66-4a61-8bd5-cb04250e629c None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:40.945744 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98409a93-9a66-4a61-8bd5-cb04250e629c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:40.946343 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98409a93-9a66-4a61-8bd5-cb04250e629c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:41.011335 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-98409a93-9a66-4a61-8bd5-cb04250e629c None None] MFA Rules not processed for user `b95082c9e68241c6abcbac2d1a3fb147`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:41.012960 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-98409a93-9a66-4a61-8bd5-cb04250e629c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:41.129882 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b69481-1f11-427e-8943-f9967095a815 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:41.130521 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 928/1851] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:41.204713 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b69481-1f11-427e-8943-f9967095a815 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:41.209659 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af62195-381b-4b77-a929-4e943ee1bc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:41.210406 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af62195-381b-4b77-a929-4e943ee1bc79 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:41.210646 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af62195-381b-4b77-a929-4e943ee1bc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:41.210925 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af62195-381b-4b77-a929-4e943ee1bc79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:41.211724 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af62195-381b-4b77-a929-4e943ee1bc79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:41.213661 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af62195-381b-4b77-a929-4e943ee1bc79 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:41.249013 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98409a93-9a66-4a61-8bd5-cb04250e629c None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:41.250774 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 924/1852] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:23:41 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:23:41.262252 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98409a93-9a66-4a61-8bd5-cb04250e629c None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:41.341773 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:41.356454 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb44c82-52b0-4674-b6bd-579980374a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:41.358460 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb44c82-52b0-4674-b6bd-579980374a08 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:41.358978 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb44c82-52b0-4674-b6bd-579980374a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:41.359680 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb44c82-52b0-4674-b6bd-579980374a08 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:41.361357 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb44c82-52b0-4674-b6bd-579980374a08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:41.366289 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb44c82-52b0-4674-b6bd-579980374a08 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:41.393927 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 929/1853] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:23:41 2022] POST /identity/v3/users => generated 293 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:23:41.397125 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af62195-381b-4b77-a929-4e943ee1bc79 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:41.409352 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af62195-381b-4b77-a929-4e943ee1bc79 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:41.414338 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4d847-513a-4968-8983-2caa6fe02e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:41.415008 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4d847-513a-4968-8983-2caa6fe02e5e admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:41.415294 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4d847-513a-4968-8983-2caa6fe02e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:41.415572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4d847-513a-4968-8983-2caa6fe02e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:41.416302 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4d847-513a-4968-8983-2caa6fe02e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:41.417939 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4d847-513a-4968-8983-2caa6fe02e5e admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:41.435601 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb44c82-52b0-4674-b6bd-579980374a08 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:41.436431 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 925/1854] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:23:41.449219 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb44c82-52b0-4674-b6bd-579980374a08 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:41.456320 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89718c98-7d2c-45cb-aba4-0582101e3718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:41.457276 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89718c98-7d2c-45cb-aba4-0582101e3718 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:41.457787 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89718c98-7d2c-45cb-aba4-0582101e3718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:41.458305 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89718c98-7d2c-45cb-aba4-0582101e3718 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:41.459236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89718c98-7d2c-45cb-aba4-0582101e3718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:41.461694 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89718c98-7d2c-45cb-aba4-0582101e3718 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:41.476902 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 930/1855] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:23:41.478823 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4d847-513a-4968-8983-2caa6fe02e5e admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:41.490670 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4d847-513a-4968-8983-2caa6fe02e5e admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:41.503100 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc903df-881f-40e8-9d0f-619d3d3026d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:41.504167 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc903df-881f-40e8-9d0f-619d3d3026d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:41.504456 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc903df-881f-40e8-9d0f-619d3d3026d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:41.504808 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc903df-881f-40e8-9d0f-619d3d3026d9 admin admin] PATH_INFO: `/v3/projects/f0b840cee17a4f8d9fab292e482c9f79/users/21dac1833ccd47c89a26fcbc921aea97/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:41.508793 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:41.523475 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc903df-881f-40e8-9d0f-619d3d3026d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b840cee17a4f8d9fab292e482c9f79, user_id=21dac1833ccd47c89a26fcbc921aea97, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:41.526887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc903df-881f-40e8-9d0f-619d3d3026d9 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:41.558510 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 926/1856] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:23:41 2022] PUT /identity/v3/projects/f0b840cee17a4f8d9fab292e482c9f79/users/21dac1833ccd47c89a26fcbc921aea97/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:41.564025 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5f1c9-f782-4890-95dd-57ff5026ddaf None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:41.564434 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5f1c9-f782-4890-95dd-57ff5026ddaf None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:41.564874 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5f1c9-f782-4890-95dd-57ff5026ddaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:41.586051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e986b2-bf43-4fd4-ab8c-d5aa44b7462c None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:41.586748 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e986b2-bf43-4fd4-ab8c-d5aa44b7462c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:41.587326 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e986b2-bf43-4fd4-ab8c-d5aa44b7462c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:41.626367 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-09a5f1c9-f782-4890-95dd-57ff5026ddaf None None] MFA Rules not processed for user `21dac1833ccd47c89a26fcbc921aea97`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:41.627867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-09a5f1c9-f782-4890-95dd-57ff5026ddaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:41.654014 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-74e986b2-bf43-4fd4-ab8c-d5aa44b7462c None None] MFA Rules not processed for user `ea706e92a10e421fb6bb5a520caa2b49`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:41.655291 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-74e986b2-bf43-4fd4-ab8c-d5aa44b7462c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:41.747102 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 931/1857] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:41.754786 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5f1c9-f782-4890-95dd-57ff5026ddaf None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:41.770637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 927/1858] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:23:41.771792 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e986b2-bf43-4fd4-ab8c-d5aa44b7462c None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:41.777193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-74e986b2-bf43-4fd4-ab8c-d5aa44b7462c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:41.889260 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5f1c9-f782-4890-95dd-57ff5026ddaf None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:41.896060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559a28d-b6ec-4453-945a-288bb4123540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:41.896237 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559a28d-b6ec-4453-945a-288bb4123540 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:41.896495 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559a28d-b6ec-4453-945a-288bb4123540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:41.896770 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559a28d-b6ec-4453-945a-288bb4123540 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:41.898174 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6559a28d-b6ec-4453-945a-288bb4123540 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:41.899225 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e986b2-bf43-4fd4-ab8c-d5aa44b7462c None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:41.900221 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6559a28d-b6ec-4453-945a-288bb4123540 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:41.930430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f420bc3-109c-44d0-8e79-76c097465cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:41.931090 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f420bc3-109c-44d0-8e79-76c097465cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:41.931570 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f420bc3-109c-44d0-8e79-76c097465cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:41.931857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f420bc3-109c-44d0-8e79-76c097465cb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:41.932563 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f420bc3-109c-44d0-8e79-76c097465cb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:41.934744 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f420bc3-109c-44d0-8e79-76c097465cb4 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:41.946288 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 932/1859] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:23:41 2022] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:23:41.950258 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559a28d-b6ec-4453-945a-288bb4123540 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:41.977633 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 928/1860] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:23:41 2022] POST /identity/v3/projects => generated 373 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:23:41.983719 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f420bc3-109c-44d0-8e79-76c097465cb4 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:42.060551 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:42.084870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559a28d-b6ec-4453-945a-288bb4123540 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:42.115234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f420bc3-109c-44d0-8e79-76c097465cb4 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:42.122317 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b51c4c-3754-4d85-ba16-4e5a47d50032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:42.123758 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b51c4c-3754-4d85-ba16-4e5a47d50032 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:42.124244 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b51c4c-3754-4d85-ba16-4e5a47d50032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:42.124621 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b51c4c-3754-4d85-ba16-4e5a47d50032 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:42.125420 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b51c4c-3754-4d85-ba16-4e5a47d50032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:42.127715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b51c4c-3754-4d85-ba16-4e5a47d50032 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:42.135380 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:42.182584 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 929/1861] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:23:41 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:23:42.183814 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b51c4c-3754-4d85-ba16-4e5a47d50032 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:42.214682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b51c4c-3754-4d85-ba16-4e5a47d50032 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:42.224221 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d81e2-48ee-4d24-9b57-8f902971d931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:42.224418 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9e222-c2d5-4f0a-b80b-71c09bec980f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:42.225081 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9e222-c2d5-4f0a-b80b-71c09bec980f admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:42.225362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9e222-c2d5-4f0a-b80b-71c09bec980f admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:42.225634 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9e222-c2d5-4f0a-b80b-71c09bec980f admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:42.226213 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d81e2-48ee-4d24-9b57-8f902971d931 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:42.226389 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb9e222-c2d5-4f0a-b80b-71c09bec980f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:42.226882 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d81e2-48ee-4d24-9b57-8f902971d931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:42.227352 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d81e2-48ee-4d24-9b57-8f902971d931 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:42.228117 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb9e222-c2d5-4f0a-b80b-71c09bec980f admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:42.228470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d81e2-48ee-4d24-9b57-8f902971d931 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:42.230841 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d81e2-48ee-4d24-9b57-8f902971d931 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:42.240328 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 930/1862] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:23:42.243846 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9e222-c2d5-4f0a-b80b-71c09bec980f admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:42.264807 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 933/1863] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:23:41 2022] POST /identity/v3/users => generated 299 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:23:42.268001 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d81e2-48ee-4d24-9b57-8f902971d931 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:42.276236 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9e222-c2d5-4f0a-b80b-71c09bec980f admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:42.281578 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a18adc-0158-48a1-8094-794f0c0b5557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:42.282515 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a18adc-0158-48a1-8094-794f0c0b5557 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:42.282796 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a18adc-0158-48a1-8094-794f0c0b5557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:42.283071 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a18adc-0158-48a1-8094-794f0c0b5557 admin admin] PATH_INFO: `/v3/projects/6887b328484341e685ef0718e1a1cea9/users/05e4f5b1fa3e4e89a8bf2dac137175d2/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:42.290113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d81e2-48ee-4d24-9b57-8f902971d931 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:42.295640 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4364b-0729-4b04-8599-c3b614df362a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:42.296343 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4364b-0729-4b04-8599-c3b614df362a admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:42.296630 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4364b-0729-4b04-8599-c3b614df362a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:42.296916 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4364b-0729-4b04-8599-c3b614df362a admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:42.297642 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4364b-0729-4b04-8599-c3b614df362a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:42.299493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4364b-0729-4b04-8599-c3b614df362a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:42.310916 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a18adc-0158-48a1-8094-794f0c0b5557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6887b328484341e685ef0718e1a1cea9, user_id=05e4f5b1fa3e4e89a8bf2dac137175d2, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:42.313887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a18adc-0158-48a1-8094-794f0c0b5557 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:42.314082 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 934/1864] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:23:42.314940 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4364b-0729-4b04-8599-c3b614df362a admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:42.325520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4364b-0729-4b04-8599-c3b614df362a admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:42.331889 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ca0e1-2261-4ad3-bcfe-e4f4ad09ecfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:42.332981 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ca0e1-2261-4ad3-bcfe-e4f4ad09ecfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:42.333365 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ca0e1-2261-4ad3-bcfe-e4f4ad09ecfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:42.333765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ca0e1-2261-4ad3-bcfe-e4f4ad09ecfc admin admin] PATH_INFO: `/v3/projects/c96c9e8d95a243238f4631126ce36445/users/f0a1221f9e6c4e50adafbe735ed67a14/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:42.337426 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 931/1865] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:23:42 2022] PUT /identity/v3/projects/6887b328484341e685ef0718e1a1cea9/users/05e4f5b1fa3e4e89a8bf2dac137175d2/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:23:42.343671 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a18adc-0158-48a1-8094-794f0c0b5557 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:42.354841 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ca0e1-2261-4ad3-bcfe-e4f4ad09ecfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96c9e8d95a243238f4631126ce36445, user_id=f0a1221f9e6c4e50adafbe735ed67a14, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:42.359166 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ca0e1-2261-4ad3-bcfe-e4f4ad09ecfc admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:42.387435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 935/1866] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:23:42 2022] PUT /identity/v3/projects/c96c9e8d95a243238f4631126ce36445/users/f0a1221f9e6c4e50adafbe735ed67a14/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:42.391837 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ca0e1-2261-4ad3-bcfe-e4f4ad09ecfc admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:42.431937 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a18adc-0158-48a1-8094-794f0c0b5557 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:42.487027 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ca0e1-2261-4ad3-bcfe-e4f4ad09ecfc admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:42.492796 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e81f9-e45e-4d75-93d4-4aa5f8c3657d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:42.493491 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e81f9-e45e-4d75-93d4-4aa5f8c3657d admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:42.493872 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e81f9-e45e-4d75-93d4-4aa5f8c3657d admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:42.494879 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e81f9-e45e-4d75-93d4-4aa5f8c3657d admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:42.495625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e81f9-e45e-4d75-93d4-4aa5f8c3657d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:42.497317 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e81f9-e45e-4d75-93d4-4aa5f8c3657d admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:42.521815 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 936/1867] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:23:42.526060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e81f9-e45e-4d75-93d4-4aa5f8c3657d admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:42.532713 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af704697-b1b6-4ac5-b6a4-1b102649478e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:42.533559 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af704697-b1b6-4ac5-b6a4-1b102649478e admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:42.534044 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af704697-b1b6-4ac5-b6a4-1b102649478e admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:42.534412 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af704697-b1b6-4ac5-b6a4-1b102649478e admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:42.535260 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af704697-b1b6-4ac5-b6a4-1b102649478e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:42.536996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af704697-b1b6-4ac5-b6a4-1b102649478e admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:42.542039 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e81f9-e45e-4d75-93d4-4aa5f8c3657d admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:42.550091 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bac7d-9fca-41c9-ac95-a1f07e109884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:42.551596 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bac7d-9fca-41c9-ac95-a1f07e109884 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:42.552029 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bac7d-9fca-41c9-ac95-a1f07e109884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:42.552500 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bac7d-9fca-41c9-ac95-a1f07e109884 admin admin] PATH_INFO: `/v3/projects/c96c9e8d95a243238f4631126ce36445/users/f0a1221f9e6c4e50adafbe735ed67a14/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:42.555630 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38bac7d-9fca-41c9-ac95-a1f07e109884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96c9e8d95a243238f4631126ce36445, user_id=f0a1221f9e6c4e50adafbe735ed67a14, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:42.560160 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 932/1868] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:23:42.560293 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38bac7d-9fca-41c9-ac95-a1f07e109884 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:42.561311 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af704697-b1b6-4ac5-b6a4-1b102649478e admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:42.572981 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 937/1869] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:23:42 2022] PUT /identity/v3/projects/c96c9e8d95a243238f4631126ce36445/users/f0a1221f9e6c4e50adafbe735ed67a14/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:23:42.575615 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af704697-b1b6-4ac5-b6a4-1b102649478e admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:42.584640 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcad5d-cc86-4a2d-b2d3-baa21bc787dc None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:42.584640 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcad5d-cc86-4a2d-b2d3-baa21bc787dc None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:42.584947 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcad5d-cc86-4a2d-b2d3-baa21bc787dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:42.647195 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-11fcad5d-cc86-4a2d-b2d3-baa21bc787dc None None] MFA Rules not processed for user `f0a1221f9e6c4e50adafbe735ed67a14`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:42.648660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:42.649635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-11fcad5d-cc86-4a2d-b2d3-baa21bc787dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:42.659923 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6628a2-f67c-48d7-8bce-918f39a739a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:42.661631 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6628a2-f67c-48d7-8bce-918f39a739a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:42.662167 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6628a2-f67c-48d7-8bce-918f39a739a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:42.662622 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6628a2-f67c-48d7-8bce-918f39a739a8 admin admin] PATH_INFO: `/v3/projects/6887b328484341e685ef0718e1a1cea9/users/05e4f5b1fa3e4e89a8bf2dac137175d2/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:42.665183 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6628a2-f67c-48d7-8bce-918f39a739a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6887b328484341e685ef0718e1a1cea9, user_id=05e4f5b1fa3e4e89a8bf2dac137175d2, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:42.667989 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6628a2-f67c-48d7-8bce-918f39a739a8 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:42.674365 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:42.686107 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 933/1870] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:23:42 2022] PUT /identity/v3/projects/6887b328484341e685ef0718e1a1cea9/users/05e4f5b1fa3e4e89a8bf2dac137175d2/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:42.760132 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 938/1871] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:23:42.777282 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6628a2-f67c-48d7-8bce-918f39a739a8 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:42.780153 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-fc6628a2-f67c-48d7-8bce-918f39a739a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:42.884900 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6628a2-f67c-48d7-8bce-918f39a739a8 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:42.890558 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5904c5-08a6-4496-9e2a-0de74103cb7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:42.891654 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5904c5-08a6-4496-9e2a-0de74103cb7d service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:42.891974 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5904c5-08a6-4496-9e2a-0de74103cb7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:42.892504 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5904c5-08a6-4496-9e2a-0de74103cb7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:42.983428 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5904c5-08a6-4496-9e2a-0de74103cb7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:42.985140 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5904c5-08a6-4496-9e2a-0de74103cb7d service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:43.013380 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 934/1872] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:23:43.759774 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063864a-736a-471d-bc56-4af3a72e9ed9 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:43.760296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063864a-736a-471d-bc56-4af3a72e9ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:43.760296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063864a-736a-471d-bc56-4af3a72e9ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:43.823617 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-4063864a-736a-471d-bc56-4af3a72e9ed9 None None] MFA Rules not processed for user `05e4f5b1fa3e4e89a8bf2dac137175d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:43.826182 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4063864a-736a-471d-bc56-4af3a72e9ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:43.919547 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 939/1873] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:43.941073 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5904c5-08a6-4496-9e2a-0de74103cb7d service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:43.942886 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-eb5904c5-08a6-4496-9e2a-0de74103cb7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:43.955645 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5904c5-08a6-4496-9e2a-0de74103cb7d service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:43.959385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75301084-7d47-4e62-bd74-db52f1476db2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:43.960045 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75301084-7d47-4e62-bd74-db52f1476db2 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:43.960333 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75301084-7d47-4e62-bd74-db52f1476db2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:43.960639 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75301084-7d47-4e62-bd74-db52f1476db2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:44.027230 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75301084-7d47-4e62-bd74-db52f1476db2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:44.028741 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75301084-7d47-4e62-bd74-db52f1476db2 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:44.040000 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 935/1874] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:23:44.705311 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063864a-736a-471d-bc56-4af3a72e9ed9 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:44.716247 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063864a-736a-471d-bc56-4af3a72e9ed9 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:44.722078 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc618d1-7bd6-4bd3-bc11-458081a24600 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:44.722844 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc618d1-7bd6-4bd3-bc11-458081a24600 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:44.723242 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc618d1-7bd6-4bd3-bc11-458081a24600 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:44.723633 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc618d1-7bd6-4bd3-bc11-458081a24600 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:44.806932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc618d1-7bd6-4bd3-bc11-458081a24600 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:44.808644 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc618d1-7bd6-4bd3-bc11-458081a24600 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:44.818801 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 940/1875] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:23:45.474133 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75301084-7d47-4e62-bd74-db52f1476db2 service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:45.483303 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75301084-7d47-4e62-bd74-db52f1476db2 service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:45.485003 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc618d1-7bd6-4bd3-bc11-458081a24600 service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:45.488701 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c2242-dc41-4da1-804e-955ce986a654 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:45.489545 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c2242-dc41-4da1-804e-955ce986a654 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:45.490258 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c2242-dc41-4da1-804e-955ce986a654 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:45.490517 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c2242-dc41-4da1-804e-955ce986a654 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:45.496931 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc618d1-7bd6-4bd3-bc11-458081a24600 service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:45.501432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c2242-dc41-4da1-804e-955ce986a654 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:45.501952 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ec3af-b72d-444d-8d7d-b576e311d014 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:45.502588 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ec3af-b72d-444d-8d7d-b576e311d014 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:45.502870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ec3af-b72d-444d-8d7d-b576e311d014 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:45.503146 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ec3af-b72d-444d-8d7d-b576e311d014 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:45.503280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c2242-dc41-4da1-804e-955ce986a654 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:45.521817 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 936/1876] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:45 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:23:45.553980 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:45.579671 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ec3af-b72d-444d-8d7d-b576e311d014 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:45.581122 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ec3af-b72d-444d-8d7d-b576e311d014 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:45.590954 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 941/1877] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:23:49.565634 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c2242-dc41-4da1-804e-955ce986a654 service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:49.601495 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:49.638144 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c2242-dc41-4da1-804e-955ce986a654 service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:49.652269 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f6a58-d06c-4c49-90b6-c309f4673195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:49.653156 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f6a58-d06c-4c49-90b6-c309f4673195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:49.653474 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f6a58-d06c-4c49-90b6-c309f4673195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:49.653713 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f6a58-d06c-4c49-90b6-c309f4673195 admin admin] PATH_INFO: `/v3/users/b95082c9e68241c6abcbac2d1a3fb147` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:49.655007 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f6a58-d06c-4c49-90b6-c309f4673195 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b95082c9e68241c6abcbac2d1a3fb147)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:49.657123 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f6a58-d06c-4c49-90b6-c309f4673195 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:49.729041 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a95f6a58-d06c-4c49-90b6-c309f4673195 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b95082c9e68241c6abcbac2d1a3fb147'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:49.738954 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a95f6a58-d06c-4c49-90b6-c309f4673195 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b95082c9e68241c6abcbac2d1a3fb147'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:49.740043 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a95f6a58-d06c-4c49-90b6-c309f4673195 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b95082c9e68241c6abcbac2d1a3fb147'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:49.822020 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a95f6a58-d06c-4c49-90b6-c309f4673195 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b95082c9e68241c6abcbac2d1a3fb147'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:49.822972 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a95f6a58-d06c-4c49-90b6-c309f4673195 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b95082c9e68241c6abcbac2d1a3fb147'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:49.848486 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 937/1878] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:23:49 2022] DELETE /identity/v3/users/b95082c9e68241c6abcbac2d1a3fb147 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:49.849877 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22264c5-4d38-4c80-8f72-30ce58001fb2 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:49.850346 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22264c5-4d38-4c80-8f72-30ce58001fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:49.850529 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22264c5-4d38-4c80-8f72-30ce58001fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:49.871286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e22264c5-4d38-4c80-8f72-30ce58001fb2 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:49.872786 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e22264c5-4d38-4c80-8f72-30ce58001fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:49.978951 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 942/1879] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:23:49.988595 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f6a58-d06c-4c49-90b6-c309f4673195 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:49.990335 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a95f6a58-d06c-4c49-90b6-c309f4673195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:50.060716 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f6a58-d06c-4c49-90b6-c309f4673195 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:50.064743 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9552f-3ef1-4367-8060-910b0c80b6da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:50.065414 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9552f-3ef1-4367-8060-910b0c80b6da service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:50.065703 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9552f-3ef1-4367-8060-910b0c80b6da service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:50.066031 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9552f-3ef1-4367-8060-910b0c80b6da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:50.076764 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9552f-3ef1-4367-8060-910b0c80b6da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:50.078497 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9552f-3ef1-4367-8060-910b0c80b6da service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:50.089478 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 938/1880] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:23:50.784699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22264c5-4d38-4c80-8f72-30ce58001fb2 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:50.786524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e22264c5-4d38-4c80-8f72-30ce58001fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:50.804001 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22264c5-4d38-4c80-8f72-30ce58001fb2 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:50.809474 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ddf512-4a5e-4f01-88a1-dfaf197bb836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:50.811144 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddf512-4a5e-4f01-88a1-dfaf197bb836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:50.811432 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddf512-4a5e-4f01-88a1-dfaf197bb836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:50.811996 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddf512-4a5e-4f01-88a1-dfaf197bb836 admin admin] PATH_INFO: `/v3/projects/38d87a96b1394e08a8342f48eb54684c` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:50.813231 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ddf512-4a5e-4f01-88a1-dfaf197bb836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38d87a96b1394e08a8342f48eb54684c)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:50.815493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ddf512-4a5e-4f01-88a1-dfaf197bb836 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:50.890299 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-08ddf512-4a5e-4f01-88a1-dfaf197bb836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38d87a96b1394e08a8342f48eb54684c', 'request_id': 'req-08ddf512-4a5e-4f01-88a1-dfaf197bb836'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:50.897722 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-08ddf512-4a5e-4f01-88a1-dfaf197bb836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38d87a96b1394e08a8342f48eb54684c', 'request_id': 'req-08ddf512-4a5e-4f01-88a1-dfaf197bb836'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:50.907969 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-08ddf512-4a5e-4f01-88a1-dfaf197bb836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38d87a96b1394e08a8342f48eb54684c', 'request_id': 'req-08ddf512-4a5e-4f01-88a1-dfaf197bb836'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:50.938674 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-08ddf512-4a5e-4f01-88a1-dfaf197bb836 admin admin] The token cache is being invalidate because project 38d87a96b1394e08a8342f48eb54684c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:23:50.938967 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-08ddf512-4a5e-4f01-88a1-dfaf197bb836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:50.939860 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-08ddf512-4a5e-4f01-88a1-dfaf197bb836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:50.945366 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 943/1881] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:23:50 2022] DELETE /identity/v3/projects/38d87a96b1394e08a8342f48eb54684c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:50.946459 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9552f-3ef1-4367-8060-910b0c80b6da service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:50.959086 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9552f-3ef1-4367-8060-910b0c80b6da service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:51.039838 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:51.057048 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0f053-0b32-4358-9d26-584ea689c3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:51.058884 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0f053-0b32-4358-9d26-584ea689c3e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:51.059583 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0f053-0b32-4358-9d26-584ea689c3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:51.060910 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0f053-0b32-4358-9d26-584ea689c3e7 admin admin] PATH_INFO: `/v3/users/21dac1833ccd47c89a26fcbc921aea97` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:51.063218 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0f053-0b32-4358-9d26-584ea689c3e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21dac1833ccd47c89a26fcbc921aea97)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:51.065145 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0f053-0b32-4358-9d26-584ea689c3e7 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:51.150394 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-50b0f053-0b32-4358-9d26-584ea689c3e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21dac1833ccd47c89a26fcbc921aea97'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:51.157921 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-50b0f053-0b32-4358-9d26-584ea689c3e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21dac1833ccd47c89a26fcbc921aea97'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:51.158657 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-50b0f053-0b32-4358-9d26-584ea689c3e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21dac1833ccd47c89a26fcbc921aea97'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:51.176056 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-50b0f053-0b32-4358-9d26-584ea689c3e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21dac1833ccd47c89a26fcbc921aea97'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:51.176619 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-50b0f053-0b32-4358-9d26-584ea689c3e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21dac1833ccd47c89a26fcbc921aea97'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:51.195562 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 939/1882] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:23:50 2022] DELETE /identity/v3/users/21dac1833ccd47c89a26fcbc921aea97 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:51.794949 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ddf512-4a5e-4f01-88a1-dfaf197bb836 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:51.797297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-08ddf512-4a5e-4f01-88a1-dfaf197bb836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:51.848768 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ddf512-4a5e-4f01-88a1-dfaf197bb836 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:51.939928 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:51.947552 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c206ee-b3df-4c2e-90bf-be12d7a1b48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:51.948908 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c206ee-b3df-4c2e-90bf-be12d7a1b48b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:51.949566 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c206ee-b3df-4c2e-90bf-be12d7a1b48b admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:51.950190 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c206ee-b3df-4c2e-90bf-be12d7a1b48b admin admin] PATH_INFO: `/v3/projects/f0b840cee17a4f8d9fab292e482c9f79` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:51.952187 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c206ee-b3df-4c2e-90bf-be12d7a1b48b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0b840cee17a4f8d9fab292e482c9f79)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:51.954713 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c206ee-b3df-4c2e-90bf-be12d7a1b48b admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:52.031259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-67c206ee-b3df-4c2e-90bf-be12d7a1b48b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0b840cee17a4f8d9fab292e482c9f79', 'request_id': 'req-67c206ee-b3df-4c2e-90bf-be12d7a1b48b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:52.044333 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-67c206ee-b3df-4c2e-90bf-be12d7a1b48b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0b840cee17a4f8d9fab292e482c9f79', 'request_id': 'req-67c206ee-b3df-4c2e-90bf-be12d7a1b48b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:52.056846 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-67c206ee-b3df-4c2e-90bf-be12d7a1b48b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0b840cee17a4f8d9fab292e482c9f79', 'request_id': 'req-67c206ee-b3df-4c2e-90bf-be12d7a1b48b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:52.073395 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-67c206ee-b3df-4c2e-90bf-be12d7a1b48b admin admin] The token cache is being invalidate because project f0b840cee17a4f8d9fab292e482c9f79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:23:52.073605 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-67c206ee-b3df-4c2e-90bf-be12d7a1b48b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:52.074297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-67c206ee-b3df-4c2e-90bf-be12d7a1b48b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:52.079462 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 944/1883] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:23:51 2022] DELETE /identity/v3/projects/f0b840cee17a4f8d9fab292e482c9f79 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:52.080638 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0f053-0b32-4358-9d26-584ea689c3e7 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:52.082268 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-50b0f053-0b32-4358-9d26-584ea689c3e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:52.108784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0f053-0b32-4358-9d26-584ea689c3e7 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:52.189760 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6dd71b-e5f8-4d9d-b22f-3be60195c6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:52.191242 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6dd71b-e5f8-4d9d-b22f-3be60195c6e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:52.191760 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6dd71b-e5f8-4d9d-b22f-3be60195c6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:52.192249 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6dd71b-e5f8-4d9d-b22f-3be60195c6e7 admin admin] PATH_INFO: `/v3/users/f0a1221f9e6c4e50adafbe735ed67a14` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:52.194432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6dd71b-e5f8-4d9d-b22f-3be60195c6e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0a1221f9e6c4e50adafbe735ed67a14)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:52.199649 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6dd71b-e5f8-4d9d-b22f-3be60195c6e7 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:52.278308 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9b6dd71b-e5f8-4d9d-b22f-3be60195c6e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0a1221f9e6c4e50adafbe735ed67a14'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:52.289387 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9b6dd71b-e5f8-4d9d-b22f-3be60195c6e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0a1221f9e6c4e50adafbe735ed67a14'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:52.290216 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9b6dd71b-e5f8-4d9d-b22f-3be60195c6e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0a1221f9e6c4e50adafbe735ed67a14'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:52.312726 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9b6dd71b-e5f8-4d9d-b22f-3be60195c6e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0a1221f9e6c4e50adafbe735ed67a14'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:52.313707 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9b6dd71b-e5f8-4d9d-b22f-3be60195c6e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0a1221f9e6c4e50adafbe735ed67a14'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:52.318188 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:52.347431 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 940/1884] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:23:52 2022] DELETE /identity/v3/users/f0a1221f9e6c4e50adafbe735ed67a14 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:53.610431 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c206ee-b3df-4c2e-90bf-be12d7a1b48b admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:53.614333 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-67c206ee-b3df-4c2e-90bf-be12d7a1b48b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:53.628783 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c206ee-b3df-4c2e-90bf-be12d7a1b48b admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:53.760073 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e22894-9168-4ea2-8e72-cfeb67183e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:53.761140 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e22894-9168-4ea2-8e72-cfeb67183e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:53.761479 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e22894-9168-4ea2-8e72-cfeb67183e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:53.761783 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e22894-9168-4ea2-8e72-cfeb67183e68 admin admin] PATH_INFO: `/v3/projects/c96c9e8d95a243238f4631126ce36445` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:53.763341 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e22894-9168-4ea2-8e72-cfeb67183e68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c96c9e8d95a243238f4631126ce36445)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:53.766319 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e22894-9168-4ea2-8e72-cfeb67183e68 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:53.879946 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-78e22894-9168-4ea2-8e72-cfeb67183e68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c96c9e8d95a243238f4631126ce36445', 'request_id': 'req-78e22894-9168-4ea2-8e72-cfeb67183e68'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:53.887790 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-78e22894-9168-4ea2-8e72-cfeb67183e68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c96c9e8d95a243238f4631126ce36445', 'request_id': 'req-78e22894-9168-4ea2-8e72-cfeb67183e68'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:53.900875 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-78e22894-9168-4ea2-8e72-cfeb67183e68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c96c9e8d95a243238f4631126ce36445', 'request_id': 'req-78e22894-9168-4ea2-8e72-cfeb67183e68'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:53.918957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-78e22894-9168-4ea2-8e72-cfeb67183e68 admin admin] The token cache is being invalidate because project c96c9e8d95a243238f4631126ce36445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:23:53.919475 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-78e22894-9168-4ea2-8e72-cfeb67183e68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:53.920368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-78e22894-9168-4ea2-8e72-cfeb67183e68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:53.925954 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 945/1885] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:23:53 2022] DELETE /identity/v3/projects/c96c9e8d95a243238f4631126ce36445 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:53.931930 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc345355-07be-488c-ae8c-03b56d8d19ae None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:53.932424 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc345355-07be-488c-ae8c-03b56d8d19ae None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:53.932577 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc345355-07be-488c-ae8c-03b56d8d19ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:53.956792 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-cc345355-07be-488c-ae8c-03b56d8d19ae None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:53.958379 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-cc345355-07be-488c-ae8c-03b56d8d19ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:54.023699 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 941/1886] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:54.031485 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec9fda-4fa9-4f1b-ae0e-18aa4f7d8255 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:54.031777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec9fda-4fa9-4f1b-ae0e-18aa4f7d8255 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:54.032059 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec9fda-4fa9-4f1b-ae0e-18aa4f7d8255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:54.051601 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-98ec9fda-4fa9-4f1b-ae0e-18aa4f7d8255 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:54.052905 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-98ec9fda-4fa9-4f1b-ae0e-18aa4f7d8255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:54.061850 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 946/1887] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:54.066286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc345355-07be-488c-ae8c-03b56d8d19ae None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:54.076603 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc345355-07be-488c-ae8c-03b56d8d19ae None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:54.081285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdad7c-89fe-4c5e-a295-c5fd518b01d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:54.081977 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdad7c-89fe-4c5e-a295-c5fd518b01d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:54.082265 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdad7c-89fe-4c5e-a295-c5fd518b01d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:54.082543 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdad7c-89fe-4c5e-a295-c5fd518b01d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:54.083273 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdad7c-89fe-4c5e-a295-c5fd518b01d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:23:54.083582 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdad7c-89fe-4c5e-a295-c5fd518b01d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:54.085200 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdad7c-89fe-4c5e-a295-c5fd518b01d6 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:54.097097 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 942/1888] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:23:54.101335 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec9fda-4fa9-4f1b-ae0e-18aa4f7d8255 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:54.112060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec9fda-4fa9-4f1b-ae0e-18aa4f7d8255 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:54.118224 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f15f40-e581-4da8-ad36-f6b3e16a242f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:54.119338 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f15f40-e581-4da8-ad36-f6b3e16a242f admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:54.119708 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f15f40-e581-4da8-ad36-f6b3e16a242f admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:54.120050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f15f40-e581-4da8-ad36-f6b3e16a242f admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:54.122328 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f15f40-e581-4da8-ad36-f6b3e16a242f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:54.129911 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f15f40-e581-4da8-ad36-f6b3e16a242f admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:54.138368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:54.167242 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 947/1889] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:23:54 2022] POST /identity/v3/projects => generated 389 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:23:54.172162 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdad7c-89fe-4c5e-a295-c5fd518b01d6 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:54.183026 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdad7c-89fe-4c5e-a295-c5fd518b01d6 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:54.285037 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c413f-9e56-4715-84f1-52d6c585c60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:54.285727 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c413f-9e56-4715-84f1-52d6c585c60c admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:54.286178 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c413f-9e56-4715-84f1-52d6c585c60c admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:54.286470 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c413f-9e56-4715-84f1-52d6c585c60c admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:54.287526 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c413f-9e56-4715-84f1-52d6c585c60c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:54.289605 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c413f-9e56-4715-84f1-52d6c585c60c admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:54.334984 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 943/1890] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:23:54 2022] POST /identity/v3/users => generated 295 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:23:54.335311 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f15f40-e581-4da8-ad36-f6b3e16a242f admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:54.347425 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f15f40-e581-4da8-ad36-f6b3e16a242f admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:54.353113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdcffeb-4436-48e8-aab1-94d041d9c61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:54.353901 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcffeb-4436-48e8-aab1-94d041d9c61b admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:54.354316 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcffeb-4436-48e8-aab1-94d041d9c61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:54.354668 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcffeb-4436-48e8-aab1-94d041d9c61b admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:54.355474 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdcffeb-4436-48e8-aab1-94d041d9c61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:54.358276 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdcffeb-4436-48e8-aab1-94d041d9c61b admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:54.376286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c413f-9e56-4715-84f1-52d6c585c60c admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:54.390695 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 948/1891] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:23:54.391547 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c413f-9e56-4715-84f1-52d6c585c60c admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:54.397130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19beb79-0c04-4dc4-9411-a43a80924ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:54.398236 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19beb79-0c04-4dc4-9411-a43a80924ecb admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:54.398864 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19beb79-0c04-4dc4-9411-a43a80924ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:54.399477 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19beb79-0c04-4dc4-9411-a43a80924ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:54.400187 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19beb79-0c04-4dc4-9411-a43a80924ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:54.402529 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19beb79-0c04-4dc4-9411-a43a80924ecb admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:54.420593 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdcffeb-4436-48e8-aab1-94d041d9c61b admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:54.431379 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 944/1892] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:23:54.435253 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdcffeb-4436-48e8-aab1-94d041d9c61b admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:54.442070 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c7fbd-e077-445d-9005-8ac243f0ccd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:54.443555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c7fbd-e077-445d-9005-8ac243f0ccd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:54.443945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c7fbd-e077-445d-9005-8ac243f0ccd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:54.444856 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c7fbd-e077-445d-9005-8ac243f0ccd5 admin admin] PATH_INFO: `/v3/projects/ccf2b16f618e4d95bedc73e825dc4cb8/users/b46472924ac34e86a9f3d0a61a34d36c/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:54.486643 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c7fbd-e077-445d-9005-8ac243f0ccd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf2b16f618e4d95bedc73e825dc4cb8, user_id=b46472924ac34e86a9f3d0a61a34d36c, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:54.489394 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c7fbd-e077-445d-9005-8ac243f0ccd5 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:54.507029 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 949/1893] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:23:54 2022] PUT /identity/v3/projects/ccf2b16f618e4d95bedc73e825dc4cb8/users/b46472924ac34e86a9f3d0a61a34d36c/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:54.520307 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28060adc-5094-4b41-83aa-413ee3184ef8 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:54.520608 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28060adc-5094-4b41-83aa-413ee3184ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:54.520890 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28060adc-5094-4b41-83aa-413ee3184ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:54.552158 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-28060adc-5094-4b41-83aa-413ee3184ef8 None None] MFA Rules not processed for user `b46472924ac34e86a9f3d0a61a34d36c`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:54.553079 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-28060adc-5094-4b41-83aa-413ee3184ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:54.615458 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:54.642317 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 945/1894] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:54.653050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c7fbd-e077-445d-9005-8ac243f0ccd5 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:54.655676 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-616c7fbd-e077-445d-9005-8ac243f0ccd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:54.726031 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c7fbd-e077-445d-9005-8ac243f0ccd5 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:54.730430 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98fc13-ed4b-434c-a2dc-e9284f2fdd64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:54.731105 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98fc13-ed4b-434c-a2dc-e9284f2fdd64 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:54.731389 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98fc13-ed4b-434c-a2dc-e9284f2fdd64 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:54.731686 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98fc13-ed4b-434c-a2dc-e9284f2fdd64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:54.742962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98fc13-ed4b-434c-a2dc-e9284f2fdd64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:54.744694 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98fc13-ed4b-434c-a2dc-e9284f2fdd64 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:54.759920 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 950/1895] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:23:57.417412 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28060adc-5094-4b41-83aa-413ee3184ef8 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:57.419470 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-28060adc-5094-4b41-83aa-413ee3184ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:57.488809 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28060adc-5094-4b41-83aa-413ee3184ef8 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:57.493352 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7abf1-153d-4462-a323-5b597008b87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:57.494255 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7abf1-153d-4462-a323-5b597008b87c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:57.494538 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7abf1-153d-4462-a323-5b597008b87c admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:57.494812 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7abf1-153d-4462-a323-5b597008b87c admin admin] PATH_INFO: `/v3/users/a45dac4f789d4e6188da3b7574fb8a57` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:57.496026 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7abf1-153d-4462-a323-5b597008b87c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a45dac4f789d4e6188da3b7574fb8a57)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:57.498552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7abf1-153d-4462-a323-5b597008b87c admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:57.543538 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-96e7abf1-153d-4462-a323-5b597008b87c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a45dac4f789d4e6188da3b7574fb8a57'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:57.550918 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-96e7abf1-153d-4462-a323-5b597008b87c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a45dac4f789d4e6188da3b7574fb8a57'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:57.551566 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-96e7abf1-153d-4462-a323-5b597008b87c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a45dac4f789d4e6188da3b7574fb8a57'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:57.563711 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-96e7abf1-153d-4462-a323-5b597008b87c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a45dac4f789d4e6188da3b7574fb8a57'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:57.564269 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-96e7abf1-153d-4462-a323-5b597008b87c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a45dac4f789d4e6188da3b7574fb8a57'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:57.577165 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 946/1896] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:23:57 2022] DELETE /identity/v3/users/a45dac4f789d4e6188da3b7574fb8a57 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:57.754279 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98fc13-ed4b-434c-a2dc-e9284f2fdd64 service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:57.767910 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98fc13-ed4b-434c-a2dc-e9284f2fdd64 service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:57.827610 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6d283-c07e-4975-9694-b771010299d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:57.828404 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6d283-c07e-4975-9694-b771010299d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:57.828685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6d283-c07e-4975-9694-b771010299d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:57.828950 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6d283-c07e-4975-9694-b771010299d6 admin admin] PATH_INFO: `/v3/projects/97d43167bd994abc9483d1b86ffda90a` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:57.830155 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6d283-c07e-4975-9694-b771010299d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97d43167bd994abc9483d1b86ffda90a)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:57.832057 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6d283-c07e-4975-9694-b771010299d6 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:57.877230 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-53f6d283-c07e-4975-9694-b771010299d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97d43167bd994abc9483d1b86ffda90a', 'request_id': 'req-53f6d283-c07e-4975-9694-b771010299d6'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:57.883840 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-53f6d283-c07e-4975-9694-b771010299d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97d43167bd994abc9483d1b86ffda90a', 'request_id': 'req-53f6d283-c07e-4975-9694-b771010299d6'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:57.887951 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:57.892233 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-53f6d283-c07e-4975-9694-b771010299d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97d43167bd994abc9483d1b86ffda90a', 'request_id': 'req-53f6d283-c07e-4975-9694-b771010299d6'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:57.905029 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-53f6d283-c07e-4975-9694-b771010299d6 admin admin] The token cache is being invalidate because project 97d43167bd994abc9483d1b86ffda90a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:23:57.905250 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-53f6d283-c07e-4975-9694-b771010299d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:57.905958 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-53f6d283-c07e-4975-9694-b771010299d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:23:57.907509 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 951/1897] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:23:57 2022] DELETE /identity/v3/projects/97d43167bd994abc9483d1b86ffda90a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:57.913591 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb7363-66de-4e02-abd9-cfe76ce8ba95 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:57.914078 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb7363-66de-4e02-abd9-cfe76ce8ba95 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:57.914421 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb7363-66de-4e02-abd9-cfe76ce8ba95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:57.933198 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-6aeb7363-66de-4e02-abd9-cfe76ce8ba95 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:57.934439 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-6aeb7363-66de-4e02-abd9-cfe76ce8ba95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:57.992160 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 947/1898] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:23:58.001161 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e29b1b-4b24-46ed-ba5d-b44772a000f2 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:58.001453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e29b1b-4b24-46ed-ba5d-b44772a000f2 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:58.001734 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e29b1b-4b24-46ed-ba5d-b44772a000f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:58.023709 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-c1e29b1b-4b24-46ed-ba5d-b44772a000f2 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:58.024903 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c1e29b1b-4b24-46ed-ba5d-b44772a000f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:58.032822 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 952/1899] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:58.037025 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb7363-66de-4e02-abd9-cfe76ce8ba95 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:58.047236 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb7363-66de-4e02-abd9-cfe76ce8ba95 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:58.052349 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff8ec5-abd0-4307-888f-1166318e5100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:58.053023 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff8ec5-abd0-4307-888f-1166318e5100 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:58.053313 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff8ec5-abd0-4307-888f-1166318e5100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:58.053590 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff8ec5-abd0-4307-888f-1166318e5100 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:58.054512 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff8ec5-abd0-4307-888f-1166318e5100 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:23:58.054656 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff8ec5-abd0-4307-888f-1166318e5100 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:58.056253 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff8ec5-abd0-4307-888f-1166318e5100 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:58.057940 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:23:58.076879 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 948/1900] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:23:58.077051 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e29b1b-4b24-46ed-ba5d-b44772a000f2 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:58.085751 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e29b1b-4b24-46ed-ba5d-b44772a000f2 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:58.090466 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778ccee-9bec-4e8e-bee7-baa27b44ef19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:58.091123 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778ccee-9bec-4e8e-bee7-baa27b44ef19 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:58.091404 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778ccee-9bec-4e8e-bee7-baa27b44ef19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:58.091676 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778ccee-9bec-4e8e-bee7-baa27b44ef19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:58.092369 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778ccee-9bec-4e8e-bee7-baa27b44ef19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:58.094386 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778ccee-9bec-4e8e-bee7-baa27b44ef19 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:58.125998 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 953/1901] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:23:58 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:23:58.127141 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff8ec5-abd0-4307-888f-1166318e5100 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:58.140935 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff8ec5-abd0-4307-888f-1166318e5100 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:58.208161 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b3656-097e-4095-93ee-d59fa19e49d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:58.208937 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b3656-097e-4095-93ee-d59fa19e49d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:58.209117 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b3656-097e-4095-93ee-d59fa19e49d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:58.209395 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b3656-097e-4095-93ee-d59fa19e49d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:58.210161 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b3656-097e-4095-93ee-d59fa19e49d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:58.212084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b3656-097e-4095-93ee-d59fa19e49d3 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:58.236798 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 949/1902] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:23:58 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:23:58.240834 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778ccee-9bec-4e8e-bee7-baa27b44ef19 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:58.251276 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778ccee-9bec-4e8e-bee7-baa27b44ef19 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:58.255829 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc797c-791f-4e91-ae28-0564c8c64dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:58.256482 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc797c-791f-4e91-ae28-0564c8c64dcf admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:58.256758 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc797c-791f-4e91-ae28-0564c8c64dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:58.257027 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc797c-791f-4e91-ae28-0564c8c64dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:58.257763 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc797c-791f-4e91-ae28-0564c8c64dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:58.259388 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc797c-791f-4e91-ae28-0564c8c64dcf admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:58.269718 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 954/1903] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:23:58.273710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b3656-097e-4095-93ee-d59fa19e49d3 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:58.284151 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b3656-097e-4095-93ee-d59fa19e49d3 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:58.288834 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92933c6f-92db-46b8-a167-8a415ea77c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:58.289488 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92933c6f-92db-46b8-a167-8a415ea77c97 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:58.289772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92933c6f-92db-46b8-a167-8a415ea77c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:58.290160 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92933c6f-92db-46b8-a167-8a415ea77c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:58.290889 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92933c6f-92db-46b8-a167-8a415ea77c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:58.292483 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92933c6f-92db-46b8-a167-8a415ea77c97 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:58.303107 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 950/1904] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:23:58.307020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc797c-791f-4e91-ae28-0564c8c64dcf admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:58.316854 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc797c-791f-4e91-ae28-0564c8c64dcf admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:58.321450 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96af9bb-dcde-4c0e-bfef-4b6ea6e73fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:58.322381 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96af9bb-dcde-4c0e-bfef-4b6ea6e73fa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:58.322659 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96af9bb-dcde-4c0e-bfef-4b6ea6e73fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:58.322937 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96af9bb-dcde-4c0e-bfef-4b6ea6e73fa0 admin admin] PATH_INFO: `/v3/projects/727e8bde61224a1f86eeb7ec5c1e9ef8/users/f34f004aed7a405e859f2a79dd56d09f/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:58.337185 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96af9bb-dcde-4c0e-bfef-4b6ea6e73fa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=727e8bde61224a1f86eeb7ec5c1e9ef8, user_id=f34f004aed7a405e859f2a79dd56d09f, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:58.339804 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96af9bb-dcde-4c0e-bfef-4b6ea6e73fa0 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:58.354580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 955/1905] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:23:58 2022] PUT /identity/v3/projects/727e8bde61224a1f86eeb7ec5c1e9ef8/users/f34f004aed7a405e859f2a79dd56d09f/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:23:58.365272 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e92a8-21bb-47b5-b8a9-d97c0d7e7f04 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:58.365562 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e92a8-21bb-47b5-b8a9-d97c0d7e7f04 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:58.365856 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e92a8-21bb-47b5-b8a9-d97c0d7e7f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:58.392866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-d97e92a8-21bb-47b5-b8a9-d97c0d7e7f04 None None] MFA Rules not processed for user `f34f004aed7a405e859f2a79dd56d09f`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:23:58.394153 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d97e92a8-21bb-47b5-b8a9-d97c0d7e7f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:58.464203 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 951/1906] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:23:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:23:58.476594 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96af9bb-dcde-4c0e-bfef-4b6ea6e73fa0 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:23:58.478517 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d96af9bb-dcde-4c0e-bfef-4b6ea6e73fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:23:58.552345 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96af9bb-dcde-4c0e-bfef-4b6ea6e73fa0 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:23:58.557929 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7421c-cfa1-4456-a26d-a2401c60ad91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:23:58.558576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7421c-cfa1-4456-a26d-a2401c60ad91 service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:23:58.558860 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7421c-cfa1-4456-a26d-a2401c60ad91 service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:23:58.559135 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7421c-cfa1-4456-a26d-a2401c60ad91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:23:58.566754 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c7421c-cfa1-4456-a26d-a2401c60ad91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:23:58.568332 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c7421c-cfa1-4456-a26d-a2401c60ad91 service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:23:58.577559 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 956/1907] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:23:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:24:01.251434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e92a8-21bb-47b5-b8a9-d97c0d7e7f04 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:01.330946 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e92a8-21bb-47b5-b8a9-d97c0d7e7f04 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:01.336176 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155a427-127d-4d08-84b4-88b7f801aa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:01.337339 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155a427-127d-4d08-84b4-88b7f801aa1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:01.337831 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155a427-127d-4d08-84b4-88b7f801aa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:01.337939 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155a427-127d-4d08-84b4-88b7f801aa1a admin admin] PATH_INFO: `/v3/users/f34f004aed7a405e859f2a79dd56d09f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:01.340969 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155a427-127d-4d08-84b4-88b7f801aa1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f34f004aed7a405e859f2a79dd56d09f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:01.341094 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155a427-127d-4d08-84b4-88b7f801aa1a admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:01.344722 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:01.409585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-6155a427-127d-4d08-84b4-88b7f801aa1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f34f004aed7a405e859f2a79dd56d09f'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:01.416572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-6155a427-127d-4d08-84b4-88b7f801aa1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f34f004aed7a405e859f2a79dd56d09f'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:01.417296 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-6155a427-127d-4d08-84b4-88b7f801aa1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f34f004aed7a405e859f2a79dd56d09f'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:01.434356 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-6155a427-127d-4d08-84b4-88b7f801aa1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f34f004aed7a405e859f2a79dd56d09f'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:01.435098 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-6155a427-127d-4d08-84b4-88b7f801aa1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f34f004aed7a405e859f2a79dd56d09f'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:01.451031 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 952/1908] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:24:01 2022] DELETE /identity/v3/users/f34f004aed7a405e859f2a79dd56d09f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:01.455396 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414545b3-5b68-45ce-980e-ebc1de68685c None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:01.455871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414545b3-5b68-45ce-980e-ebc1de68685c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:01.456474 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414545b3-5b68-45ce-980e-ebc1de68685c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:01.473796 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-414545b3-5b68-45ce-980e-ebc1de68685c None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:01.475003 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-414545b3-5b68-45ce-980e-ebc1de68685c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:01.475752 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155a427-127d-4d08-84b4-88b7f801aa1a admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:01.478734 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-6155a427-127d-4d08-84b4-88b7f801aa1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:01.538337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 957/1909] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:01.545848 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155a427-127d-4d08-84b4-88b7f801aa1a admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:01.548472 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414545b3-5b68-45ce-980e-ebc1de68685c None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:01.550283 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-414545b3-5b68-45ce-980e-ebc1de68685c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:01.552737 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f950ea-dbd6-4989-bc75-534df7d668c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:01.553628 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f950ea-dbd6-4989-bc75-534df7d668c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:01.554010 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f950ea-dbd6-4989-bc75-534df7d668c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:01.554289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f950ea-dbd6-4989-bc75-534df7d668c4 admin admin] PATH_INFO: `/v3/users/ea706e92a10e421fb6bb5a520caa2b49` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:01.555495 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f950ea-dbd6-4989-bc75-534df7d668c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea706e92a10e421fb6bb5a520caa2b49)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:01.557427 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f950ea-dbd6-4989-bc75-534df7d668c4 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:01.562299 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:01.606459 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-90f950ea-dbd6-4989-bc75-534df7d668c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea706e92a10e421fb6bb5a520caa2b49'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:01.614303 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414545b3-5b68-45ce-980e-ebc1de68685c None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:01.616228 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-90f950ea-dbd6-4989-bc75-534df7d668c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea706e92a10e421fb6bb5a520caa2b49'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:01.617086 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-90f950ea-dbd6-4989-bc75-534df7d668c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea706e92a10e421fb6bb5a520caa2b49'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:01.618719 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e8dc2-79f0-48ce-8fb2-2371d61c1370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:01.619315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e8dc2-79f0-48ce-8fb2-2371d61c1370 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:01.619826 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e8dc2-79f0-48ce-8fb2-2371d61c1370 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:01.619950 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e8dc2-79f0-48ce-8fb2-2371d61c1370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:01.630512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e8dc2-79f0-48ce-8fb2-2371d61c1370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:01.632019 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e8dc2-79f0-48ce-8fb2-2371d61c1370 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:01.633846 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-90f950ea-dbd6-4989-bc75-534df7d668c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea706e92a10e421fb6bb5a520caa2b49'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:01.634573 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-90f950ea-dbd6-4989-bc75-534df7d668c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea706e92a10e421fb6bb5a520caa2b49'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:01.643864 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 958/1910] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:24:01.645689 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:01.650451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 953/1911] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:24:01 2022] DELETE /identity/v3/users/ea706e92a10e421fb6bb5a520caa2b49 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:24:01.858988 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e8dc2-79f0-48ce-8fb2-2371d61c1370 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:01.869702 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e8dc2-79f0-48ce-8fb2-2371d61c1370 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:01.948796 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26aa35-0968-46fb-82f3-bd134ea2f401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:01.949698 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26aa35-0968-46fb-82f3-bd134ea2f401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:01.950014 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26aa35-0968-46fb-82f3-bd134ea2f401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:01.950295 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26aa35-0968-46fb-82f3-bd134ea2f401 admin admin] PATH_INFO: `/v3/projects/54c153652c4342cdb9d8cd339ddf2c31` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:01.951486 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e26aa35-0968-46fb-82f3-bd134ea2f401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54c153652c4342cdb9d8cd339ddf2c31)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:01.953576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e26aa35-0968-46fb-82f3-bd134ea2f401 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:02.016511 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2e26aa35-0968-46fb-82f3-bd134ea2f401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54c153652c4342cdb9d8cd339ddf2c31', 'request_id': 'req-2e26aa35-0968-46fb-82f3-bd134ea2f401'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:02.024096 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f950ea-dbd6-4989-bc75-534df7d668c4 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:02.024282 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2e26aa35-0968-46fb-82f3-bd134ea2f401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54c153652c4342cdb9d8cd339ddf2c31', 'request_id': 'req-2e26aa35-0968-46fb-82f3-bd134ea2f401'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:02.025721 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-90f950ea-dbd6-4989-bc75-534df7d668c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:02.036209 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2e26aa35-0968-46fb-82f3-bd134ea2f401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54c153652c4342cdb9d8cd339ddf2c31', 'request_id': 'req-2e26aa35-0968-46fb-82f3-bd134ea2f401'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:02.040882 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f950ea-dbd6-4989-bc75-534df7d668c4 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:02.051555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2e26aa35-0968-46fb-82f3-bd134ea2f401 admin admin] The token cache is being invalidate because project 54c153652c4342cdb9d8cd339ddf2c31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:24:02.051825 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2e26aa35-0968-46fb-82f3-bd134ea2f401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:02.052514 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2e26aa35-0968-46fb-82f3-bd134ea2f401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:02.054512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 959/1912] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:24:01 2022] DELETE /identity/v3/projects/54c153652c4342cdb9d8cd339ddf2c31 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:02.058173 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26aa35-0968-46fb-82f3-bd134ea2f401 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:02.059312 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2e26aa35-0968-46fb-82f3-bd134ea2f401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:02.107103 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:02.111554 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46f95b-9e5f-4ccb-91ed-8e0f092c6061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:02.112369 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46f95b-9e5f-4ccb-91ed-8e0f092c6061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:02.112931 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46f95b-9e5f-4ccb-91ed-8e0f092c6061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:02.113486 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46f95b-9e5f-4ccb-91ed-8e0f092c6061 admin admin] PATH_INFO: `/v3/projects/727e8bde61224a1f86eeb7ec5c1e9ef8` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:02.115173 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46f95b-9e5f-4ccb-91ed-8e0f092c6061 admin admin] RBAC: Authorizing `identity:delete_project(project_id=727e8bde61224a1f86eeb7ec5c1e9ef8)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:02.117149 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46f95b-9e5f-4ccb-91ed-8e0f092c6061 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:02.130005 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26aa35-0968-46fb-82f3-bd134ea2f401 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:02.134707 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1b1cc-86fc-4598-98d1-831ace47d942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:02.135573 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1b1cc-86fc-4598-98d1-831ace47d942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:02.135859 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1b1cc-86fc-4598-98d1-831ace47d942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:02.136133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1b1cc-86fc-4598-98d1-831ace47d942 admin admin] PATH_INFO: `/v3/users/05e4f5b1fa3e4e89a8bf2dac137175d2` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:02.137332 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1b1cc-86fc-4598-98d1-831ace47d942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05e4f5b1fa3e4e89a8bf2dac137175d2)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:02.139309 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1b1cc-86fc-4598-98d1-831ace47d942 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:02.167265 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ff46f95b-9e5f-4ccb-91ed-8e0f092c6061 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '727e8bde61224a1f86eeb7ec5c1e9ef8', 'request_id': 'req-ff46f95b-9e5f-4ccb-91ed-8e0f092c6061'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:02.174409 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ff46f95b-9e5f-4ccb-91ed-8e0f092c6061 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '727e8bde61224a1f86eeb7ec5c1e9ef8', 'request_id': 'req-ff46f95b-9e5f-4ccb-91ed-8e0f092c6061'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:02.183598 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ff46f95b-9e5f-4ccb-91ed-8e0f092c6061 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '727e8bde61224a1f86eeb7ec5c1e9ef8', 'request_id': 'req-ff46f95b-9e5f-4ccb-91ed-8e0f092c6061'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:02.189004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-42a1b1cc-86fc-4598-98d1-831ace47d942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05e4f5b1fa3e4e89a8bf2dac137175d2'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:02.194874 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ff46f95b-9e5f-4ccb-91ed-8e0f092c6061 admin admin] The token cache is being invalidate because project 727e8bde61224a1f86eeb7ec5c1e9ef8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:24:02.195291 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ff46f95b-9e5f-4ccb-91ed-8e0f092c6061 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:02.195975 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ff46f95b-9e5f-4ccb-91ed-8e0f092c6061 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:02.196086 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-42a1b1cc-86fc-4598-98d1-831ace47d942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05e4f5b1fa3e4e89a8bf2dac137175d2'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:02.196741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-42a1b1cc-86fc-4598-98d1-831ace47d942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05e4f5b1fa3e4e89a8bf2dac137175d2'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:02.197368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-42a1b1cc-86fc-4598-98d1-831ace47d942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05e4f5b1fa3e4e89a8bf2dac137175d2'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:02.197861 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 954/1913] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:24:02 2022] DELETE /identity/v3/projects/727e8bde61224a1f86eeb7ec5c1e9ef8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:24:02.202356 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2324e6-e17a-474a-aa83-a7e935b5eb8f None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:02.202645 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2324e6-e17a-474a-aa83-a7e935b5eb8f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:02.202960 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2324e6-e17a-474a-aa83-a7e935b5eb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:02.212213 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-42a1b1cc-86fc-4598-98d1-831ace47d942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05e4f5b1fa3e4e89a8bf2dac137175d2'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:02.222109 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-6a2324e6-e17a-474a-aa83-a7e935b5eb8f None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:02.223395 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-6a2324e6-e17a-474a-aa83-a7e935b5eb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:02.226006 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 960/1914] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:24:02 2022] DELETE /identity/v3/users/05e4f5b1fa3e4e89a8bf2dac137175d2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:02.284554 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 955/1915] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:24:02.291644 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc40f38-76b5-4398-a4ed-d3bd7c305f27 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:02.291943 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc40f38-76b5-4398-a4ed-d3bd7c305f27 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:02.292227 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc40f38-76b5-4398-a4ed-d3bd7c305f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:02.310782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-bfc40f38-76b5-4398-a4ed-d3bd7c305f27 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:02.312017 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-bfc40f38-76b5-4398-a4ed-d3bd7c305f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:02.320478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 961/1916] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:02.324730 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2324e6-e17a-474a-aa83-a7e935b5eb8f None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:02.335282 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2324e6-e17a-474a-aa83-a7e935b5eb8f None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:02.340193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53caf940-692c-4c6b-8ddc-6c053a499913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:02.340875 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53caf940-692c-4c6b-8ddc-6c053a499913 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:02.341162 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53caf940-692c-4c6b-8ddc-6c053a499913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:02.342051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53caf940-692c-4c6b-8ddc-6c053a499913 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:02.343434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53caf940-692c-4c6b-8ddc-6c053a499913 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:24:02.343763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53caf940-692c-4c6b-8ddc-6c053a499913 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:02.345586 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53caf940-692c-4c6b-8ddc-6c053a499913 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:02.357527 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 956/1917] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:24:02.361994 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc40f38-76b5-4398-a4ed-d3bd7c305f27 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:02.371257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc40f38-76b5-4398-a4ed-d3bd7c305f27 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:02.376053 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bc9d1-7d1f-464b-801c-38bdfb104946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:02.376712 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bc9d1-7d1f-464b-801c-38bdfb104946 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:02.377028 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bc9d1-7d1f-464b-801c-38bdfb104946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:02.377309 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bc9d1-7d1f-464b-801c-38bdfb104946 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:02.378065 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4bc9d1-7d1f-464b-801c-38bdfb104946 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:02.380016 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4bc9d1-7d1f-464b-801c-38bdfb104946 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:02.404206 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53caf940-692c-4c6b-8ddc-6c053a499913 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:02.406895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-53caf940-692c-4c6b-8ddc-6c053a499913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:02.407657 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 962/1918] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:24:02 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:24:02.411584 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bc9d1-7d1f-464b-801c-38bdfb104946 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:02.423868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53caf940-692c-4c6b-8ddc-6c053a499913 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:02.449040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:02.490225 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bc9d1-7d1f-464b-801c-38bdfb104946 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:02.495005 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd2da0-c866-4eef-bfac-89cc82959e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:02.495674 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd2da0-c866-4eef-bfac-89cc82959e33 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:02.495959 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd2da0-c866-4eef-bfac-89cc82959e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:02.496748 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd2da0-c866-4eef-bfac-89cc82959e33 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:02.497446 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd2da0-c866-4eef-bfac-89cc82959e33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:02.498757 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9ce83-fff1-4e04-bd50-817298338e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:02.499502 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd2da0-c866-4eef-bfac-89cc82959e33 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:02.499784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9ce83-fff1-4e04-bd50-817298338e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:02.500067 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9ce83-fff1-4e04-bd50-817298338e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:02.500343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9ce83-fff1-4e04-bd50-817298338e68 admin admin] PATH_INFO: `/v3/projects/6887b328484341e685ef0718e1a1cea9` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:02.501622 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9ce83-fff1-4e04-bd50-817298338e68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6887b328484341e685ef0718e1a1cea9)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:02.503637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9ce83-fff1-4e04-bd50-817298338e68 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:02.520430 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 963/1919] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:24:02 2022] POST /identity/v3/users => generated 303 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:24:02.524488 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd2da0-c866-4eef-bfac-89cc82959e33 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:02.539400 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd2da0-c866-4eef-bfac-89cc82959e33 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:02.544379 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed02e9-4dde-4eef-a2da-9752589c5ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:02.545037 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed02e9-4dde-4eef-a2da-9752589c5ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:02.545320 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed02e9-4dde-4eef-a2da-9752589c5ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:02.546161 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed02e9-4dde-4eef-a2da-9752589c5ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:02.547593 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed02e9-4dde-4eef-a2da-9752589c5ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:02.549202 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed02e9-4dde-4eef-a2da-9752589c5ca5 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:02.559081 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4fe9ce83-fff1-4e04-bd50-817298338e68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6887b328484341e685ef0718e1a1cea9', 'request_id': 'req-4fe9ce83-fff1-4e04-bd50-817298338e68'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:02.559630 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 964/1920] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:02.564676 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed02e9-4dde-4eef-a2da-9752589c5ca5 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:02.565969 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4fe9ce83-fff1-4e04-bd50-817298338e68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6887b328484341e685ef0718e1a1cea9', 'request_id': 'req-4fe9ce83-fff1-4e04-bd50-817298338e68'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:02.573928 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4fe9ce83-fff1-4e04-bd50-817298338e68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6887b328484341e685ef0718e1a1cea9', 'request_id': 'req-4fe9ce83-fff1-4e04-bd50-817298338e68'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:02.575068 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed02e9-4dde-4eef-a2da-9752589c5ca5 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:02.583222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:02.586226 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4fe9ce83-fff1-4e04-bd50-817298338e68 admin admin] The token cache is being invalidate because project 6887b328484341e685ef0718e1a1cea9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:24:02.586487 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4fe9ce83-fff1-4e04-bd50-817298338e68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:02.587140 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4fe9ce83-fff1-4e04-bd50-817298338e68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:02.588865 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 957/1921] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:24:02 2022] DELETE /identity/v3/projects/6887b328484341e685ef0718e1a1cea9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:24:02.593936 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9801a-9ccf-4f31-9a7c-4f548935e758 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:02.594228 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9801a-9ccf-4f31-9a7c-4f548935e758 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:02.595097 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9801a-9ccf-4f31-9a7c-4f548935e758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:02.616361 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-3be9801a-9ccf-4f31-9a7c-4f548935e758 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:02.617493 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-3be9801a-9ccf-4f31-9a7c-4f548935e758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:02.641535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc64fc-60db-4448-b6c3-8b898913cb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:02.642245 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc64fc-60db-4448-b6c3-8b898913cb79 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:02.642543 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc64fc-60db-4448-b6c3-8b898913cb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:02.642812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc64fc-60db-4448-b6c3-8b898913cb79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:02.643536 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc64fc-60db-4448-b6c3-8b898913cb79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:02.645171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc64fc-60db-4448-b6c3-8b898913cb79 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:02.655359 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 965/1922] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:02.659415 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc64fc-60db-4448-b6c3-8b898913cb79 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:02.661074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-1dbc64fc-60db-4448-b6c3-8b898913cb79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:02.673592 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc64fc-60db-4448-b6c3-8b898913cb79 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:02.678342 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 958/1923] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:24:02.678603 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145e8da-444f-42c9-af78-354f25315de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:02.679541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145e8da-444f-42c9-af78-354f25315de8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:02.679844 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145e8da-444f-42c9-af78-354f25315de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:02.680113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145e8da-444f-42c9-af78-354f25315de8 admin admin] PATH_INFO: `/v3/projects/c69cca84c83a4079a1bcd3cf88268bc3/users/4d19760f96ee40069b9f82bc07f7a9ac/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:02.685609 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24986af-8793-4be4-bb69-5da178e09795 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:02.685928 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24986af-8793-4be4-bb69-5da178e09795 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:02.686761 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24986af-8793-4be4-bb69-5da178e09795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:02.696038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145e8da-444f-42c9-af78-354f25315de8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c69cca84c83a4079a1bcd3cf88268bc3, user_id=4d19760f96ee40069b9f82bc07f7a9ac, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:02.698753 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145e8da-444f-42c9-af78-354f25315de8 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:02.704914 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-d24986af-8793-4be4-bb69-5da178e09795 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:02.706347 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d24986af-8793-4be4-bb69-5da178e09795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:02.716501 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 966/1924] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:24:02 2022] PUT /identity/v3/projects/c69cca84c83a4079a1bcd3cf88268bc3/users/4d19760f96ee40069b9f82bc07f7a9ac/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:24:02.729735 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51d66b-f15b-4667-9f0a-1a5f9a3efbff None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:02.729735 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51d66b-f15b-4667-9f0a-1a5f9a3efbff None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:02.734180 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51d66b-f15b-4667-9f0a-1a5f9a3efbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:02.760434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:02.763934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-5d51d66b-f15b-4667-9f0a-1a5f9a3efbff None None] MFA Rules not processed for user `4d19760f96ee40069b9f82bc07f7a9ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:02.765277 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-5d51d66b-f15b-4667-9f0a-1a5f9a3efbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:02.778855 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 959/1925] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:24:02.787482 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24986af-8793-4be4-bb69-5da178e09795 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:02.797403 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24986af-8793-4be4-bb69-5da178e09795 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:02.803069 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a3dbd-af52-453a-963c-5f059fe9e275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:02.803820 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a3dbd-af52-453a-963c-5f059fe9e275 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:02.804108 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a3dbd-af52-453a-963c-5f059fe9e275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:02.804382 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a3dbd-af52-453a-963c-5f059fe9e275 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:02.805117 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a3dbd-af52-453a-963c-5f059fe9e275 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:24:02.805424 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a3dbd-af52-453a-963c-5f059fe9e275 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:02.807189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a3dbd-af52-453a-963c-5f059fe9e275 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:02.821622 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 960/1926] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:24:02.828140 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a3dbd-af52-453a-963c-5f059fe9e275 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:02.837845 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a3dbd-af52-453a-963c-5f059fe9e275 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:02.838931 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 967/1927] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:02 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:24:02.843685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51d66b-f15b-4667-9f0a-1a5f9a3efbff None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:02.846762 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbedba-5fd2-42a0-9263-64932cce0ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:02.847308 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbedba-5fd2-42a0-9263-64932cce0ede admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:02.847593 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbedba-5fd2-42a0-9263-64932cce0ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:02.847938 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbedba-5fd2-42a0-9263-64932cce0ede admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:02.848551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbedba-5fd2-42a0-9263-64932cce0ede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:02.850558 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbedba-5fd2-42a0-9263-64932cce0ede admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:02.856236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51d66b-f15b-4667-9f0a-1a5f9a3efbff None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:02.862296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741aa052-c185-4320-a348-7dc5679e887b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:02.863130 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aa052-c185-4320-a348-7dc5679e887b admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:02.863413 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aa052-c185-4320-a348-7dc5679e887b admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:02.863688 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aa052-c185-4320-a348-7dc5679e887b admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:02.864510 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741aa052-c185-4320-a348-7dc5679e887b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:02.866335 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741aa052-c185-4320-a348-7dc5679e887b admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:02.885363 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 961/1928] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:24:02 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:24:02.886540 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbedba-5fd2-42a0-9263-64932cce0ede admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:02.903577 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 968/1929] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:24:02 2022] POST /identity/v3/projects => generated 403 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:24:02.908053 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741aa052-c185-4320-a348-7dc5679e887b admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:02.962256 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbedba-5fd2-42a0-9263-64932cce0ede admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:02.973184 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:02.992612 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741aa052-c185-4320-a348-7dc5679e887b admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:03.001691 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d4896-32c2-47b5-9b6f-72e371c4f249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:03.002516 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d4896-32c2-47b5-9b6f-72e371c4f249 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:03.002866 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d4896-32c2-47b5-9b6f-72e371c4f249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:03.003626 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d4896-32c2-47b5-9b6f-72e371c4f249 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:03.003985 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d4896-32c2-47b5-9b6f-72e371c4f249 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:03.006647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d4896-32c2-47b5-9b6f-72e371c4f249 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:03.039407 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 969/1930] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:24:02 2022] POST /identity/v3/users => generated 308 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:24:03.042408 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac3abb-896f-4d1e-9f3d-a1dff62fff40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:03.043084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac3abb-896f-4d1e-9f3d-a1dff62fff40 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:03.043393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac3abb-896f-4d1e-9f3d-a1dff62fff40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:03.043671 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac3abb-896f-4d1e-9f3d-a1dff62fff40 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:03.044415 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac3abb-896f-4d1e-9f3d-a1dff62fff40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:03.045067 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d4896-32c2-47b5-9b6f-72e371c4f249 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:03.046699 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac3abb-896f-4d1e-9f3d-a1dff62fff40 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:03.055590 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d4896-32c2-47b5-9b6f-72e371c4f249 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:03.061620 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90929788-a27c-459c-a9d6-e796fdd411f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:03.062581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90929788-a27c-459c-a9d6-e796fdd411f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:03.062977 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90929788-a27c-459c-a9d6-e796fdd411f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:03.063379 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90929788-a27c-459c-a9d6-e796fdd411f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:03.065007 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90929788-a27c-459c-a9d6-e796fdd411f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:03.066916 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90929788-a27c-459c-a9d6-e796fdd411f8 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:03.069724 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 962/1931] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:24:02 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:24:03.073854 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac3abb-896f-4d1e-9f3d-a1dff62fff40 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:03.081222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 970/1932] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:24:03.084400 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac3abb-896f-4d1e-9f3d-a1dff62fff40 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:03.085454 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90929788-a27c-459c-a9d6-e796fdd411f8 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:03.089153 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7363bdd-ef78-4bce-88ee-60481cfe1953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:03.089800 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7363bdd-ef78-4bce-88ee-60481cfe1953 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:03.090275 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7363bdd-ef78-4bce-88ee-60481cfe1953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:03.090386 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7363bdd-ef78-4bce-88ee-60481cfe1953 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:03.091108 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7363bdd-ef78-4bce-88ee-60481cfe1953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:03.092755 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7363bdd-ef78-4bce-88ee-60481cfe1953 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:03.095244 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90929788-a27c-459c-a9d6-e796fdd411f8 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:03.100731 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f200e-d593-4a4f-8008-7fe763bdfd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:03.102251 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f200e-d593-4a4f-8008-7fe763bdfd12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:03.105415 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 963/1933] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:24:03.105545 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f200e-d593-4a4f-8008-7fe763bdfd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:03.105545 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f200e-d593-4a4f-8008-7fe763bdfd12 admin admin] PATH_INFO: `/v3/projects/4d11c4363e374f54b011a7b2336731cc/users/ac72d77c9c3440fb97224d179455b555/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:03.106581 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7363bdd-ef78-4bce-88ee-60481cfe1953 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:03.117048 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7363bdd-ef78-4bce-88ee-60481cfe1953 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:03.122091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b593e-7bd0-4ce3-96ff-adbea7724a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:03.122756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b593e-7bd0-4ce3-96ff-adbea7724a96 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:03.123042 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b593e-7bd0-4ce3-96ff-adbea7724a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:03.123311 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b593e-7bd0-4ce3-96ff-adbea7724a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:03.124613 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b593e-7bd0-4ce3-96ff-adbea7724a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:03.125714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f200e-d593-4a4f-8008-7fe763bdfd12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d11c4363e374f54b011a7b2336731cc, user_id=ac72d77c9c3440fb97224d179455b555, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:03.126298 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b593e-7bd0-4ce3-96ff-adbea7724a96 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:03.128555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f200e-d593-4a4f-8008-7fe763bdfd12 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:03.143906 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 964/1934] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:03.144134 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 971/1935] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:24:03 2022] PUT /identity/v3/projects/4d11c4363e374f54b011a7b2336731cc/users/ac72d77c9c3440fb97224d179455b555/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:03.147741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f200e-d593-4a4f-8008-7fe763bdfd12 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:03.147919 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b593e-7bd0-4ce3-96ff-adbea7724a96 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:03.157552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b593e-7bd0-4ce3-96ff-adbea7724a96 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:03.184259 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:03.215544 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f200e-d593-4a4f-8008-7fe763bdfd12 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:03.216758 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74b86b-9a12-45e0-b8a9-05a4443505a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:03.217541 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74b86b-9a12-45e0-b8a9-05a4443505a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:03.217844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74b86b-9a12-45e0-b8a9-05a4443505a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:03.218123 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74b86b-9a12-45e0-b8a9-05a4443505a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:03.218842 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74b86b-9a12-45e0-b8a9-05a4443505a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:03.220504 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74b86b-9a12-45e0-b8a9-05a4443505a0 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:03.220611 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06484d80-6c35-4849-8f89-af9c7b0c6367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:03.221438 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06484d80-6c35-4849-8f89-af9c7b0c6367 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:03.221959 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06484d80-6c35-4849-8f89-af9c7b0c6367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:03.222238 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06484d80-6c35-4849-8f89-af9c7b0c6367 admin admin] PATH_INFO: `/v3/projects/70aa2edc2fb444cc80e91a61b1d41f15/users/62d02c168e144c7587f70fe2082c56f8/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:03.230298 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 965/1936] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:24:03.234926 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74b86b-9a12-45e0-b8a9-05a4443505a0 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:03.239851 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06484d80-6c35-4849-8f89-af9c7b0c6367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70aa2edc2fb444cc80e91a61b1d41f15, user_id=62d02c168e144c7587f70fe2082c56f8, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:03.242565 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06484d80-6c35-4849-8f89-af9c7b0c6367 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:03.244299 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74b86b-9a12-45e0-b8a9-05a4443505a0 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:03.250384 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af72f1-9755-4bd9-a839-deb5af12928b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:03.251413 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af72f1-9755-4bd9-a839-deb5af12928b admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:03.251726 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af72f1-9755-4bd9-a839-deb5af12928b admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:03.252059 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af72f1-9755-4bd9-a839-deb5af12928b admin admin] PATH_INFO: `/v3/projects/4d11c4363e374f54b011a7b2336731cc/users/ac72d77c9c3440fb97224d179455b555/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:03.254275 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af72f1-9755-4bd9-a839-deb5af12928b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d11c4363e374f54b011a7b2336731cc, user_id=ac72d77c9c3440fb97224d179455b555, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:03.256937 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 972/1937] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:24:03 2022] PUT /identity/v3/projects/70aa2edc2fb444cc80e91a61b1d41f15/users/62d02c168e144c7587f70fe2082c56f8/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:03.257995 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af72f1-9755-4bd9-a839-deb5af12928b admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:03.268423 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc0c20-0432-4e65-bb6b-e34503f1c192 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:03.268743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc0c20-0432-4e65-bb6b-e34503f1c192 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:03.268983 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc0c20-0432-4e65-bb6b-e34503f1c192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:03.269446 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 966/1938] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:24:03 2022] PUT /identity/v3/projects/4d11c4363e374f54b011a7b2336731cc/users/ac72d77c9c3440fb97224d179455b555/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:24:03.279351 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc7240-9a02-4e10-9b00-486a9f571a9a None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:03.279646 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc7240-9a02-4e10-9b00-486a9f571a9a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:03.279961 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc7240-9a02-4e10-9b00-486a9f571a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:03.298161 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-27cc0c20-0432-4e65-bb6b-e34503f1c192 None None] MFA Rules not processed for user `62d02c168e144c7587f70fe2082c56f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:03.299522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-27cc0c20-0432-4e65-bb6b-e34503f1c192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:03.306936 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-9cfc7240-9a02-4e10-9b00-486a9f571a9a None None] MFA Rules not processed for user `ac72d77c9c3440fb97224d179455b555`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:03.308123 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-9cfc7240-9a02-4e10-9b00-486a9f571a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:03.365286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 973/1939] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:24:03.369725 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc0c20-0432-4e65-bb6b-e34503f1c192 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:03.381412 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 967/1940] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:03 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:24:03.388518 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:03.392690 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc7240-9a02-4e10-9b00-486a9f571a9a None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:03.394192 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-9cfc7240-9a02-4e10-9b00-486a9f571a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:03.432579 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc0c20-0432-4e65-bb6b-e34503f1c192 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:03.437857 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aab270-ff9f-4271-ac5e-19b0075cfbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:03.438713 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aab270-ff9f-4271-ac5e-19b0075cfbdc admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:03.440212 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aab270-ff9f-4271-ac5e-19b0075cfbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:03.440499 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aab270-ff9f-4271-ac5e-19b0075cfbdc admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:03.441202 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aab270-ff9f-4271-ac5e-19b0075cfbdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:03.444326 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aab270-ff9f-4271-ac5e-19b0075cfbdc admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:03.455969 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc7240-9a02-4e10-9b00-486a9f571a9a None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:03.459874 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0533c-4193-49fe-870a-cfda2449c760 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:03.460532 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0533c-4193-49fe-870a-cfda2449c760 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:03.460880 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0533c-4193-49fe-870a-cfda2449c760 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:03.461320 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0533c-4193-49fe-870a-cfda2449c760 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:03.472663 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0533c-4193-49fe-870a-cfda2449c760 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:03.474067 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 974/1941] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:24:03 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:24:03.474213 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0533c-4193-49fe-870a-cfda2449c760 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:03.478746 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aab270-ff9f-4271-ac5e-19b0075cfbdc admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:03.487957 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 968/1942] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:03 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:24:03.551265 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aab270-ff9f-4271-ac5e-19b0075cfbdc admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:03.562420 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27110019-5c3e-4128-8063-605a6375ce15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:03.563040 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27110019-5c3e-4128-8063-605a6375ce15 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:03.563325 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27110019-5c3e-4128-8063-605a6375ce15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:03.563602 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27110019-5c3e-4128-8063-605a6375ce15 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:03.564299 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27110019-5c3e-4128-8063-605a6375ce15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:03.566252 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27110019-5c3e-4128-8063-605a6375ce15 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:03.589129 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 975/1943] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:24:03 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:24:03.593071 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0533c-4193-49fe-870a-cfda2449c760 service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:03.603456 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0533c-4193-49fe-870a-cfda2449c760 service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:03.608151 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e079c-2f5e-490e-b837-f373394fa4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:03.608803 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e079c-2f5e-490e-b837-f373394fa4fe admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:03.609089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e079c-2f5e-490e-b837-f373394fa4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:03.609365 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e079c-2f5e-490e-b837-f373394fa4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:03.610119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e079c-2f5e-490e-b837-f373394fa4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:03.611708 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e079c-2f5e-490e-b837-f373394fa4fe admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:03.621567 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 969/1944] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:03.626170 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27110019-5c3e-4128-8063-605a6375ce15 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:03.635829 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27110019-5c3e-4128-8063-605a6375ce15 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:03.641310 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176eb6f-ebf9-45e2-aca9-cdeb3c25a51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:03.642231 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176eb6f-ebf9-45e2-aca9-cdeb3c25a51f admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:03.642513 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176eb6f-ebf9-45e2-aca9-cdeb3c25a51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:03.642786 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176eb6f-ebf9-45e2-aca9-cdeb3c25a51f admin admin] PATH_INFO: `/v3/projects/1471c0e9f5634a4795b30849a893d23d/users/2dea55f9cb9f4063b991584433ad1c58/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:03.657972 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176eb6f-ebf9-45e2-aca9-cdeb3c25a51f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1471c0e9f5634a4795b30849a893d23d, user_id=2dea55f9cb9f4063b991584433ad1c58, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:03.660575 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176eb6f-ebf9-45e2-aca9-cdeb3c25a51f admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:03.673131 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 976/1945] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:24:03 2022] PUT /identity/v3/projects/1471c0e9f5634a4795b30849a893d23d/users/2dea55f9cb9f4063b991584433ad1c58/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:03.677455 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e079c-2f5e-490e-b837-f373394fa4fe admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:03.687896 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e079c-2f5e-490e-b837-f373394fa4fe admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:03.713413 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:03.743396 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b20837-a0b3-4d6b-8d74-5cbd4355ccba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:03.744073 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b20837-a0b3-4d6b-8d74-5cbd4355ccba admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:03.744340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b20837-a0b3-4d6b-8d74-5cbd4355ccba admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:03.744617 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b20837-a0b3-4d6b-8d74-5cbd4355ccba admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:03.745329 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b20837-a0b3-4d6b-8d74-5cbd4355ccba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:03.746949 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b20837-a0b3-4d6b-8d74-5cbd4355ccba admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:03.757599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 970/1946] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:03.761645 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176eb6f-ebf9-45e2-aca9-cdeb3c25a51f admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:03.773649 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176eb6f-ebf9-45e2-aca9-cdeb3c25a51f admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:03.781489 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6b054-449d-47f0-acd6-d24873870658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:03.782402 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6b054-449d-47f0-acd6-d24873870658 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:03.782680 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6b054-449d-47f0-acd6-d24873870658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:03.782952 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6b054-449d-47f0-acd6-d24873870658 admin admin] PATH_INFO: `/v3/projects/1471c0e9f5634a4795b30849a893d23d/users/2dea55f9cb9f4063b991584433ad1c58/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:03.784889 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6b054-449d-47f0-acd6-d24873870658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1471c0e9f5634a4795b30849a893d23d, user_id=2dea55f9cb9f4063b991584433ad1c58, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:03.787546 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6b054-449d-47f0-acd6-d24873870658 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:03.797835 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 977/1947] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:24:03 2022] PUT /identity/v3/projects/1471c0e9f5634a4795b30849a893d23d/users/2dea55f9cb9f4063b991584433ad1c58/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:03.808619 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8d5a6-fe30-4533-9786-de5829cd6460 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:03.808904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8d5a6-fe30-4533-9786-de5829cd6460 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:03.809182 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8d5a6-fe30-4533-9786-de5829cd6460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:03.835709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-a7a8d5a6-fe30-4533-9786-de5829cd6460 None None] MFA Rules not processed for user `2dea55f9cb9f4063b991584433ad1c58`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:03.836905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a7a8d5a6-fe30-4533-9786-de5829cd6460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:03.892689 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6b054-449d-47f0-acd6-d24873870658 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:03.911674 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 971/1948] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:03 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:03.923834 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8d5a6-fe30-4533-9786-de5829cd6460 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:03.954858 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:03.960462 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6b054-449d-47f0-acd6-d24873870658 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:03.966404 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c50f3-9011-4244-acbf-15837c5083e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:03.967328 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c50f3-9011-4244-acbf-15837c5083e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:03.967605 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c50f3-9011-4244-acbf-15837c5083e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:03.967895 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c50f3-9011-4244-acbf-15837c5083e8 admin admin] PATH_INFO: `/v3/users/4d19760f96ee40069b9f82bc07f7a9ac` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:03.969046 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c50f3-9011-4244-acbf-15837c5083e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d19760f96ee40069b9f82bc07f7a9ac)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:03.970994 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c50f3-9011-4244-acbf-15837c5083e8 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:03.979611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8d5a6-fe30-4533-9786-de5829cd6460 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:03.983788 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e847cb-25d7-485f-8379-f023f32c678a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:03.984424 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e847cb-25d7-485f-8379-f023f32c678a service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:03.984814 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e847cb-25d7-485f-8379-f023f32c678a service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:03.985150 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e847cb-25d7-485f-8379-f023f32c678a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:04.019956 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-fe9c50f3-9011-4244-acbf-15837c5083e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d19760f96ee40069b9f82bc07f7a9ac'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:04.027730 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-fe9c50f3-9011-4244-acbf-15837c5083e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d19760f96ee40069b9f82bc07f7a9ac'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:04.028423 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-fe9c50f3-9011-4244-acbf-15837c5083e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d19760f96ee40069b9f82bc07f7a9ac'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:04.029066 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-fe9c50f3-9011-4244-acbf-15837c5083e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d19760f96ee40069b9f82bc07f7a9ac'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:04.042515 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-fe9c50f3-9011-4244-acbf-15837c5083e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d19760f96ee40069b9f82bc07f7a9ac'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:04.043658 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e847cb-25d7-485f-8379-f023f32c678a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:04.045857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e847cb-25d7-485f-8379-f023f32c678a service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:04.057995 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 972/1949] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:24:04.062417 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 978/1950] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:24:03 2022] DELETE /identity/v3/users/4d19760f96ee40069b9f82bc07f7a9ac => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:24:04.067282 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef818e62-1b00-4d57-85a3-bf71fa434e5f None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:04.067577 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef818e62-1b00-4d57-85a3-bf71fa434e5f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:04.067863 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef818e62-1b00-4d57-85a3-bf71fa434e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:04.074784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:04.093010 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-ef818e62-1b00-4d57-85a3-bf71fa434e5f None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:04.094364 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ef818e62-1b00-4d57-85a3-bf71fa434e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:04.166801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 973/1951] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:24:04.177693 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c50f3-9011-4244-acbf-15837c5083e8 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:04.179680 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-fe9c50f3-9011-4244-acbf-15837c5083e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:04.250207 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c50f3-9011-4244-acbf-15837c5083e8 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:04.253969 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65a5ff-7a6f-4332-a09f-126f7aaa3603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:04.254823 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65a5ff-7a6f-4332-a09f-126f7aaa3603 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:04.255213 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65a5ff-7a6f-4332-a09f-126f7aaa3603 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:04.255384 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65a5ff-7a6f-4332-a09f-126f7aaa3603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:04.265424 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65a5ff-7a6f-4332-a09f-126f7aaa3603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:04.266936 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65a5ff-7a6f-4332-a09f-126f7aaa3603 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:04.276524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 979/1952] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:24:04.567142 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef818e62-1b00-4d57-85a3-bf71fa434e5f None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:04.569222 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ef818e62-1b00-4d57-85a3-bf71fa434e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:04.582354 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef818e62-1b00-4d57-85a3-bf71fa434e5f None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:04.586969 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7fa3c8-db08-420e-ac5a-9928bec979d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:04.587840 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fa3c8-db08-420e-ac5a-9928bec979d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:04.588122 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fa3c8-db08-420e-ac5a-9928bec979d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:04.588393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fa3c8-db08-420e-ac5a-9928bec979d8 admin admin] PATH_INFO: `/v3/projects/c69cca84c83a4079a1bcd3cf88268bc3` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:04.589576 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7fa3c8-db08-420e-ac5a-9928bec979d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c69cca84c83a4079a1bcd3cf88268bc3)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:04.591526 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7fa3c8-db08-420e-ac5a-9928bec979d8 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:04.639671 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-eb7fa3c8-db08-420e-ac5a-9928bec979d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c69cca84c83a4079a1bcd3cf88268bc3', 'request_id': 'req-eb7fa3c8-db08-420e-ac5a-9928bec979d8'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:04.645866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-eb7fa3c8-db08-420e-ac5a-9928bec979d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c69cca84c83a4079a1bcd3cf88268bc3', 'request_id': 'req-eb7fa3c8-db08-420e-ac5a-9928bec979d8'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:04.653353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-eb7fa3c8-db08-420e-ac5a-9928bec979d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c69cca84c83a4079a1bcd3cf88268bc3', 'request_id': 'req-eb7fa3c8-db08-420e-ac5a-9928bec979d8'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:04.664173 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-eb7fa3c8-db08-420e-ac5a-9928bec979d8 admin admin] The token cache is being invalidate because project c69cca84c83a4079a1bcd3cf88268bc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:24:04.664462 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-eb7fa3c8-db08-420e-ac5a-9928bec979d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:04.665090 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-eb7fa3c8-db08-420e-ac5a-9928bec979d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:04.666692 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 974/1953] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:24:04 2022] DELETE /identity/v3/projects/c69cca84c83a4079a1bcd3cf88268bc3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:04.671124 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65a5ff-7a6f-4332-a09f-126f7aaa3603 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:04.680920 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65a5ff-7a6f-4332-a09f-126f7aaa3603 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:04.735803 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354aa1c-e97a-4a1c-8c96-a2584b2719fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:04.736675 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354aa1c-e97a-4a1c-8c96-a2584b2719fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:04.736957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354aa1c-e97a-4a1c-8c96-a2584b2719fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:04.737248 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354aa1c-e97a-4a1c-8c96-a2584b2719fd admin admin] PATH_INFO: `/v3/users/ac72d77c9c3440fb97224d179455b555` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:04.738434 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354aa1c-e97a-4a1c-8c96-a2584b2719fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac72d77c9c3440fb97224d179455b555)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:04.740390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354aa1c-e97a-4a1c-8c96-a2584b2719fd admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:04.761138 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:04.787633 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c354aa1c-e97a-4a1c-8c96-a2584b2719fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac72d77c9c3440fb97224d179455b555'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:04.794945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c354aa1c-e97a-4a1c-8c96-a2584b2719fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac72d77c9c3440fb97224d179455b555'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:04.796132 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c354aa1c-e97a-4a1c-8c96-a2584b2719fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac72d77c9c3440fb97224d179455b555'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:04.796746 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c354aa1c-e97a-4a1c-8c96-a2584b2719fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac72d77c9c3440fb97224d179455b555'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:04.810354 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c354aa1c-e97a-4a1c-8c96-a2584b2719fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac72d77c9c3440fb97224d179455b555'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:04.831506 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 980/1954] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:24:04 2022] DELETE /identity/v3/users/ac72d77c9c3440fb97224d179455b555 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:05.119180 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7fa3c8-db08-420e-ac5a-9928bec979d8 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:05.120770 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-eb7fa3c8-db08-420e-ac5a-9928bec979d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:05.144860 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7fa3c8-db08-420e-ac5a-9928bec979d8 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:05.201899 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866901cf-58f0-4e16-b726-6e5e135cfbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:05.202693 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866901cf-58f0-4e16-b726-6e5e135cfbcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:05.202970 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866901cf-58f0-4e16-b726-6e5e135cfbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:05.203238 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866901cf-58f0-4e16-b726-6e5e135cfbcd admin admin] PATH_INFO: `/v3/projects/4d11c4363e374f54b011a7b2336731cc` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:05.204401 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866901cf-58f0-4e16-b726-6e5e135cfbcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d11c4363e374f54b011a7b2336731cc)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:05.206348 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866901cf-58f0-4e16-b726-6e5e135cfbcd admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:05.240064 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:05.255013 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-866901cf-58f0-4e16-b726-6e5e135cfbcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d11c4363e374f54b011a7b2336731cc', 'request_id': 'req-866901cf-58f0-4e16-b726-6e5e135cfbcd'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:05.261913 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-866901cf-58f0-4e16-b726-6e5e135cfbcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d11c4363e374f54b011a7b2336731cc', 'request_id': 'req-866901cf-58f0-4e16-b726-6e5e135cfbcd'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:05.270298 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-866901cf-58f0-4e16-b726-6e5e135cfbcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d11c4363e374f54b011a7b2336731cc', 'request_id': 'req-866901cf-58f0-4e16-b726-6e5e135cfbcd'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:05.281775 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-866901cf-58f0-4e16-b726-6e5e135cfbcd admin admin] The token cache is being invalidate because project 4d11c4363e374f54b011a7b2336731cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:24:05.282094 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-866901cf-58f0-4e16-b726-6e5e135cfbcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:05.282719 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-866901cf-58f0-4e16-b726-6e5e135cfbcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:05.284285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 975/1955] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:24:05 2022] DELETE /identity/v3/projects/4d11c4363e374f54b011a7b2336731cc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:05.289196 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e43c8-bc3d-4df2-9358-6466cc19e2d8 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:05.289493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e43c8-bc3d-4df2-9358-6466cc19e2d8 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:05.289772 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e43c8-bc3d-4df2-9358-6466cc19e2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:05.309162 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-448e43c8-bc3d-4df2-9358-6466cc19e2d8 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:05.310427 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-448e43c8-bc3d-4df2-9358-6466cc19e2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:05.379392 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 981/1956] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:05.381364 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d1125-5d50-479b-b2db-7bae21809815 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:05.381654 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d1125-5d50-479b-b2db-7bae21809815 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:05.381955 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d1125-5d50-479b-b2db-7bae21809815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:05.404081 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-2a9d1125-5d50-479b-b2db-7bae21809815 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:05.406191 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2a9d1125-5d50-479b-b2db-7bae21809815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:05.414854 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 976/1957] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:05.426654 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e43c8-bc3d-4df2-9358-6466cc19e2d8 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:05.436968 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e43c8-bc3d-4df2-9358-6466cc19e2d8 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:05.440942 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97a7b9-7f20-4bda-bdfd-377316ec23d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:05.441601 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97a7b9-7f20-4bda-bdfd-377316ec23d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:05.441905 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97a7b9-7f20-4bda-bdfd-377316ec23d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:05.442198 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97a7b9-7f20-4bda-bdfd-377316ec23d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:05.443323 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97a7b9-7f20-4bda-bdfd-377316ec23d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:24:05.443627 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97a7b9-7f20-4bda-bdfd-377316ec23d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:05.445208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97a7b9-7f20-4bda-bdfd-377316ec23d6 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:05.458686 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 982/1958] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:24:05.462917 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d1125-5d50-479b-b2db-7bae21809815 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:05.476333 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d1125-5d50-479b-b2db-7bae21809815 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:05.481397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b834bd-04a2-4324-be86-0a8e0dc1b536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:05.482234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b834bd-04a2-4324-be86-0a8e0dc1b536 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:05.482596 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b834bd-04a2-4324-be86-0a8e0dc1b536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:05.482965 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b834bd-04a2-4324-be86-0a8e0dc1b536 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:05.483740 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b834bd-04a2-4324-be86-0a8e0dc1b536 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:05.485741 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b834bd-04a2-4324-be86-0a8e0dc1b536 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:05.520679 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 977/1959] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:24:05 2022] POST /identity/v3/projects => generated 363 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:24:05.521719 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97a7b9-7f20-4bda-bdfd-377316ec23d6 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:05.533924 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97a7b9-7f20-4bda-bdfd-377316ec23d6 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:05.596551 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011582f2-8395-48aa-a4d1-0a6f241e47a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:05.597226 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011582f2-8395-48aa-a4d1-0a6f241e47a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:05.597507 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011582f2-8395-48aa-a4d1-0a6f241e47a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:05.597782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011582f2-8395-48aa-a4d1-0a6f241e47a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:05.598505 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011582f2-8395-48aa-a4d1-0a6f241e47a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:05.600426 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011582f2-8395-48aa-a4d1-0a6f241e47a9 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:05.620117 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 983/1960] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:24:05 2022] POST /identity/v3/users => generated 282 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:24:05.624213 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b834bd-04a2-4324-be86-0a8e0dc1b536 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:05.634500 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b834bd-04a2-4324-be86-0a8e0dc1b536 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:05.639740 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3343a4-e8e1-4972-b6e4-2dcbfe03b84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:05.640393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3343a4-e8e1-4972-b6e4-2dcbfe03b84b admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:05.640678 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3343a4-e8e1-4972-b6e4-2dcbfe03b84b admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:05.640954 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3343a4-e8e1-4972-b6e4-2dcbfe03b84b admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:05.641685 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3343a4-e8e1-4972-b6e4-2dcbfe03b84b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:05.643315 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3343a4-e8e1-4972-b6e4-2dcbfe03b84b admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:05.653764 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 978/1961] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:05.658171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011582f2-8395-48aa-a4d1-0a6f241e47a9 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:05.667950 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011582f2-8395-48aa-a4d1-0a6f241e47a9 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:05.672533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc54ba5-4103-4212-8bc0-7f963d446a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:05.673181 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc54ba5-4103-4212-8bc0-7f963d446a22 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:05.673464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc54ba5-4103-4212-8bc0-7f963d446a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:05.673742 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc54ba5-4103-4212-8bc0-7f963d446a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:05.674493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc54ba5-4103-4212-8bc0-7f963d446a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:05.676379 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc54ba5-4103-4212-8bc0-7f963d446a22 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:05.686204 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 984/1962] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:05.690081 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3343a4-e8e1-4972-b6e4-2dcbfe03b84b admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:05.699766 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3343a4-e8e1-4972-b6e4-2dcbfe03b84b admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:05.704780 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15835dad-baea-4dc7-8640-03b2feaab426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:05.705639 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15835dad-baea-4dc7-8640-03b2feaab426 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:05.705948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15835dad-baea-4dc7-8640-03b2feaab426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:05.706226 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15835dad-baea-4dc7-8640-03b2feaab426 admin admin] PATH_INFO: `/v3/projects/88a1e781f8954783821c64d0d4aa6e15/users/cec5668fe4994a998dd6bfbe726c136d/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:05.720800 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15835dad-baea-4dc7-8640-03b2feaab426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88a1e781f8954783821c64d0d4aa6e15, user_id=cec5668fe4994a998dd6bfbe726c136d, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:05.723406 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15835dad-baea-4dc7-8640-03b2feaab426 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:05.736174 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 979/1963] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:24:05 2022] PUT /identity/v3/projects/88a1e781f8954783821c64d0d4aa6e15/users/cec5668fe4994a998dd6bfbe726c136d/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:05.747302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d15b0d-522f-4b66-b4de-e3c2dd4da4ee None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:05.747596 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d15b0d-522f-4b66-b4de-e3c2dd4da4ee None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:05.747873 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d15b0d-522f-4b66-b4de-e3c2dd4da4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:05.754099 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:05.777995 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-69d15b0d-522f-4b66-b4de-e3c2dd4da4ee None None] MFA Rules not processed for user `cec5668fe4994a998dd6bfbe726c136d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:05.779198 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-69d15b0d-522f-4b66-b4de-e3c2dd4da4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:05.842017 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 985/1964] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:05 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:05.846445 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15835dad-baea-4dc7-8640-03b2feaab426 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:05.906910 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15835dad-baea-4dc7-8640-03b2feaab426 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:05.911608 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e99c8-5236-4770-8263-c8716c1f9f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:05.912269 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e99c8-5236-4770-8263-c8716c1f9f23 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:05.912553 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e99c8-5236-4770-8263-c8716c1f9f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:05.912828 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e99c8-5236-4770-8263-c8716c1f9f23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:05.913517 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e99c8-5236-4770-8263-c8716c1f9f23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:05.915456 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e99c8-5236-4770-8263-c8716c1f9f23 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:05.941642 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 980/1965] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:24:05 2022] POST /identity/v3/projects => generated 363 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:24:05.945641 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d15b0d-522f-4b66-b4de-e3c2dd4da4ee None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:05.956174 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d15b0d-522f-4b66-b4de-e3c2dd4da4ee None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:06.012627 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9f769-4854-4084-a813-595c5aecb761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:06.013533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9f769-4854-4084-a813-595c5aecb761 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:06.013996 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9f769-4854-4084-a813-595c5aecb761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:06.014868 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9f769-4854-4084-a813-595c5aecb761 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:06.015690 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9f769-4854-4084-a813-595c5aecb761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:06.017717 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9f769-4854-4084-a813-595c5aecb761 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:06.036235 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 986/1966] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:24:05 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:24:06.040106 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e99c8-5236-4770-8263-c8716c1f9f23 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:06.050626 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e99c8-5236-4770-8263-c8716c1f9f23 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:06.055500 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750bd3b-5eb3-4e9d-bcd2-23e191d7a9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:06.056162 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750bd3b-5eb3-4e9d-bcd2-23e191d7a9ed admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:06.056448 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750bd3b-5eb3-4e9d-bcd2-23e191d7a9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:06.056756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750bd3b-5eb3-4e9d-bcd2-23e191d7a9ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:06.057483 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750bd3b-5eb3-4e9d-bcd2-23e191d7a9ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:06.059134 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750bd3b-5eb3-4e9d-bcd2-23e191d7a9ed admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:06.070086 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 981/1967] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:06.074012 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9f769-4854-4084-a813-595c5aecb761 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:06.084449 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9f769-4854-4084-a813-595c5aecb761 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:06.089078 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4deaa3-2fab-4e27-9db9-8899f3893bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:06.089983 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4deaa3-2fab-4e27-9db9-8899f3893bdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:06.090267 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4deaa3-2fab-4e27-9db9-8899f3893bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:06.090540 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4deaa3-2fab-4e27-9db9-8899f3893bdf admin admin] PATH_INFO: `/v3/projects/690381f53921485caea4b14cb0a3e117/users/6e806ea9baa7482c8a409ea6cc2bf8e4/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:06.105080 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4deaa3-2fab-4e27-9db9-8899f3893bdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=690381f53921485caea4b14cb0a3e117, user_id=6e806ea9baa7482c8a409ea6cc2bf8e4, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:06.108284 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4deaa3-2fab-4e27-9db9-8899f3893bdf admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:06.120757 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 987/1968] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:24:06 2022] PUT /identity/v3/projects/690381f53921485caea4b14cb0a3e117/users/6e806ea9baa7482c8a409ea6cc2bf8e4/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:06.125194 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750bd3b-5eb3-4e9d-bcd2-23e191d7a9ed admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:06.135307 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750bd3b-5eb3-4e9d-bcd2-23e191d7a9ed admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:06.160338 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:06.195797 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e10c39-2451-49ff-af3c-5cab78847fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:06.196473 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e10c39-2451-49ff-af3c-5cab78847fca admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:06.196753 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e10c39-2451-49ff-af3c-5cab78847fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:06.197028 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e10c39-2451-49ff-af3c-5cab78847fca admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:06.197789 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e10c39-2451-49ff-af3c-5cab78847fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:06.199397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e10c39-2451-49ff-af3c-5cab78847fca admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:06.212262 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 982/1969] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:06.213443 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4deaa3-2fab-4e27-9db9-8899f3893bdf admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:06.223885 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4deaa3-2fab-4e27-9db9-8899f3893bdf admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:06.228506 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635cff7-7932-4e1c-81d2-2bca2654edf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:06.229376 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635cff7-7932-4e1c-81d2-2bca2654edf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:06.229657 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635cff7-7932-4e1c-81d2-2bca2654edf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:06.229968 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635cff7-7932-4e1c-81d2-2bca2654edf8 admin admin] PATH_INFO: `/v3/projects/690381f53921485caea4b14cb0a3e117/users/6e806ea9baa7482c8a409ea6cc2bf8e4/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:06.231934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635cff7-7932-4e1c-81d2-2bca2654edf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=690381f53921485caea4b14cb0a3e117, user_id=6e806ea9baa7482c8a409ea6cc2bf8e4, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:06.235177 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635cff7-7932-4e1c-81d2-2bca2654edf8 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:06.245200 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 988/1970] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:24:06 2022] PUT /identity/v3/projects/690381f53921485caea4b14cb0a3e117/users/6e806ea9baa7482c8a409ea6cc2bf8e4/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:06.255684 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ca6de-d8a3-48b1-9ea6-9e9fc9a76f13 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:06.255908 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ca6de-d8a3-48b1-9ea6-9e9fc9a76f13 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:06.256183 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ca6de-d8a3-48b1-9ea6-9e9fc9a76f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:06.281536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-036ca6de-d8a3-48b1-9ea6-9e9fc9a76f13 None None] MFA Rules not processed for user `6e806ea9baa7482c8a409ea6cc2bf8e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:06.282744 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-036ca6de-d8a3-48b1-9ea6-9e9fc9a76f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:06.348637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 983/1971] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:06 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:06.360519 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635cff7-7932-4e1c-81d2-2bca2654edf8 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:06.362272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d635cff7-7932-4e1c-81d2-2bca2654edf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:06.408072 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:06.419252 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635cff7-7932-4e1c-81d2-2bca2654edf8 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:06.423458 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f28bd4-ab34-4dbe-bf3f-9aff4a14f95f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:06.424100 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f28bd4-ab34-4dbe-bf3f-9aff4a14f95f service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:06.424387 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f28bd4-ab34-4dbe-bf3f-9aff4a14f95f service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:06.424664 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f28bd4-ab34-4dbe-bf3f-9aff4a14f95f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:06.434080 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f28bd4-ab34-4dbe-bf3f-9aff4a14f95f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:06.435523 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f28bd4-ab34-4dbe-bf3f-9aff4a14f95f service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:06.445707 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 989/1972] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:06 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:24:06.520076 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ca6de-d8a3-48b1-9ea6-9e9fc9a76f13 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:06.530228 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ca6de-d8a3-48b1-9ea6-9e9fc9a76f13 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:06.533957 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fb270-52eb-4dd3-ad9d-41d4d2d690ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:06.534619 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fb270-52eb-4dd3-ad9d-41d4d2d690ad service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:06.535028 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fb270-52eb-4dd3-ad9d-41d4d2d690ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:06.536195 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fb270-52eb-4dd3-ad9d-41d4d2d690ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:06.597889 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4fb270-52eb-4dd3-ad9d-41d4d2d690ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:06.599347 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4fb270-52eb-4dd3-ad9d-41d4d2d690ad service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:06.609488 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 984/1973] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:06 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:24:09.768720 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f28bd4-ab34-4dbe-bf3f-9aff4a14f95f service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:09.770195 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-07f28bd4-ab34-4dbe-bf3f-9aff4a14f95f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:09.838164 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f28bd4-ab34-4dbe-bf3f-9aff4a14f95f service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:09.843552 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03b9a2-2d2c-4306-88fe-b5fcdfdb4ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:09.844519 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03b9a2-2d2c-4306-88fe-b5fcdfdb4ed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:09.844871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03b9a2-2d2c-4306-88fe-b5fcdfdb4ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:09.845254 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03b9a2-2d2c-4306-88fe-b5fcdfdb4ed9 admin admin] PATH_INFO: `/v3/users/62d02c168e144c7587f70fe2082c56f8` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:09.846546 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03b9a2-2d2c-4306-88fe-b5fcdfdb4ed9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62d02c168e144c7587f70fe2082c56f8)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:09.848591 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03b9a2-2d2c-4306-88fe-b5fcdfdb4ed9 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:09.894561 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-8e03b9a2-2d2c-4306-88fe-b5fcdfdb4ed9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62d02c168e144c7587f70fe2082c56f8'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:09.901466 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-8e03b9a2-2d2c-4306-88fe-b5fcdfdb4ed9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62d02c168e144c7587f70fe2082c56f8'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:09.902131 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-8e03b9a2-2d2c-4306-88fe-b5fcdfdb4ed9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62d02c168e144c7587f70fe2082c56f8'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:09.902737 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-8e03b9a2-2d2c-4306-88fe-b5fcdfdb4ed9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62d02c168e144c7587f70fe2082c56f8'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:09.915152 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-8e03b9a2-2d2c-4306-88fe-b5fcdfdb4ed9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62d02c168e144c7587f70fe2082c56f8'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:09.934088 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 990/1974] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:24:09 2022] DELETE /identity/v3/users/62d02c168e144c7587f70fe2082c56f8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:09.936131 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0e2dd-f8a6-4648-aec9-0565f6043c76 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:09.936564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0e2dd-f8a6-4648-aec9-0565f6043c76 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:09.936731 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0e2dd-f8a6-4648-aec9-0565f6043c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:09.956401 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-8cb0e2dd-f8a6-4648-aec9-0565f6043c76 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:09.957615 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8cb0e2dd-f8a6-4648-aec9-0565f6043c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:10.003980 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:10.019747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 985/1975] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:10.029151 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03b9a2-2d2c-4306-88fe-b5fcdfdb4ed9 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:10.031225 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8e03b9a2-2d2c-4306-88fe-b5fcdfdb4ed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:10.101275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03b9a2-2d2c-4306-88fe-b5fcdfdb4ed9 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:10.105191 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19a90e-a9cd-4158-9c6d-b7f6203fac16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:10.105872 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19a90e-a9cd-4158-9c6d-b7f6203fac16 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:10.106209 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19a90e-a9cd-4158-9c6d-b7f6203fac16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:10.106554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19a90e-a9cd-4158-9c6d-b7f6203fac16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:10.115621 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19a90e-a9cd-4158-9c6d-b7f6203fac16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:10.117041 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19a90e-a9cd-4158-9c6d-b7f6203fac16 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:10.126366 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 991/1976] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:24:10.417735 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0e2dd-f8a6-4648-aec9-0565f6043c76 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:10.419215 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8cb0e2dd-f8a6-4648-aec9-0565f6043c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:10.440327 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0e2dd-f8a6-4648-aec9-0565f6043c76 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:10.445257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19a90e-a9cd-4158-9c6d-b7f6203fac16 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:10.446469 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c7b84-3fe8-4c79-981b-c6d20c5ae0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:10.447437 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3e19a90e-a9cd-4158-9c6d-b7f6203fac16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:10.447702 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c7b84-3fe8-4c79-981b-c6d20c5ae0cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:10.448261 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c7b84-3fe8-4c79-981b-c6d20c5ae0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:10.448906 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c7b84-3fe8-4c79-981b-c6d20c5ae0cf admin admin] PATH_INFO: `/v3/projects/70aa2edc2fb444cc80e91a61b1d41f15` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:10.450405 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c7b84-3fe8-4c79-981b-c6d20c5ae0cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=70aa2edc2fb444cc80e91a61b1d41f15)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:10.453463 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c7b84-3fe8-4c79-981b-c6d20c5ae0cf admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:10.461221 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19a90e-a9cd-4158-9c6d-b7f6203fac16 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:10.466885 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1a288-6f44-49d9-9972-7ebcd7ff2cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:10.467825 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1a288-6f44-49d9-9972-7ebcd7ff2cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:10.468106 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1a288-6f44-49d9-9972-7ebcd7ff2cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:10.468381 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1a288-6f44-49d9-9972-7ebcd7ff2cfa admin admin] PATH_INFO: `/v3/users/cec5668fe4994a998dd6bfbe726c136d` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:10.469586 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1a288-6f44-49d9-9972-7ebcd7ff2cfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=cec5668fe4994a998dd6bfbe726c136d)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:10.472494 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1a288-6f44-49d9-9972-7ebcd7ff2cfa admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:10.475814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:10.509903 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-056c7b84-3fe8-4c79-981b-c6d20c5ae0cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70aa2edc2fb444cc80e91a61b1d41f15', 'request_id': 'req-056c7b84-3fe8-4c79-981b-c6d20c5ae0cf'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:10.517842 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-056c7b84-3fe8-4c79-981b-c6d20c5ae0cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70aa2edc2fb444cc80e91a61b1d41f15', 'request_id': 'req-056c7b84-3fe8-4c79-981b-c6d20c5ae0cf'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:10.534415 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-6bc1a288-6f44-49d9-9972-7ebcd7ff2cfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cec5668fe4994a998dd6bfbe726c136d'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:10.537527 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-056c7b84-3fe8-4c79-981b-c6d20c5ae0cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70aa2edc2fb444cc80e91a61b1d41f15', 'request_id': 'req-056c7b84-3fe8-4c79-981b-c6d20c5ae0cf'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:10.541892 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-6bc1a288-6f44-49d9-9972-7ebcd7ff2cfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cec5668fe4994a998dd6bfbe726c136d'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:10.542526 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-6bc1a288-6f44-49d9-9972-7ebcd7ff2cfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cec5668fe4994a998dd6bfbe726c136d'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:10.543134 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-6bc1a288-6f44-49d9-9972-7ebcd7ff2cfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cec5668fe4994a998dd6bfbe726c136d'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:10.553896 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-056c7b84-3fe8-4c79-981b-c6d20c5ae0cf admin admin] The token cache is being invalidate because project 70aa2edc2fb444cc80e91a61b1d41f15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:24:10.554186 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-056c7b84-3fe8-4c79-981b-c6d20c5ae0cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:10.554823 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-056c7b84-3fe8-4c79-981b-c6d20c5ae0cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:10.556395 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 986/1977] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:24:10 2022] DELETE /identity/v3/projects/70aa2edc2fb444cc80e91a61b1d41f15 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:10.558107 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-6bc1a288-6f44-49d9-9972-7ebcd7ff2cfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cec5668fe4994a998dd6bfbe726c136d'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:10.560093 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c7b84-3fe8-4c79-981b-c6d20c5ae0cf admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:10.562897 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-056c7b84-3fe8-4c79-981b-c6d20c5ae0cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:10.573349 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 992/1978] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:24:10 2022] DELETE /identity/v3/users/cec5668fe4994a998dd6bfbe726c136d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:10.578088 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d0686-16f4-4813-9443-5e9e67622859 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:10.578432 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d0686-16f4-4813-9443-5e9e67622859 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:10.578710 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d0686-16f4-4813-9443-5e9e67622859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:10.599300 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-863d0686-16f4-4813-9443-5e9e67622859 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:10.600421 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-863d0686-16f4-4813-9443-5e9e67622859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:10.630000 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c7b84-3fe8-4c79-981b-c6d20c5ae0cf admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:10.662658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 993/1979] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:24:10.672949 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d0686-16f4-4813-9443-5e9e67622859 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:10.674368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-863d0686-16f4-4813-9443-5e9e67622859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:10.686034 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b269c03-0ec8-4ce1-8076-6e4b3b67f11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:10.687489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b269c03-0ec8-4ce1-8076-6e4b3b67f11f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:10.687782 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b269c03-0ec8-4ce1-8076-6e4b3b67f11f admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:10.688049 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b269c03-0ec8-4ce1-8076-6e4b3b67f11f admin admin] PATH_INFO: `/v3/users/2dea55f9cb9f4063b991584433ad1c58` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:10.689263 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b269c03-0ec8-4ce1-8076-6e4b3b67f11f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dea55f9cb9f4063b991584433ad1c58)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:10.691223 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b269c03-0ec8-4ce1-8076-6e4b3b67f11f admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:10.713743 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:10.735283 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d0686-16f4-4813-9443-5e9e67622859 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:10.739288 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8d64b-8c33-4a65-a57b-7eb0701cd716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:10.740003 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8d64b-8c33-4a65-a57b-7eb0701cd716 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:10.740436 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8d64b-8c33-4a65-a57b-7eb0701cd716 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:10.740719 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8d64b-8c33-4a65-a57b-7eb0701cd716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:10.742174 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9b269c03-0ec8-4ce1-8076-6e4b3b67f11f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dea55f9cb9f4063b991584433ad1c58'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:10.749844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9b269c03-0ec8-4ce1-8076-6e4b3b67f11f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dea55f9cb9f4063b991584433ad1c58'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:10.750539 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8d64b-8c33-4a65-a57b-7eb0701cd716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:10.750650 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9b269c03-0ec8-4ce1-8076-6e4b3b67f11f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dea55f9cb9f4063b991584433ad1c58'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:10.751974 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8d64b-8c33-4a65-a57b-7eb0701cd716 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:10.761293 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 994/1980] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:24:10.762847 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9b269c03-0ec8-4ce1-8076-6e4b3b67f11f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dea55f9cb9f4063b991584433ad1c58'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:10.763679 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9b269c03-0ec8-4ce1-8076-6e4b3b67f11f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dea55f9cb9f4063b991584433ad1c58'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:10.776356 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 987/1981] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:24:10 2022] DELETE /identity/v3/users/2dea55f9cb9f4063b991584433ad1c58 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:24:11.134298 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8d64b-8c33-4a65-a57b-7eb0701cd716 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:11.136010 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b7b8d64b-8c33-4a65-a57b-7eb0701cd716 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:11.146438 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b269c03-0ec8-4ce1-8076-6e4b3b67f11f admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:11.148813 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-9b269c03-0ec8-4ce1-8076-6e4b3b67f11f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:11.151303 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8d64b-8c33-4a65-a57b-7eb0701cd716 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:11.179354 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:11.244678 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b35a7-f239-46ec-9d55-b8ddad6ddccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:11.245564 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b35a7-f239-46ec-9d55-b8ddad6ddccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:11.245897 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b35a7-f239-46ec-9d55-b8ddad6ddccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:11.246184 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b35a7-f239-46ec-9d55-b8ddad6ddccd admin admin] PATH_INFO: `/v3/projects/88a1e781f8954783821c64d0d4aa6e15` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:11.248254 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b35a7-f239-46ec-9d55-b8ddad6ddccd admin admin] RBAC: Authorizing `identity:delete_project(project_id=88a1e781f8954783821c64d0d4aa6e15)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:11.251686 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b35a7-f239-46ec-9d55-b8ddad6ddccd admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:11.268159 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b269c03-0ec8-4ce1-8076-6e4b3b67f11f admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:11.276648 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6284e-7eeb-454c-98d0-720f9b174343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:11.277554 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6284e-7eeb-454c-98d0-720f9b174343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:11.277871 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6284e-7eeb-454c-98d0-720f9b174343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:11.278271 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6284e-7eeb-454c-98d0-720f9b174343 admin admin] PATH_INFO: `/v3/projects/1471c0e9f5634a4795b30849a893d23d` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:11.279786 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6284e-7eeb-454c-98d0-720f9b174343 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1471c0e9f5634a4795b30849a893d23d)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:11.282438 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6284e-7eeb-454c-98d0-720f9b174343 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:11.323120 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-5d9b35a7-f239-46ec-9d55-b8ddad6ddccd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88a1e781f8954783821c64d0d4aa6e15', 'request_id': 'req-5d9b35a7-f239-46ec-9d55-b8ddad6ddccd'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:11.330247 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-5d9b35a7-f239-46ec-9d55-b8ddad6ddccd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88a1e781f8954783821c64d0d4aa6e15', 'request_id': 'req-5d9b35a7-f239-46ec-9d55-b8ddad6ddccd'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:11.335171 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-43b6284e-7eeb-454c-98d0-720f9b174343 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1471c0e9f5634a4795b30849a893d23d', 'request_id': 'req-43b6284e-7eeb-454c-98d0-720f9b174343'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:11.338302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-5d9b35a7-f239-46ec-9d55-b8ddad6ddccd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88a1e781f8954783821c64d0d4aa6e15', 'request_id': 'req-5d9b35a7-f239-46ec-9d55-b8ddad6ddccd'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:11.341641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-43b6284e-7eeb-454c-98d0-720f9b174343 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1471c0e9f5634a4795b30849a893d23d', 'request_id': 'req-43b6284e-7eeb-454c-98d0-720f9b174343'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:11.350066 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-43b6284e-7eeb-454c-98d0-720f9b174343 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1471c0e9f5634a4795b30849a893d23d', 'request_id': 'req-43b6284e-7eeb-454c-98d0-720f9b174343'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:11.351001 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-5d9b35a7-f239-46ec-9d55-b8ddad6ddccd admin admin] The token cache is being invalidate because project 88a1e781f8954783821c64d0d4aa6e15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:24:11.351308 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-5d9b35a7-f239-46ec-9d55-b8ddad6ddccd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:11.351924 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-5d9b35a7-f239-46ec-9d55-b8ddad6ddccd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:11.353709 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 995/1982] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:24:11 2022] DELETE /identity/v3/projects/88a1e781f8954783821c64d0d4aa6e15 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:11.357445 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b35a7-f239-46ec-9d55-b8ddad6ddccd admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:11.358814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-5d9b35a7-f239-46ec-9d55-b8ddad6ddccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:11.361052 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-43b6284e-7eeb-454c-98d0-720f9b174343 admin admin] The token cache is being invalidate because project 1471c0e9f5634a4795b30849a893d23d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:24:11.361341 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-43b6284e-7eeb-454c-98d0-720f9b174343 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:11.362020 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-43b6284e-7eeb-454c-98d0-720f9b174343 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:11.363643 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 988/1983] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:24:11 2022] DELETE /identity/v3/projects/1471c0e9f5634a4795b30849a893d23d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:11.368088 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddb37b-af99-440c-baf5-42f3f442225d None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:11.368376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddb37b-af99-440c-baf5-42f3f442225d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:11.368656 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddb37b-af99-440c-baf5-42f3f442225d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:11.386476 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-ceddb37b-af99-440c-baf5-42f3f442225d None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:11.387670 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ceddb37b-af99-440c-baf5-42f3f442225d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:11.413559 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:11.427585 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b35a7-f239-46ec-9d55-b8ddad6ddccd admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:11.455425 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 989/1984] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:24:11.464473 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3b6f6-28f9-4f67-bd39-a3bf6762d14e None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:11.464771 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3b6f6-28f9-4f67-bd39-a3bf6762d14e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:11.465078 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3b6f6-28f9-4f67-bd39-a3bf6762d14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:11.489051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-f3e3b6f6-28f9-4f67-bd39-a3bf6762d14e None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:11.490312 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f3e3b6f6-28f9-4f67-bd39-a3bf6762d14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:11.498406 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 990/1985] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:11.498856 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ffb13-0e75-4589-8706-70b123634c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:11.499844 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ffb13-0e75-4589-8706-70b123634c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:11.500134 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ffb13-0e75-4589-8706-70b123634c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:11.500413 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ffb13-0e75-4589-8706-70b123634c21 admin admin] PATH_INFO: `/v3/users/6e806ea9baa7482c8a409ea6cc2bf8e4` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:11.501724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ffb13-0e75-4589-8706-70b123634c21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e806ea9baa7482c8a409ea6cc2bf8e4)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:11.502486 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3b6f6-28f9-4f67-bd39-a3bf6762d14e None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:11.503698 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ffb13-0e75-4589-8706-70b123634c21 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:11.506656 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:11.511545 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3b6f6-28f9-4f67-bd39-a3bf6762d14e None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:11.517020 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ac159-a50b-4e81-9ed6-39819ebcd4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:11.517670 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ac159-a50b-4e81-9ed6-39819ebcd4be admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:11.517988 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ac159-a50b-4e81-9ed6-39819ebcd4be admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:11.518265 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ac159-a50b-4e81-9ed6-39819ebcd4be admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:11.518984 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ac159-a50b-4e81-9ed6-39819ebcd4be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:24:11.519353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ac159-a50b-4e81-9ed6-39819ebcd4be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:11.520974 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ac159-a50b-4e81-9ed6-39819ebcd4be admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:11.533568 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 991/1986] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:24:11.537956 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ac159-a50b-4e81-9ed6-39819ebcd4be admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:11.548013 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ac159-a50b-4e81-9ed6-39819ebcd4be admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:11.552930 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525df3c8-6c64-4335-813c-3139a9eb0bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:11.553588 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525df3c8-6c64-4335-813c-3139a9eb0bff admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:11.553900 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525df3c8-6c64-4335-813c-3139a9eb0bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:11.554202 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525df3c8-6c64-4335-813c-3139a9eb0bff admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:11.554324 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2b4ffb13-0e75-4589-8706-70b123634c21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e806ea9baa7482c8a409ea6cc2bf8e4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:11.554894 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525df3c8-6c64-4335-813c-3139a9eb0bff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:11.556773 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525df3c8-6c64-4335-813c-3139a9eb0bff admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:11.560891 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2b4ffb13-0e75-4589-8706-70b123634c21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e806ea9baa7482c8a409ea6cc2bf8e4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:11.561551 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2b4ffb13-0e75-4589-8706-70b123634c21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e806ea9baa7482c8a409ea6cc2bf8e4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:11.562206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2b4ffb13-0e75-4589-8706-70b123634c21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e806ea9baa7482c8a409ea6cc2bf8e4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:11.574736 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2b4ffb13-0e75-4589-8706-70b123634c21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e806ea9baa7482c8a409ea6cc2bf8e4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:11.586516 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 992/1987] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:24:11 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:24:11.587864 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 996/1988] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:24:11 2022] DELETE /identity/v3/users/6e806ea9baa7482c8a409ea6cc2bf8e4 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:11.591838 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525df3c8-6c64-4335-813c-3139a9eb0bff admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:11.594060 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-525df3c8-6c64-4335-813c-3139a9eb0bff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:11.667079 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525df3c8-6c64-4335-813c-3139a9eb0bff admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:11.726470 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316164f-bd76-4c73-92c8-7ea59d786b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:11.727144 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316164f-bd76-4c73-92c8-7ea59d786b8c admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:11.727427 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316164f-bd76-4c73-92c8-7ea59d786b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:11.727705 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316164f-bd76-4c73-92c8-7ea59d786b8c admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:11.728392 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316164f-bd76-4c73-92c8-7ea59d786b8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:11.730344 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316164f-bd76-4c73-92c8-7ea59d786b8c admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:11.753892 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 993/1989] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:24:11 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:24:11.757174 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ffb13-0e75-4589-8706-70b123634c21 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:11.769877 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ffb13-0e75-4589-8706-70b123634c21 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:11.775214 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b0d3d-cd2c-461f-80d5-a47a2b367690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:11.775992 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b0d3d-cd2c-461f-80d5-a47a2b367690 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:11.776365 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b0d3d-cd2c-461f-80d5-a47a2b367690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:11.776717 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b0d3d-cd2c-461f-80d5-a47a2b367690 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:11.777522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b0d3d-cd2c-461f-80d5-a47a2b367690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:11.779237 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b0d3d-cd2c-461f-80d5-a47a2b367690 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:11.789571 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 997/1990] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:11.793524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316164f-bd76-4c73-92c8-7ea59d786b8c admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:11.804170 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316164f-bd76-4c73-92c8-7ea59d786b8c admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:11.808694 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8754ef7-7826-4eba-806f-495b3f2713e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:11.809359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8754ef7-7826-4eba-806f-495b3f2713e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:11.809780 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8754ef7-7826-4eba-806f-495b3f2713e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:11.809959 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8754ef7-7826-4eba-806f-495b3f2713e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:11.810668 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8754ef7-7826-4eba-806f-495b3f2713e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:11.812811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8754ef7-7826-4eba-806f-495b3f2713e4 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:11.826447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 994/1991] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:11.828182 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b0d3d-cd2c-461f-80d5-a47a2b367690 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:11.838153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b0d3d-cd2c-461f-80d5-a47a2b367690 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:11.843483 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1219f-3ede-4be4-8e56-38ebcadca6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:11.844420 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1219f-3ede-4be4-8e56-38ebcadca6d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:11.844702 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1219f-3ede-4be4-8e56-38ebcadca6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:11.844974 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1219f-3ede-4be4-8e56-38ebcadca6d9 admin admin] PATH_INFO: `/v3/projects/bf504a9a88b6412db7c276ebdf8e5748/users/aaac0561fe794c8c80b1a4cfe678894d/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:11.860721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af1219f-3ede-4be4-8e56-38ebcadca6d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf504a9a88b6412db7c276ebdf8e5748, user_id=aaac0561fe794c8c80b1a4cfe678894d, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:11.863490 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af1219f-3ede-4be4-8e56-38ebcadca6d9 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:11.867811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8754ef7-7826-4eba-806f-495b3f2713e4 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:11.870021 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a8754ef7-7826-4eba-806f-495b3f2713e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:11.881046 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 998/1992] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:24:11 2022] PUT /identity/v3/projects/bf504a9a88b6412db7c276ebdf8e5748/users/aaac0561fe794c8c80b1a4cfe678894d/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:11.892295 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b4bbb-bb7c-411d-a626-708b3b240a46 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:11.892619 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b4bbb-bb7c-411d-a626-708b3b240a46 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:11.892860 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b4bbb-bb7c-411d-a626-708b3b240a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:11.898166 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8754ef7-7826-4eba-806f-495b3f2713e4 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:11.907463 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:11.927335 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f08b4bbb-bb7c-411d-a626-708b3b240a46 None None] MFA Rules not processed for user `aaac0561fe794c8c80b1a4cfe678894d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:11.929078 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f08b4bbb-bb7c-411d-a626-708b3b240a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:11.959965 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e793f5c-0c48-451a-96e8-d2c44309fc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:11.960834 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e793f5c-0c48-451a-96e8-d2c44309fc67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:11.961120 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e793f5c-0c48-451a-96e8-d2c44309fc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:11.961406 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e793f5c-0c48-451a-96e8-d2c44309fc67 admin admin] PATH_INFO: `/v3/projects/690381f53921485caea4b14cb0a3e117` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:11.962630 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e793f5c-0c48-451a-96e8-d2c44309fc67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=690381f53921485caea4b14cb0a3e117)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:11.964577 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e793f5c-0c48-451a-96e8-d2c44309fc67 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:11.994636 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 999/1993] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:12.006330 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b4bbb-bb7c-411d-a626-708b3b240a46 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:12.007705 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f08b4bbb-bb7c-411d-a626-708b3b240a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:12.017763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0e793f5c-0c48-451a-96e8-d2c44309fc67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '690381f53921485caea4b14cb0a3e117', 'request_id': 'req-0e793f5c-0c48-451a-96e8-d2c44309fc67'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:12.028112 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0e793f5c-0c48-451a-96e8-d2c44309fc67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '690381f53921485caea4b14cb0a3e117', 'request_id': 'req-0e793f5c-0c48-451a-96e8-d2c44309fc67'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:12.038408 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0e793f5c-0c48-451a-96e8-d2c44309fc67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '690381f53921485caea4b14cb0a3e117', 'request_id': 'req-0e793f5c-0c48-451a-96e8-d2c44309fc67'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:12.050888 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0e793f5c-0c48-451a-96e8-d2c44309fc67 admin admin] The token cache is being invalidate because project 690381f53921485caea4b14cb0a3e117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:24:12.051176 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0e793f5c-0c48-451a-96e8-d2c44309fc67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:12.051845 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0e793f5c-0c48-451a-96e8-d2c44309fc67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:12.053410 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 995/1994] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:24:11 2022] DELETE /identity/v3/projects/690381f53921485caea4b14cb0a3e117 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:24:12.057068 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:12.058236 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bda1b-69ce-4e81-8188-c311a816538e None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:12.058427 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bda1b-69ce-4e81-8188-c311a816538e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:12.058707 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bda1b-69ce-4e81-8188-c311a816538e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:12.078845 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-297bda1b-69ce-4e81-8188-c311a816538e None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:12.080100 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-297bda1b-69ce-4e81-8188-c311a816538e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:12.093161 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b4bbb-bb7c-411d-a626-708b3b240a46 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:12.147940 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 996/1995] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:24:12.152352 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d1c22-7e36-4131-bab4-bf6f13f45dc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:12.152999 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d1c22-7e36-4131-bab4-bf6f13f45dc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:12.153277 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d1c22-7e36-4131-bab4-bf6f13f45dc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:12.153549 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d1c22-7e36-4131-bab4-bf6f13f45dc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:12.155371 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5096751-b996-4bfa-8773-0e2b3d175837 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:12.155492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-186d1c22-7e36-4131-bab4-bf6f13f45dc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:12.155746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5096751-b996-4bfa-8773-0e2b3d175837 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:12.156036 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5096751-b996-4bfa-8773-0e2b3d175837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:12.174325 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-a5096751-b996-4bfa-8773-0e2b3d175837 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:12.175772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a5096751-b996-4bfa-8773-0e2b3d175837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:12.183913 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 997/1996] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:24:12.188356 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5096751-b996-4bfa-8773-0e2b3d175837 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:12.197371 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5096751-b996-4bfa-8773-0e2b3d175837 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:12.202886 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dace0a8-ce18-4017-9ec5-730e5f37229c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:12.203539 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dace0a8-ce18-4017-9ec5-730e5f37229c admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:12.203816 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dace0a8-ce18-4017-9ec5-730e5f37229c admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:12.204086 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dace0a8-ce18-4017-9ec5-730e5f37229c admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:12.204845 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dace0a8-ce18-4017-9ec5-730e5f37229c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:24:12.205193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dace0a8-ce18-4017-9ec5-730e5f37229c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:12.206822 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dace0a8-ce18-4017-9ec5-730e5f37229c admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:12.216198 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d1c22-7e36-4131-bab4-bf6f13f45dc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:12.218498 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d1c22-7e36-4131-bab4-bf6f13f45dc2 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:12.219179 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 998/1997] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:24:12.223143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dace0a8-ce18-4017-9ec5-730e5f37229c admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:12.228253 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1000/1998] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:24:12.232890 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dace0a8-ce18-4017-9ec5-730e5f37229c admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:12.237895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05d262-4b49-436b-aae7-35591dbf457f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:12.239230 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05d262-4b49-436b-aae7-35591dbf457f admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:12.239526 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05d262-4b49-436b-aae7-35591dbf457f admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:12.239914 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05d262-4b49-436b-aae7-35591dbf457f admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:12.240642 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05d262-4b49-436b-aae7-35591dbf457f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:12.247085 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05d262-4b49-436b-aae7-35591dbf457f admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:12.271682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 999/1999] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:24:12 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:24:12.276497 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d1c22-7e36-4131-bab4-bf6f13f45dc2 service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:12.287992 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d1c22-7e36-4131-bab4-bf6f13f45dc2 service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:12.361048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec7182-1f54-4360-8bc7-4f985801e538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:12.361760 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec7182-1f54-4360-8bc7-4f985801e538 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:12.362080 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec7182-1f54-4360-8bc7-4f985801e538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:12.362353 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec7182-1f54-4360-8bc7-4f985801e538 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:12.363045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec7182-1f54-4360-8bc7-4f985801e538 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:12.364989 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec7182-1f54-4360-8bc7-4f985801e538 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:12.391663 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1001/2000] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:24:12 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:24:12.395905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05d262-4b49-436b-aae7-35591dbf457f admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:12.401902 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:12.410168 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05d262-4b49-436b-aae7-35591dbf457f admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:12.416746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5865b6a-6664-4d70-ac08-da2b2e14cae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:12.417397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5865b6a-6664-4d70-ac08-da2b2e14cae3 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:12.418083 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5865b6a-6664-4d70-ac08-da2b2e14cae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:12.418383 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5865b6a-6664-4d70-ac08-da2b2e14cae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:12.419114 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5865b6a-6664-4d70-ac08-da2b2e14cae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:12.420713 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5865b6a-6664-4d70-ac08-da2b2e14cae3 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:12.431768 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1000/2001] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:24:12.435791 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec7182-1f54-4360-8bc7-4f985801e538 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:12.448268 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec7182-1f54-4360-8bc7-4f985801e538 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:12.455447 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204b808-ff86-47dd-adb5-e4c3799581f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:12.456264 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204b808-ff86-47dd-adb5-e4c3799581f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:12.456566 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204b808-ff86-47dd-adb5-e4c3799581f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:12.457755 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204b808-ff86-47dd-adb5-e4c3799581f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:12.458057 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204b808-ff86-47dd-adb5-e4c3799581f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:12.459995 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204b808-ff86-47dd-adb5-e4c3799581f6 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:12.477947 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1002/2002] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:12.482674 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5865b6a-6664-4d70-ac08-da2b2e14cae3 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:12.514518 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5865b6a-6664-4d70-ac08-da2b2e14cae3 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:12.525891 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89beef08-1c7b-4d93-8cc7-c418311d49ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:12.527013 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89beef08-1c7b-4d93-8cc7-c418311d49ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:12.527299 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89beef08-1c7b-4d93-8cc7-c418311d49ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:12.527644 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89beef08-1c7b-4d93-8cc7-c418311d49ec admin admin] PATH_INFO: `/v3/projects/a107386c081847d4b006ab93bde01972/users/7f382fc33bde495cb138d5ef9573d339/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:12.545916 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89beef08-1c7b-4d93-8cc7-c418311d49ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=a107386c081847d4b006ab93bde01972, user_id=7f382fc33bde495cb138d5ef9573d339, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:12.549447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89beef08-1c7b-4d93-8cc7-c418311d49ec admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:12.567740 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1001/2003] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:24:12 2022] PUT /identity/v3/projects/a107386c081847d4b006ab93bde01972/users/7f382fc33bde495cb138d5ef9573d339/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:24:12.579133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcce7c-3990-4401-a196-cfd8bd7af6a3 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:12.580027 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcce7c-3990-4401-a196-cfd8bd7af6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:12.580027 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcce7c-3990-4401-a196-cfd8bd7af6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:12.606210 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-08bcce7c-3990-4401-a196-cfd8bd7af6a3 None None] MFA Rules not processed for user `7f382fc33bde495cb138d5ef9573d339`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:12.607364 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-08bcce7c-3990-4401-a196-cfd8bd7af6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:12.619370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:12.673443 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1003/2004] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:12.678197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89beef08-1c7b-4d93-8cc7-c418311d49ec admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:12.738413 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89beef08-1c7b-4d93-8cc7-c418311d49ec admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:12.743014 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a583614-b4f3-410d-a98b-8d34c759915c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:12.743662 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a583614-b4f3-410d-a98b-8d34c759915c admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:12.743945 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a583614-b4f3-410d-a98b-8d34c759915c admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:12.744223 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a583614-b4f3-410d-a98b-8d34c759915c admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:12.744908 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a583614-b4f3-410d-a98b-8d34c759915c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:12.746833 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a583614-b4f3-410d-a98b-8d34c759915c admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:12.772228 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1002/2005] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:24:12 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:24:12.776162 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bcce7c-3990-4401-a196-cfd8bd7af6a3 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:12.786618 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bcce7c-3990-4401-a196-cfd8bd7af6a3 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:12.843991 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213e961-576b-4623-bbe7-5376b16380c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:12.844661 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213e961-576b-4623-bbe7-5376b16380c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:12.844939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213e961-576b-4623-bbe7-5376b16380c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:12.845211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213e961-576b-4623-bbe7-5376b16380c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:12.845966 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213e961-576b-4623-bbe7-5376b16380c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:12.847878 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213e961-576b-4623-bbe7-5376b16380c1 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:12.869542 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1004/2006] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:24:12 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:24:12.873490 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a583614-b4f3-410d-a98b-8d34c759915c admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:12.884447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a583614-b4f3-410d-a98b-8d34c759915c admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:12.889126 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553f9ca-f7cb-4fad-8fbb-35e386a1975a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:12.889786 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553f9ca-f7cb-4fad-8fbb-35e386a1975a admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:12.890105 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553f9ca-f7cb-4fad-8fbb-35e386a1975a admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:12.890383 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553f9ca-f7cb-4fad-8fbb-35e386a1975a admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:12.891138 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553f9ca-f7cb-4fad-8fbb-35e386a1975a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:12.892746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553f9ca-f7cb-4fad-8fbb-35e386a1975a admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:12.903745 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1003/2007] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:12.907769 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213e961-576b-4623-bbe7-5376b16380c1 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:12.918812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213e961-576b-4623-bbe7-5376b16380c1 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:12.930011 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd43bd-e94e-4e15-8e35-f4b814360dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:12.930629 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd43bd-e94e-4e15-8e35-f4b814360dbd admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:12.930915 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd43bd-e94e-4e15-8e35-f4b814360dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:12.931196 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd43bd-e94e-4e15-8e35-f4b814360dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:12.931963 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd43bd-e94e-4e15-8e35-f4b814360dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:12.933621 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd43bd-e94e-4e15-8e35-f4b814360dbd admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:12.945647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1005/2008] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:12.950042 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553f9ca-f7cb-4fad-8fbb-35e386a1975a admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:12.961585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553f9ca-f7cb-4fad-8fbb-35e386a1975a admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:12.967313 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6809ebf-87f6-4855-91fb-ef960d0440fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:12.968293 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6809ebf-87f6-4855-91fb-ef960d0440fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:12.968581 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6809ebf-87f6-4855-91fb-ef960d0440fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:12.968854 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6809ebf-87f6-4855-91fb-ef960d0440fb admin admin] PATH_INFO: `/v3/projects/3ad1339850a745f084c256cdb1c1ccf5/users/b4b38cab251c4c579e8232fd2e348a91/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:12.984955 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6809ebf-87f6-4855-91fb-ef960d0440fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ad1339850a745f084c256cdb1c1ccf5, user_id=b4b38cab251c4c579e8232fd2e348a91, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:12.988077 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6809ebf-87f6-4855-91fb-ef960d0440fb admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:13.001673 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1004/2009] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:24:12 2022] PUT /identity/v3/projects/3ad1339850a745f084c256cdb1c1ccf5/users/b4b38cab251c4c579e8232fd2e348a91/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:24:13.011994 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0b200-d4aa-4a0b-8089-0b685b85319a None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:13.012291 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0b200-d4aa-4a0b-8089-0b685b85319a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:13.012574 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0b200-d4aa-4a0b-8089-0b685b85319a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:13.039746 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-43c0b200-d4aa-4a0b-8089-0b685b85319a None None] MFA Rules not processed for user `b4b38cab251c4c579e8232fd2e348a91`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:13.040953 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-43c0b200-d4aa-4a0b-8089-0b685b85319a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:13.103759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1006/2010] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:13.108823 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6809ebf-87f6-4855-91fb-ef960d0440fb admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:13.172163 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6809ebf-87f6-4855-91fb-ef960d0440fb admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:13.177230 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880eaf3-79da-43ed-b96d-d2b69f450071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:13.177927 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880eaf3-79da-43ed-b96d-d2b69f450071 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:13.178284 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880eaf3-79da-43ed-b96d-d2b69f450071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:13.178566 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880eaf3-79da-43ed-b96d-d2b69f450071 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:13.179288 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880eaf3-79da-43ed-b96d-d2b69f450071 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:13.181219 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880eaf3-79da-43ed-b96d-d2b69f450071 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:13.213285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1005/2011] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:24:13 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:24:13.218582 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0b200-d4aa-4a0b-8089-0b685b85319a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:13.230326 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0b200-d4aa-4a0b-8089-0b685b85319a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:13.250649 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:13.301072 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabb3e4-1b7d-4f2f-9848-83e8e576233b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:13.301907 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabb3e4-1b7d-4f2f-9848-83e8e576233b admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:13.302362 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabb3e4-1b7d-4f2f-9848-83e8e576233b admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:13.302643 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabb3e4-1b7d-4f2f-9848-83e8e576233b admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:13.303358 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabb3e4-1b7d-4f2f-9848-83e8e576233b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:13.305513 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabb3e4-1b7d-4f2f-9848-83e8e576233b admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:13.329868 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1007/2012] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:24:13 2022] POST /identity/v3/users => generated 299 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:24:13.331636 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880eaf3-79da-43ed-b96d-d2b69f450071 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:13.337924 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:13.344427 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880eaf3-79da-43ed-b96d-d2b69f450071 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:13.351089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5da8a3-1e07-4437-b216-16e207484922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:13.351865 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5da8a3-1e07-4437-b216-16e207484922 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:13.352224 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5da8a3-1e07-4437-b216-16e207484922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:13.352578 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5da8a3-1e07-4437-b216-16e207484922 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:13.353311 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5da8a3-1e07-4437-b216-16e207484922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:13.354966 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5da8a3-1e07-4437-b216-16e207484922 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:13.368250 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1006/2013] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:13.373028 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabb3e4-1b7d-4f2f-9848-83e8e576233b admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:13.391065 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabb3e4-1b7d-4f2f-9848-83e8e576233b admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:13.395867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7d5f8-4003-4a90-b73a-98434cbd9363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:13.396767 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7d5f8-4003-4a90-b73a-98434cbd9363 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:13.397056 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7d5f8-4003-4a90-b73a-98434cbd9363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:13.397363 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7d5f8-4003-4a90-b73a-98434cbd9363 admin admin] PATH_INFO: `/v3/projects/8ea33cfa796141acb48ccda17feb7785/users/90499a3f35d2446f84da4589ad10c6d5/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:13.412679 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7d5f8-4003-4a90-b73a-98434cbd9363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ea33cfa796141acb48ccda17feb7785, user_id=90499a3f35d2446f84da4589ad10c6d5, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:13.415396 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7d5f8-4003-4a90-b73a-98434cbd9363 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:13.429020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1008/2014] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:24:13 2022] PUT /identity/v3/projects/8ea33cfa796141acb48ccda17feb7785/users/90499a3f35d2446f84da4589ad10c6d5/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:13.433162 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5da8a3-1e07-4437-b216-16e207484922 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:13.444439 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5da8a3-1e07-4437-b216-16e207484922 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:13.504628 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6300a9b-2dd8-461c-bf40-4796cff7e139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:13.505508 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6300a9b-2dd8-461c-bf40-4796cff7e139 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:13.506023 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6300a9b-2dd8-461c-bf40-4796cff7e139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:13.506323 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6300a9b-2dd8-461c-bf40-4796cff7e139 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:13.507146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6300a9b-2dd8-461c-bf40-4796cff7e139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:13.509016 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6300a9b-2dd8-461c-bf40-4796cff7e139 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:13.523845 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1007/2015] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:13.524942 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7d5f8-4003-4a90-b73a-98434cbd9363 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:13.537402 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7d5f8-4003-4a90-b73a-98434cbd9363 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:13.542282 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b4e88-4433-4eda-8c8d-bfc5a88934aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:13.543174 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b4e88-4433-4eda-8c8d-bfc5a88934aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:13.543457 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b4e88-4433-4eda-8c8d-bfc5a88934aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:13.543760 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b4e88-4433-4eda-8c8d-bfc5a88934aa admin admin] PATH_INFO: `/v3/projects/8ea33cfa796141acb48ccda17feb7785/users/90499a3f35d2446f84da4589ad10c6d5/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:13.545810 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b4e88-4433-4eda-8c8d-bfc5a88934aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ea33cfa796141acb48ccda17feb7785, user_id=90499a3f35d2446f84da4589ad10c6d5, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:13.549335 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b4e88-4433-4eda-8c8d-bfc5a88934aa admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:13.560839 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1009/2016] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:24:13 2022] PUT /identity/v3/projects/8ea33cfa796141acb48ccda17feb7785/users/90499a3f35d2446f84da4589ad10c6d5/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:13.577864 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81381a6e-a290-4efd-8d32-2581dfd44b08 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:13.578093 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81381a6e-a290-4efd-8d32-2581dfd44b08 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:13.578361 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81381a6e-a290-4efd-8d32-2581dfd44b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:13.674244 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-81381a6e-a290-4efd-8d32-2581dfd44b08 None None] MFA Rules not processed for user `90499a3f35d2446f84da4589ad10c6d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:13.675737 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-81381a6e-a290-4efd-8d32-2581dfd44b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:13.782103 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1008/2017] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:13.834612 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b4e88-4433-4eda-8c8d-bfc5a88934aa admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:13.836601 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3e4b4e88-4433-4eda-8c8d-bfc5a88934aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:13.924996 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b4e88-4433-4eda-8c8d-bfc5a88934aa admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:13.929715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec01c3-6801-4aa3-a143-a9f29d6531a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:13.930412 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec01c3-6801-4aa3-a143-a9f29d6531a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:13.930910 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec01c3-6801-4aa3-a143-a9f29d6531a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:13.931098 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec01c3-6801-4aa3-a143-a9f29d6531a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:13.946217 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec01c3-6801-4aa3-a143-a9f29d6531a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:13.947668 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec01c3-6801-4aa3-a143-a9f29d6531a6 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:13.959204 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1010/2018] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:24:14.426327 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81381a6e-a290-4efd-8d32-2581dfd44b08 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:14.427791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-81381a6e-a290-4efd-8d32-2581dfd44b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:14.518297 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81381a6e-a290-4efd-8d32-2581dfd44b08 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:14.527835 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662c005-61c2-4171-a186-608995b4a888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:14.530117 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662c005-61c2-4171-a186-608995b4a888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:14.530952 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662c005-61c2-4171-a186-608995b4a888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:14.531233 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662c005-61c2-4171-a186-608995b4a888 admin admin] PATH_INFO: `/v3/users/b46472924ac34e86a9f3d0a61a34d36c` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:14.532649 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662c005-61c2-4171-a186-608995b4a888 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b46472924ac34e86a9f3d0a61a34d36c)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:14.534936 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662c005-61c2-4171-a186-608995b4a888 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:14.557128 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:14.611484 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1662c005-61c2-4171-a186-608995b4a888 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b46472924ac34e86a9f3d0a61a34d36c'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:14.620306 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1662c005-61c2-4171-a186-608995b4a888 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b46472924ac34e86a9f3d0a61a34d36c'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:14.621088 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1662c005-61c2-4171-a186-608995b4a888 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b46472924ac34e86a9f3d0a61a34d36c'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:14.651362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1662c005-61c2-4171-a186-608995b4a888 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b46472924ac34e86a9f3d0a61a34d36c'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:14.654457 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1662c005-61c2-4171-a186-608995b4a888 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b46472924ac34e86a9f3d0a61a34d36c'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:14.672708 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1009/2019] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:24:14 2022] DELETE /identity/v3/users/b46472924ac34e86a9f3d0a61a34d36c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:14.681815 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33403b9-c721-4a6f-b2a2-dd4af966f1b3 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:14.681815 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33403b9-c721-4a6f-b2a2-dd4af966f1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:14.681815 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33403b9-c721-4a6f-b2a2-dd4af966f1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:14.701187 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-d33403b9-c721-4a6f-b2a2-dd4af966f1b3 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:14.702724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d33403b9-c721-4a6f-b2a2-dd4af966f1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:14.742766 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662c005-61c2-4171-a186-608995b4a888 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:14.744191 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1662c005-61c2-4171-a186-608995b4a888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:14.772120 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1011/2020] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:14.783004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33403b9-c721-4a6f-b2a2-dd4af966f1b3 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:14.784571 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d33403b9-c721-4a6f-b2a2-dd4af966f1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:14.805610 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662c005-61c2-4171-a186-608995b4a888 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:14.808396 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:14.810059 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a821b20-7576-427e-b564-04e32162db9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:14.810880 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a821b20-7576-427e-b564-04e32162db9f service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:14.811339 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a821b20-7576-427e-b564-04e32162db9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:14.811796 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a821b20-7576-427e-b564-04e32162db9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:14.813725 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4a821b20-7576-427e-b564-04e32162db9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:14.849063 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33403b9-c721-4a6f-b2a2-dd4af966f1b3 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:14.853572 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86d090-db5d-4a45-b057-92fd0f207c7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:14.854273 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86d090-db5d-4a45-b057-92fd0f207c7b service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:14.854569 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86d090-db5d-4a45-b057-92fd0f207c7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:14.854915 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86d090-db5d-4a45-b057-92fd0f207c7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:14.865476 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86d090-db5d-4a45-b057-92fd0f207c7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:14.866952 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86d090-db5d-4a45-b057-92fd0f207c7b service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:14.876726 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a821b20-7576-427e-b564-04e32162db9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:14.877082 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1012/2021] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:24:14.878200 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a821b20-7576-427e-b564-04e32162db9f service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:14.887305 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1010/2022] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:24:15.167200 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86d090-db5d-4a45-b057-92fd0f207c7b service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:15.168639 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-da86d090-db5d-4a45-b057-92fd0f207c7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:15.176757 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a821b20-7576-427e-b564-04e32162db9f service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:15.178242 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4a821b20-7576-427e-b564-04e32162db9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:15.195690 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86d090-db5d-4a45-b057-92fd0f207c7b service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:15.199334 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a821b20-7576-427e-b564-04e32162db9f service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:15.200735 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f10ca-9348-4da1-a48a-67167f5c7003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:15.201724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f10ca-9348-4da1-a48a-67167f5c7003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:15.202884 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f10ca-9348-4da1-a48a-67167f5c7003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:15.202884 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f10ca-9348-4da1-a48a-67167f5c7003 admin admin] PATH_INFO: `/v3/users/bbc53d692224444cae7b590a0bc7b6aa` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:15.206451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a88775-ba25-4f2f-b4a0-dd02fa1cbc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:15.207948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a88775-ba25-4f2f-b4a0-dd02fa1cbc2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:15.208421 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a88775-ba25-4f2f-b4a0-dd02fa1cbc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:15.208894 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a88775-ba25-4f2f-b4a0-dd02fa1cbc2d admin admin] PATH_INFO: `/v3/projects/ccf2b16f618e4d95bedc73e825dc4cb8` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:15.210265 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a88775-ba25-4f2f-b4a0-dd02fa1cbc2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccf2b16f618e4d95bedc73e825dc4cb8)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:15.210784 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f10ca-9348-4da1-a48a-67167f5c7003 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbc53d692224444cae7b590a0bc7b6aa)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:15.212704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a88775-ba25-4f2f-b4a0-dd02fa1cbc2d admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:15.213268 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f10ca-9348-4da1-a48a-67167f5c7003 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:15.282545 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:15.288140 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c91f10ca-9348-4da1-a48a-67167f5c7003 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbc53d692224444cae7b590a0bc7b6aa'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:15.291687 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f6a88775-ba25-4f2f-b4a0-dd02fa1cbc2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccf2b16f618e4d95bedc73e825dc4cb8', 'request_id': 'req-f6a88775-ba25-4f2f-b4a0-dd02fa1cbc2d'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:15.295450 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c91f10ca-9348-4da1-a48a-67167f5c7003 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbc53d692224444cae7b590a0bc7b6aa'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:15.296352 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c91f10ca-9348-4da1-a48a-67167f5c7003 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbc53d692224444cae7b590a0bc7b6aa'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:15.297155 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c91f10ca-9348-4da1-a48a-67167f5c7003 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbc53d692224444cae7b590a0bc7b6aa'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:15.300148 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f6a88775-ba25-4f2f-b4a0-dd02fa1cbc2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccf2b16f618e4d95bedc73e825dc4cb8', 'request_id': 'req-f6a88775-ba25-4f2f-b4a0-dd02fa1cbc2d'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:15.308136 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f6a88775-ba25-4f2f-b4a0-dd02fa1cbc2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccf2b16f618e4d95bedc73e825dc4cb8', 'request_id': 'req-f6a88775-ba25-4f2f-b4a0-dd02fa1cbc2d'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:15.310309 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c91f10ca-9348-4da1-a48a-67167f5c7003 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbc53d692224444cae7b590a0bc7b6aa'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:15.319481 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f6a88775-ba25-4f2f-b4a0-dd02fa1cbc2d admin admin] The token cache is being invalidate because project ccf2b16f618e4d95bedc73e825dc4cb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:24:15.319769 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f6a88775-ba25-4f2f-b4a0-dd02fa1cbc2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:15.320398 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f6a88775-ba25-4f2f-b4a0-dd02fa1cbc2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:15.321981 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1011/2023] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:24:15 2022] DELETE /identity/v3/projects/ccf2b16f618e4d95bedc73e825dc4cb8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:15.323634 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1013/2024] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:24:15 2022] DELETE /identity/v3/users/bbc53d692224444cae7b590a0bc7b6aa => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:15.326695 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b2aad-6584-4b41-abb4-546ecaebd86c None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:15.327006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b2aad-6584-4b41-abb4-546ecaebd86c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:15.327946 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b2aad-6584-4b41-abb4-546ecaebd86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:15.328871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec574d8-e09e-424a-aabd-2d86808493bd None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:15.329164 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec574d8-e09e-424a-aabd-2d86808493bd None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:15.329445 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec574d8-e09e-424a-aabd-2d86808493bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:15.347846 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-2ec574d8-e09e-424a-aabd-2d86808493bd None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:15.349861 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2ec574d8-e09e-424a-aabd-2d86808493bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:15.354840 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-2a7b2aad-6584-4b41-abb4-546ecaebd86c None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:15.356351 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2a7b2aad-6584-4b41-abb4-546ecaebd86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:15.423078 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1012/2025] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:15.424270 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1014/2026] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:24:15.431107 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb1e7b-cf95-48c4-b00d-8658344a3cf6 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:15.431626 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb1e7b-cf95-48c4-b00d-8658344a3cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:15.431727 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb1e7b-cf95-48c4-b00d-8658344a3cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:15.434266 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec574d8-e09e-424a-aabd-2d86808493bd None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:15.435665 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2ec574d8-e09e-424a-aabd-2d86808493bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:15.450688 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-43bb1e7b-cf95-48c4-b00d-8658344a3cf6 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:15.451898 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-43bb1e7b-cf95-48c4-b00d-8658344a3cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:15.460093 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1013/2027] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:24:15.464842 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb1e7b-cf95-48c4-b00d-8658344a3cf6 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:15.474619 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb1e7b-cf95-48c4-b00d-8658344a3cf6 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:15.477371 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:15.479620 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6f24f-70b8-408c-a854-df730576188b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:15.480473 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6f24f-70b8-408c-a854-df730576188b admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:15.480918 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6f24f-70b8-408c-a854-df730576188b admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:15.481342 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6f24f-70b8-408c-a854-df730576188b admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:15.482269 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c6f24f-70b8-408c-a854-df730576188b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:24:15.482763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c6f24f-70b8-408c-a854-df730576188b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:15.484954 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c6f24f-70b8-408c-a854-df730576188b admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:15.498393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1014/2028] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:24:15.506446 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6f24f-70b8-408c-a854-df730576188b admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:15.511287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec574d8-e09e-424a-aabd-2d86808493bd None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:15.515429 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913c8dc-6e7c-4c8a-aadf-2e0df58d6280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:15.516089 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913c8dc-6e7c-4c8a-aadf-2e0df58d6280 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:15.516373 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913c8dc-6e7c-4c8a-aadf-2e0df58d6280 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:15.516649 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913c8dc-6e7c-4c8a-aadf-2e0df58d6280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:15.518111 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6f24f-70b8-408c-a854-df730576188b admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:15.524810 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad73687-f261-4222-a5cd-67cdecd0c82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:15.525557 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad73687-f261-4222-a5cd-67cdecd0c82f admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:15.525858 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad73687-f261-4222-a5cd-67cdecd0c82f admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:15.526152 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad73687-f261-4222-a5cd-67cdecd0c82f admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:15.526852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad73687-f261-4222-a5cd-67cdecd0c82f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:15.528852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad73687-f261-4222-a5cd-67cdecd0c82f admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:15.530709 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4913c8dc-6e7c-4c8a-aadf-2e0df58d6280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:15.532304 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4913c8dc-6e7c-4c8a-aadf-2e0df58d6280 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:15.544359 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1015/2029] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:24:15.575545 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1015/2030] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:24:15 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:24:15.579783 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913c8dc-6e7c-4c8a-aadf-2e0df58d6280 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:15.591433 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913c8dc-6e7c-4c8a-aadf-2e0df58d6280 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:15.662153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013441cb-953d-46a1-8b6c-cbc8e84cc470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:15.662842 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013441cb-953d-46a1-8b6c-cbc8e84cc470 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:15.663127 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013441cb-953d-46a1-8b6c-cbc8e84cc470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:15.663405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013441cb-953d-46a1-8b6c-cbc8e84cc470 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:15.664098 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013441cb-953d-46a1-8b6c-cbc8e84cc470 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:15.666208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013441cb-953d-46a1-8b6c-cbc8e84cc470 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:15.694978 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1016/2031] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:24:15 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:24:15.701807 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad73687-f261-4222-a5cd-67cdecd0c82f admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:15.702047 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013441cb-953d-46a1-8b6c-cbc8e84cc470 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:15.704467 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-013441cb-953d-46a1-8b6c-cbc8e84cc470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:15.715171 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad73687-f261-4222-a5cd-67cdecd0c82f admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:15.723302 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c8d76-1e46-4977-aea7-1f4789ea513b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:15.724996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c8d76-1e46-4977-aea7-1f4789ea513b admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:15.725132 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013441cb-953d-46a1-8b6c-cbc8e84cc470 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:15.725681 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c8d76-1e46-4977-aea7-1f4789ea513b admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:15.726202 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c8d76-1e46-4977-aea7-1f4789ea513b admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:15.727498 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c8d76-1e46-4977-aea7-1f4789ea513b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:15.729378 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c8d76-1e46-4977-aea7-1f4789ea513b admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:15.731133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45754f6a-af41-4b0c-a1bd-bcb9cfbdecd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:15.732181 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45754f6a-af41-4b0c-a1bd-bcb9cfbdecd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:15.732604 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45754f6a-af41-4b0c-a1bd-bcb9cfbdecd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:15.733030 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45754f6a-af41-4b0c-a1bd-bcb9cfbdecd8 admin admin] PATH_INFO: `/v3/users/aaac0561fe794c8c80b1a4cfe678894d` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:15.740620 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45754f6a-af41-4b0c-a1bd-bcb9cfbdecd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaac0561fe794c8c80b1a4cfe678894d)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:15.742687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45754f6a-af41-4b0c-a1bd-bcb9cfbdecd8 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:15.743190 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1016/2032] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:15.746869 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c8d76-1e46-4977-aea7-1f4789ea513b admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:15.757890 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c8d76-1e46-4977-aea7-1f4789ea513b admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:15.764935 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548f4e6-01b7-47d3-b593-68c60f515da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:15.766187 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548f4e6-01b7-47d3-b593-68c60f515da2 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:15.766718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548f4e6-01b7-47d3-b593-68c60f515da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:15.767544 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548f4e6-01b7-47d3-b593-68c60f515da2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:15.768519 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548f4e6-01b7-47d3-b593-68c60f515da2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:15.770969 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548f4e6-01b7-47d3-b593-68c60f515da2 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:15.784178 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1017/2033] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:24:15.788136 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548f4e6-01b7-47d3-b593-68c60f515da2 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:15.800192 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548f4e6-01b7-47d3-b593-68c60f515da2 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:15.801177 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-45754f6a-af41-4b0c-a1bd-bcb9cfbdecd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaac0561fe794c8c80b1a4cfe678894d'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:15.806637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6696e86-c28a-41e9-b6fb-6b023723c2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:15.808302 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6696e86-c28a-41e9-b6fb-6b023723c2fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:15.808741 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6696e86-c28a-41e9-b6fb-6b023723c2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:15.809024 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6696e86-c28a-41e9-b6fb-6b023723c2fc admin admin] PATH_INFO: `/v3/projects/1cc798a91bd74226a144199bd78c2331/users/0c58a96bc78b4fa3a643125a6140bb00/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:15.809278 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-45754f6a-af41-4b0c-a1bd-bcb9cfbdecd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaac0561fe794c8c80b1a4cfe678894d'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:15.810134 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-45754f6a-af41-4b0c-a1bd-bcb9cfbdecd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaac0561fe794c8c80b1a4cfe678894d'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:15.811616 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-45754f6a-af41-4b0c-a1bd-bcb9cfbdecd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaac0561fe794c8c80b1a4cfe678894d'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:15.824479 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6696e86-c28a-41e9-b6fb-6b023723c2fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc798a91bd74226a144199bd78c2331, user_id=0c58a96bc78b4fa3a643125a6140bb00, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:15.827820 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6696e86-c28a-41e9-b6fb-6b023723c2fc admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:15.843827 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-45754f6a-af41-4b0c-a1bd-bcb9cfbdecd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaac0561fe794c8c80b1a4cfe678894d'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:15.862719 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1018/2034] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:24:15 2022] PUT /identity/v3/projects/1cc798a91bd74226a144199bd78c2331/users/0c58a96bc78b4fa3a643125a6140bb00/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:15.863276 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1017/2035] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:24:15 2022] DELETE /identity/v3/users/aaac0561fe794c8c80b1a4cfe678894d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:24:15.865171 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7718c-f38a-4778-8def-0e25bda5f283 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:15.865579 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7718c-f38a-4778-8def-0e25bda5f283 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:15.865960 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7718c-f38a-4778-8def-0e25bda5f283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:15.867861 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b188f4-e499-4931-8231-6d874537b524 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:15.868161 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b188f4-e499-4931-8231-6d874537b524 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:15.868434 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b188f4-e499-4931-8231-6d874537b524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:15.885530 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-5bc7718c-f38a-4778-8def-0e25bda5f283 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:15.886887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-5bc7718c-f38a-4778-8def-0e25bda5f283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:15.887704 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-63b188f4-e499-4931-8231-6d874537b524 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:15.888966 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-63b188f4-e499-4931-8231-6d874537b524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:15.934672 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:15.941183 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:15.973748 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1019/2036] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:15.985718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7718c-f38a-4778-8def-0e25bda5f283 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:15.988881 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1018/2037] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:15.989064 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-5bc7718c-f38a-4778-8def-0e25bda5f283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:15.992889 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b188f4-e499-4931-8231-6d874537b524 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:15.994500 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-63b188f4-e499-4931-8231-6d874537b524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:16.009084 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b188f4-e499-4931-8231-6d874537b524 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:16.021216 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd57904-5bd7-4675-9163-b14d516b6914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:16.021899 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd57904-5bd7-4675-9163-b14d516b6914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:16.022190 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd57904-5bd7-4675-9163-b14d516b6914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:16.022470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd57904-5bd7-4675-9163-b14d516b6914 admin admin] PATH_INFO: `/v3/projects/3ccadd8aee574a1e936eb328227d1520` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:16.023700 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd57904-5bd7-4675-9163-b14d516b6914 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ccadd8aee574a1e936eb328227d1520)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:16.025650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd57904-5bd7-4675-9163-b14d516b6914 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:16.071396 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7718c-f38a-4778-8def-0e25bda5f283 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:16.080491 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-3fd57904-5bd7-4675-9163-b14d516b6914 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ccadd8aee574a1e936eb328227d1520', 'request_id': 'req-3fd57904-5bd7-4675-9163-b14d516b6914'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:16.087063 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-3fd57904-5bd7-4675-9163-b14d516b6914 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ccadd8aee574a1e936eb328227d1520', 'request_id': 'req-3fd57904-5bd7-4675-9163-b14d516b6914'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:16.097256 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-3fd57904-5bd7-4675-9163-b14d516b6914 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ccadd8aee574a1e936eb328227d1520', 'request_id': 'req-3fd57904-5bd7-4675-9163-b14d516b6914'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:16.112331 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-3fd57904-5bd7-4675-9163-b14d516b6914 admin admin] The token cache is being invalidate because project 3ccadd8aee574a1e936eb328227d1520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:24:16.112619 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-3fd57904-5bd7-4675-9163-b14d516b6914 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:16.113282 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-3fd57904-5bd7-4675-9163-b14d516b6914 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:16.114970 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1019/2038] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:24:15 2022] DELETE /identity/v3/projects/3ccadd8aee574a1e936eb328227d1520 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:16.115742 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd57904-5bd7-4675-9163-b14d516b6914 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:16.117083 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3fd57904-5bd7-4675-9163-b14d516b6914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:16.130567 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d999b9-5b48-49f1-a1c8-e33d9b624294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:16.131220 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d999b9-5b48-49f1-a1c8-e33d9b624294 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:16.131502 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d999b9-5b48-49f1-a1c8-e33d9b624294 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:16.131780 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d999b9-5b48-49f1-a1c8-e33d9b624294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:16.133602 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-97d999b9-5b48-49f1-a1c8-e33d9b624294 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:16.177626 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd57904-5bd7-4675-9163-b14d516b6914 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:16.181359 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc74a8d-4a4a-4edb-9be5-9e43de5ce883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:16.182048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc74a8d-4a4a-4edb-9be5-9e43de5ce883 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:16.182338 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc74a8d-4a4a-4edb-9be5-9e43de5ce883 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:16.182602 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc74a8d-4a4a-4edb-9be5-9e43de5ce883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:16.185352 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-7bc74a8d-4a4a-4edb-9be5-9e43de5ce883 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:16.206093 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d999b9-5b48-49f1-a1c8-e33d9b624294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:16.207620 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d999b9-5b48-49f1-a1c8-e33d9b624294 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:16.219095 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1020/2039] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:24:16.220400 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c38294-b832-458e-850d-c31f4b92c918 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:16.220687 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c38294-b832-458e-850d-c31f4b92c918 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:16.220960 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c38294-b832-458e-850d-c31f4b92c918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:16.251147 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-f0c38294-b832-458e-850d-c31f4b92c918 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:16.253855 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f0c38294-b832-458e-850d-c31f4b92c918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:16.265579 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1021/2040] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:16.266497 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc74a8d-4a4a-4edb-9be5-9e43de5ce883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:16.268076 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc74a8d-4a4a-4edb-9be5-9e43de5ce883 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:16.274315 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c51c9-a73f-487b-bffb-c13f7e598d59 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:16.274606 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c51c9-a73f-487b-bffb-c13f7e598d59 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:16.275029 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c51c9-a73f-487b-bffb-c13f7e598d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:16.281290 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1020/2041] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:24:16.299688 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-e19c51c9-a73f-487b-bffb-c13f7e598d59 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:16.301714 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e19c51c9-a73f-487b-bffb-c13f7e598d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:16.311000 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1022/2042] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:16.314753 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc74a8d-4a4a-4edb-9be5-9e43de5ce883 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:16.324896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc74a8d-4a4a-4edb-9be5-9e43de5ce883 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:16.330439 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36d7e5-50a7-4111-8748-2c640ab09208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:16.331522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36d7e5-50a7-4111-8748-2c640ab09208 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:16.331904 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36d7e5-50a7-4111-8748-2c640ab09208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:16.332252 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36d7e5-50a7-4111-8748-2c640ab09208 admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:16.333159 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36d7e5-50a7-4111-8748-2c640ab09208 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:24:16.333461 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36d7e5-50a7-4111-8748-2c640ab09208 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:16.335877 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36d7e5-50a7-4111-8748-2c640ab09208 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:16.350330 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:16.361407 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1021/2043] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:24:16.366503 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c51c9-a73f-487b-bffb-c13f7e598d59 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:16.381458 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c51c9-a73f-487b-bffb-c13f7e598d59 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:16.391023 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616033d5-fa23-4d71-92c7-c62c212f92aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:16.391700 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616033d5-fa23-4d71-92c7-c62c212f92aa admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:16.391991 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616033d5-fa23-4d71-92c7-c62c212f92aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:16.392271 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616033d5-fa23-4d71-92c7-c62c212f92aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:16.392979 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616033d5-fa23-4d71-92c7-c62c212f92aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:16.395089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616033d5-fa23-4d71-92c7-c62c212f92aa admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:16.427110 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1023/2044] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:24:16 2022] POST /identity/v3/projects => generated 361 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:24:16.432160 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36d7e5-50a7-4111-8748-2c640ab09208 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:16.445152 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36d7e5-50a7-4111-8748-2c640ab09208 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:16.520427 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04edb8-6154-4b45-9459-240b2a869dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:16.521237 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04edb8-6154-4b45-9459-240b2a869dfe admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:16.521527 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04edb8-6154-4b45-9459-240b2a869dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:16.521954 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04edb8-6154-4b45-9459-240b2a869dfe admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:16.522673 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04edb8-6154-4b45-9459-240b2a869dfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:16.524813 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04edb8-6154-4b45-9459-240b2a869dfe admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:16.555882 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1022/2045] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:24:16 2022] POST /identity/v3/users => generated 281 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:24:16.557410 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616033d5-fa23-4d71-92c7-c62c212f92aa admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:16.568165 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616033d5-fa23-4d71-92c7-c62c212f92aa admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:16.573485 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f334080-694f-48fc-9d75-01539238c8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:16.574354 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f334080-694f-48fc-9d75-01539238c8ff admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:16.575091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f334080-694f-48fc-9d75-01539238c8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:16.575091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f334080-694f-48fc-9d75-01539238c8ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:16.575637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f334080-694f-48fc-9d75-01539238c8ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:16.577971 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f334080-694f-48fc-9d75-01539238c8ff admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:16.591984 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1024/2046] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:16.596755 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04edb8-6154-4b45-9459-240b2a869dfe admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:16.612195 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04edb8-6154-4b45-9459-240b2a869dfe admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:16.618524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d67d8-453e-4e26-8ad3-b346dd7d4e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:16.619315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d67d8-453e-4e26-8ad3-b346dd7d4e90 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:16.619887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d67d8-453e-4e26-8ad3-b346dd7d4e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:16.620258 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d67d8-453e-4e26-8ad3-b346dd7d4e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:16.621197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d67d8-453e-4e26-8ad3-b346dd7d4e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:16.622943 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d67d8-453e-4e26-8ad3-b346dd7d4e90 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:16.635268 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1023/2047] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:16.640530 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f334080-694f-48fc-9d75-01539238c8ff admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:16.645751 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:16.652622 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f334080-694f-48fc-9d75-01539238c8ff admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:16.659868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf744f-5c66-44a9-ab45-c8adf4144ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:16.660952 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf744f-5c66-44a9-ab45-c8adf4144ab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:16.661497 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf744f-5c66-44a9-ab45-c8adf4144ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:16.662222 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf744f-5c66-44a9-ab45-c8adf4144ab9 admin admin] PATH_INFO: `/v3/projects/6e4c6f51b9524fc4acb60376e23003f6/users/9f78d90cc02a4269a9c5aa6cd65ecf36/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:16.679991 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf744f-5c66-44a9-ab45-c8adf4144ab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e4c6f51b9524fc4acb60376e23003f6, user_id=9f78d90cc02a4269a9c5aa6cd65ecf36, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:16.683494 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf744f-5c66-44a9-ab45-c8adf4144ab9 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:16.700424 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d67d8-453e-4e26-8ad3-b346dd7d4e90 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:16.703879 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c67d67d8-453e-4e26-8ad3-b346dd7d4e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:16.708291 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1025/2048] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:24:16 2022] PUT /identity/v3/projects/6e4c6f51b9524fc4acb60376e23003f6/users/9f78d90cc02a4269a9c5aa6cd65ecf36/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:24:16.719491 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d67d8-453e-4e26-8ad3-b346dd7d4e90 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:16.720333 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5609d-6b5b-46e7-aa6e-c011019c83c0 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:16.720626 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5609d-6b5b-46e7-aa6e-c011019c83c0 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:16.720929 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5609d-6b5b-46e7-aa6e-c011019c83c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:16.772851 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-82a5609d-6b5b-46e7-aa6e-c011019c83c0 None None] MFA Rules not processed for user `9f78d90cc02a4269a9c5aa6cd65ecf36`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:16.775055 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-82a5609d-6b5b-46e7-aa6e-c011019c83c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:16.833545 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c5297-1304-427f-b48e-146bf7c5c280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:16.834941 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c5297-1304-427f-b48e-146bf7c5c280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:16.835220 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c5297-1304-427f-b48e-146bf7c5c280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:16.835495 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c5297-1304-427f-b48e-146bf7c5c280 admin admin] PATH_INFO: `/v3/projects/bf504a9a88b6412db7c276ebdf8e5748` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:16.836858 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c5297-1304-427f-b48e-146bf7c5c280 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf504a9a88b6412db7c276ebdf8e5748)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:16.839142 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c5297-1304-427f-b48e-146bf7c5c280 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:16.882429 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1026/2049] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:24:16.906224 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b32c5297-1304-427f-b48e-146bf7c5c280 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf504a9a88b6412db7c276ebdf8e5748', 'request_id': 'req-b32c5297-1304-427f-b48e-146bf7c5c280'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:16.918859 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b32c5297-1304-427f-b48e-146bf7c5c280 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf504a9a88b6412db7c276ebdf8e5748', 'request_id': 'req-b32c5297-1304-427f-b48e-146bf7c5c280'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:16.923016 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5609d-6b5b-46e7-aa6e-c011019c83c0 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:16.928929 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-82a5609d-6b5b-46e7-aa6e-c011019c83c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:16.933323 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b32c5297-1304-427f-b48e-146bf7c5c280 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf504a9a88b6412db7c276ebdf8e5748', 'request_id': 'req-b32c5297-1304-427f-b48e-146bf7c5c280'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:16.949490 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b32c5297-1304-427f-b48e-146bf7c5c280 admin admin] The token cache is being invalidate because project bf504a9a88b6412db7c276ebdf8e5748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:24:16.950523 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b32c5297-1304-427f-b48e-146bf7c5c280 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:16.951480 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b32c5297-1304-427f-b48e-146bf7c5c280 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:16.958078 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1024/2050] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:24:16 2022] DELETE /identity/v3/projects/bf504a9a88b6412db7c276ebdf8e5748 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:24:16.960146 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb7e3b-d58b-40ba-ae55-8f31c9aa1b5d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:16.960430 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb7e3b-d58b-40ba-ae55-8f31c9aa1b5d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:16.960716 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb7e3b-d58b-40ba-ae55-8f31c9aa1b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:16.976609 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:16.982871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f5fb7e3b-d58b-40ba-ae55-8f31c9aa1b5d None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:16.985580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f5fb7e3b-d58b-40ba-ae55-8f31c9aa1b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:17.016980 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5609d-6b5b-46e7-aa6e-c011019c83c0 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:17.063647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1025/2051] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:24:17.071960 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fbb55-cf40-4c34-bfc4-ce876d904387 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:17.072280 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fbb55-cf40-4c34-bfc4-ce876d904387 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:17.072563 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fbb55-cf40-4c34-bfc4-ce876d904387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:17.088554 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1acaa8-7d27-4de1-9d46-6d0ef44e122f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:17.089346 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1acaa8-7d27-4de1-9d46-6d0ef44e122f service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:17.089636 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1acaa8-7d27-4de1-9d46-6d0ef44e122f service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:17.089959 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1acaa8-7d27-4de1-9d46-6d0ef44e122f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:17.092524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1e1acaa8-7d27-4de1-9d46-6d0ef44e122f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:17.093122 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-661fbb55-cf40-4c34-bfc4-ce876d904387 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:17.094465 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-661fbb55-cf40-4c34-bfc4-ce876d904387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:17.103283 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1026/2052] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:24:17.107514 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fbb55-cf40-4c34-bfc4-ce876d904387 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:17.116946 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fbb55-cf40-4c34-bfc4-ce876d904387 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:17.122379 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2572022-ffcd-495e-b244-bb3ce55259b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:17.123030 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2572022-ffcd-495e-b244-bb3ce55259b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:17.123312 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2572022-ffcd-495e-b244-bb3ce55259b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:17.124564 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2572022-ffcd-495e-b244-bb3ce55259b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:17.124968 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2572022-ffcd-495e-b244-bb3ce55259b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:24:17.125270 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2572022-ffcd-495e-b244-bb3ce55259b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:17.126908 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2572022-ffcd-495e-b244-bb3ce55259b3 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:17.138313 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:17.145897 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1027/2053] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:24:17.146391 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2572022-ffcd-495e-b244-bb3ce55259b3 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:17.159842 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2572022-ffcd-495e-b244-bb3ce55259b3 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:17.166743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86b7f6-9c1e-4748-885e-7a7eeabf8354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:17.167918 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86b7f6-9c1e-4748-885e-7a7eeabf8354 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:17.168230 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86b7f6-9c1e-4748-885e-7a7eeabf8354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:17.168507 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86b7f6-9c1e-4748-885e-7a7eeabf8354 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:17.169577 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86b7f6-9c1e-4748-885e-7a7eeabf8354 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:17.169817 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1acaa8-7d27-4de1-9d46-6d0ef44e122f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:17.171321 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1acaa8-7d27-4de1-9d46-6d0ef44e122f service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:17.171717 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86b7f6-9c1e-4748-885e-7a7eeabf8354 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:17.181102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1027/2054] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:24:17.196500 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1acaa8-7d27-4de1-9d46-6d0ef44e122f service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:17.198198 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1e1acaa8-7d27-4de1-9d46-6d0ef44e122f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:17.214634 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1028/2055] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:24:17 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:24:17.217450 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1acaa8-7d27-4de1-9d46-6d0ef44e122f service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:17.221524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86b7f6-9c1e-4748-885e-7a7eeabf8354 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:17.305795 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86b7f6-9c1e-4748-885e-7a7eeabf8354 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:17.309804 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44a6d4-37b4-4359-8270-72bcb28704d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:17.310730 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44a6d4-37b4-4359-8270-72bcb28704d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:17.312127 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b472b2-0d5b-415f-9a07-44c425531e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:17.313043 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b472b2-0d5b-415f-9a07-44c425531e9b admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:17.313393 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b472b2-0d5b-415f-9a07-44c425531e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:17.313883 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b472b2-0d5b-415f-9a07-44c425531e9b admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:17.315183 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b472b2-0d5b-415f-9a07-44c425531e9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:17.317224 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b472b2-0d5b-415f-9a07-44c425531e9b admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:17.318243 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44a6d4-37b4-4359-8270-72bcb28704d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:17.318843 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44a6d4-37b4-4359-8270-72bcb28704d7 admin admin] PATH_INFO: `/v3/users/9f78d90cc02a4269a9c5aa6cd65ecf36` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:17.323613 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44a6d4-37b4-4359-8270-72bcb28704d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f78d90cc02a4269a9c5aa6cd65ecf36)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:17.335367 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44a6d4-37b4-4359-8270-72bcb28704d7 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:17.358801 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1029/2056] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:24:17 2022] POST /identity/v3/users => generated 286 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:24:17.363858 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b472b2-0d5b-415f-9a07-44c425531e9b admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:17.384580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b472b2-0d5b-415f-9a07-44c425531e9b admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:17.390367 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43414948-fe1c-498b-b20a-f835f7b0fcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:17.391039 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43414948-fe1c-498b-b20a-f835f7b0fcd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:17.391912 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43414948-fe1c-498b-b20a-f835f7b0fcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:17.391912 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43414948-fe1c-498b-b20a-f835f7b0fcd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:17.392353 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43414948-fe1c-498b-b20a-f835f7b0fcd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:17.394158 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43414948-fe1c-498b-b20a-f835f7b0fcd9 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:17.405864 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1030/2057] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:17.410158 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43414948-fe1c-498b-b20a-f835f7b0fcd9 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:17.420361 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43414948-fe1c-498b-b20a-f835f7b0fcd9 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:17.424009 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-7f44a6d4-37b4-4359-8270-72bcb28704d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f78d90cc02a4269a9c5aa6cd65ecf36'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:17.426531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff551e49-cd54-4597-bb7b-0bca9b0d03e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:17.427388 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff551e49-cd54-4597-bb7b-0bca9b0d03e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:17.427904 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff551e49-cd54-4597-bb7b-0bca9b0d03e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:17.428245 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff551e49-cd54-4597-bb7b-0bca9b0d03e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:17.429030 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff551e49-cd54-4597-bb7b-0bca9b0d03e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:17.430737 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff551e49-cd54-4597-bb7b-0bca9b0d03e0 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:17.435523 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-7f44a6d4-37b4-4359-8270-72bcb28704d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f78d90cc02a4269a9c5aa6cd65ecf36'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:17.437116 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-7f44a6d4-37b4-4359-8270-72bcb28704d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f78d90cc02a4269a9c5aa6cd65ecf36'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:17.443178 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1031/2058] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:17.446947 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff551e49-cd54-4597-bb7b-0bca9b0d03e0 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:17.457039 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff551e49-cd54-4597-bb7b-0bca9b0d03e0 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:17.461868 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed1475-d1ff-4c08-8734-1b702079011a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:17.462079 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-7f44a6d4-37b4-4359-8270-72bcb28704d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f78d90cc02a4269a9c5aa6cd65ecf36'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:17.462751 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed1475-d1ff-4c08-8734-1b702079011a admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:17.462923 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-7f44a6d4-37b4-4359-8270-72bcb28704d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f78d90cc02a4269a9c5aa6cd65ecf36'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:17.463074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed1475-d1ff-4c08-8734-1b702079011a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:17.463349 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed1475-d1ff-4c08-8734-1b702079011a admin admin] PATH_INFO: `/v3/projects/7762253ada114ed099c07c426b32acea/users/73a7772df5d8472aa56d027874d9b2e3/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:17.482483 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed1475-d1ff-4c08-8734-1b702079011a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7762253ada114ed099c07c426b32acea, user_id=73a7772df5d8472aa56d027874d9b2e3, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:17.487655 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1028/2059] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:24:17 2022] DELETE /identity/v3/users/9f78d90cc02a4269a9c5aa6cd65ecf36 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:24:17.487827 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed1475-d1ff-4c08-8734-1b702079011a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:17.491193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8d422-cdb3-492c-b02c-8f7b25d5c3a3 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:17.491670 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8d422-cdb3-492c-b02c-8f7b25d5c3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:17.491930 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8d422-cdb3-492c-b02c-8f7b25d5c3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:17.501688 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1032/2060] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:24:17 2022] PUT /identity/v3/projects/7762253ada114ed099c07c426b32acea/users/73a7772df5d8472aa56d027874d9b2e3/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:17.513234 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f42af-e993-4bec-9341-dfe9650d9eb4 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:17.514883 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f42af-e993-4bec-9341-dfe9650d9eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:17.514998 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-ccc8d422-cdb3-492c-b02c-8f7b25d5c3a3 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:17.516826 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f42af-e993-4bec-9341-dfe9650d9eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:17.516954 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ccc8d422-cdb3-492c-b02c-8f7b25d5c3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:17.555411 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:17.574820 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-df8f42af-e993-4bec-9341-dfe9650d9eb4 None None] MFA Rules not processed for user `73a7772df5d8472aa56d027874d9b2e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:17.576085 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-df8f42af-e993-4bec-9341-dfe9650d9eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:17.619701 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:17.642694 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1029/2061] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:17.651836 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8d422-cdb3-492c-b02c-8f7b25d5c3a3 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:17.653343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ccc8d422-cdb3-492c-b02c-8f7b25d5c3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:17.704256 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1033/2062] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:17.715727 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f42af-e993-4bec-9341-dfe9650d9eb4 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:17.718722 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-df8f42af-e993-4bec-9341-dfe9650d9eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:17.754620 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8d422-cdb3-492c-b02c-8f7b25d5c3a3 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:17.767683 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c068504-a7be-449e-80c1-5574d1c09b89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:17.770110 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c068504-a7be-449e-80c1-5574d1c09b89 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:17.770455 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c068504-a7be-449e-80c1-5574d1c09b89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:17.771293 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c068504-a7be-449e-80c1-5574d1c09b89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:17.785144 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c068504-a7be-449e-80c1-5574d1c09b89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:17.786634 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c068504-a7be-449e-80c1-5574d1c09b89 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:17.805346 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f42af-e993-4bec-9341-dfe9650d9eb4 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:17.812376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1030/2063] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:24:17.821109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eea217-3df0-48a3-afc1-94c49c4134ea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cd24a726e4e4ce687d150a3bdc5948f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:17.823096 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eea217-3df0-48a3-afc1-94c49c4134ea service glance] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:17.823394 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eea217-3df0-48a3-afc1-94c49c4134ea service glance] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:17.823673 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eea217-3df0-48a3-afc1-94c49c4134ea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:17.850489 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eea217-3df0-48a3-afc1-94c49c4134ea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:17.852079 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eea217-3df0-48a3-afc1-94c49c4134ea service glance] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:17.865815 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1034/2064] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:24:18.432487 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c068504-a7be-449e-80c1-5574d1c09b89 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:18.434093 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1c068504-a7be-449e-80c1-5574d1c09b89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:18.463663 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c068504-a7be-449e-80c1-5574d1c09b89 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:18.473219 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d43a8c-a4ee-47de-b3b1-70a375c3b12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:18.474812 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d43a8c-a4ee-47de-b3b1-70a375c3b12e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:18.475143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d43a8c-a4ee-47de-b3b1-70a375c3b12e admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:18.475399 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d43a8c-a4ee-47de-b3b1-70a375c3b12e admin admin] PATH_INFO: `/v3/projects/6e4c6f51b9524fc4acb60376e23003f6` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:18.487330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d43a8c-a4ee-47de-b3b1-70a375c3b12e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e4c6f51b9524fc4acb60376e23003f6)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:18.490017 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d43a8c-a4ee-47de-b3b1-70a375c3b12e admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:18.576467 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-66d43a8c-a4ee-47de-b3b1-70a375c3b12e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e4c6f51b9524fc4acb60376e23003f6', 'request_id': 'req-66d43a8c-a4ee-47de-b3b1-70a375c3b12e'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:18.584225 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-66d43a8c-a4ee-47de-b3b1-70a375c3b12e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e4c6f51b9524fc4acb60376e23003f6', 'request_id': 'req-66d43a8c-a4ee-47de-b3b1-70a375c3b12e'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:18.602687 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-66d43a8c-a4ee-47de-b3b1-70a375c3b12e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e4c6f51b9524fc4acb60376e23003f6', 'request_id': 'req-66d43a8c-a4ee-47de-b3b1-70a375c3b12e'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:18.629312 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-66d43a8c-a4ee-47de-b3b1-70a375c3b12e admin admin] The token cache is being invalidate because project 6e4c6f51b9524fc4acb60376e23003f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:24:18.630207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-66d43a8c-a4ee-47de-b3b1-70a375c3b12e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:18.631037 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-66d43a8c-a4ee-47de-b3b1-70a375c3b12e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:18.632925 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1031/2065] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:24:18 2022] DELETE /identity/v3/projects/6e4c6f51b9524fc4acb60376e23003f6 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:18.640243 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b4fb5-313b-411d-a5da-8b80f841e779 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:18.640622 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b4fb5-313b-411d-a5da-8b80f841e779 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:18.640806 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b4fb5-313b-411d-a5da-8b80f841e779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:18.705221 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-c17b4fb5-313b-411d-a5da-8b80f841e779 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:18.706598 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c17b4fb5-313b-411d-a5da-8b80f841e779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:18.803485 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1035/2066] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:18.805864 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8124f24-78c3-4f7f-bd3b-3ea05eaaf526 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:18.806792 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8124f24-78c3-4f7f-bd3b-3ea05eaaf526 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:18.807244 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8124f24-78c3-4f7f-bd3b-3ea05eaaf526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:18.829421 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-a8124f24-78c3-4f7f-bd3b-3ea05eaaf526 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:18.830731 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a8124f24-78c3-4f7f-bd3b-3ea05eaaf526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:18.841926 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1032/2067] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:18.843264 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b4fb5-313b-411d-a5da-8b80f841e779 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:18.853604 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b4fb5-313b-411d-a5da-8b80f841e779 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:18.861476 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95f7f6-25e4-4539-a046-ae0c813fb9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:18.862213 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95f7f6-25e4-4539-a046-ae0c813fb9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:18.862498 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95f7f6-25e4-4539-a046-ae0c813fb9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:18.862773 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95f7f6-25e4-4539-a046-ae0c813fb9b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:18.863503 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c95f7f6-25e4-4539-a046-ae0c813fb9b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:24:18.863807 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c95f7f6-25e4-4539-a046-ae0c813fb9b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:18.865857 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c95f7f6-25e4-4539-a046-ae0c813fb9b0 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:18.879879 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1036/2068] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:24:18.884045 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8124f24-78c3-4f7f-bd3b-3ea05eaaf526 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:18.894409 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8124f24-78c3-4f7f-bd3b-3ea05eaaf526 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:18.900037 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67f7a2-fc49-4e23-abc9-b74a29fdb6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:18.900795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67f7a2-fc49-4e23-abc9-b74a29fdb6e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:18.901082 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67f7a2-fc49-4e23-abc9-b74a29fdb6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:18.901359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67f7a2-fc49-4e23-abc9-b74a29fdb6e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:18.902111 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67f7a2-fc49-4e23-abc9-b74a29fdb6e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:18.904738 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67f7a2-fc49-4e23-abc9-b74a29fdb6e9 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:18.953069 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1033/2069] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:24:18 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:24:18.954238 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95f7f6-25e4-4539-a046-ae0c813fb9b0 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:18.973713 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95f7f6-25e4-4539-a046-ae0c813fb9b0 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:19.020714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:19.072359 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f14d6-bdcc-4e5a-924d-a3febecd3004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:19.073144 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f14d6-bdcc-4e5a-924d-a3febecd3004 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:19.073507 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f14d6-bdcc-4e5a-924d-a3febecd3004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:19.073806 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f14d6-bdcc-4e5a-924d-a3febecd3004 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:19.074728 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f14d6-bdcc-4e5a-924d-a3febecd3004 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:19.077661 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f14d6-bdcc-4e5a-924d-a3febecd3004 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:19.102647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1037/2070] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:24:18 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:24:19.107538 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67f7a2-fc49-4e23-abc9-b74a29fdb6e9 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:19.126789 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67f7a2-fc49-4e23-abc9-b74a29fdb6e9 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:19.134915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f086c-2b24-4cb4-843b-fe77f227442f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:19.136303 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f086c-2b24-4cb4-843b-fe77f227442f admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:19.136597 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f086c-2b24-4cb4-843b-fe77f227442f admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:19.136878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f086c-2b24-4cb4-843b-fe77f227442f admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:19.137628 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f086c-2b24-4cb4-843b-fe77f227442f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:19.140738 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f086c-2b24-4cb4-843b-fe77f227442f admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:19.169643 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1034/2071] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:19.174320 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f14d6-bdcc-4e5a-924d-a3febecd3004 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:19.191561 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f086c-2b24-4cb4-843b-fe77f227442f admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:19.194193 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f14d6-bdcc-4e5a-924d-a3febecd3004 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:19.197186 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ee7f086c-2b24-4cb4-843b-fe77f227442f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:19.204883 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccaed09-79d3-4e79-aa95-d839c23cae6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:19.205663 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccaed09-79d3-4e79-aa95-d839c23cae6a admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:19.206076 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccaed09-79d3-4e79-aa95-d839c23cae6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:19.206275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccaed09-79d3-4e79-aa95-d839c23cae6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:19.207009 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccaed09-79d3-4e79-aa95-d839c23cae6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:19.213941 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccaed09-79d3-4e79-aa95-d839c23cae6a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:19.227648 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1038/2072] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:24:19.232072 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccaed09-79d3-4e79-aa95-d839c23cae6a admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:19.244995 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccaed09-79d3-4e79-aa95-d839c23cae6a admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:19.264252 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371e5bc-e939-4860-9bb9-1ea36c80e9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:19.265368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371e5bc-e939-4860-9bb9-1ea36c80e9ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:19.267424 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371e5bc-e939-4860-9bb9-1ea36c80e9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:19.267885 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371e5bc-e939-4860-9bb9-1ea36c80e9ee admin admin] PATH_INFO: `/v3/projects/6c443dd708b0443f8ca77d5b28529606/users/5d20468ac7b64f1f9f850e4eca3761d0/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:19.279939 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:19.296586 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371e5bc-e939-4860-9bb9-1ea36c80e9ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c443dd708b0443f8ca77d5b28529606, user_id=5d20468ac7b64f1f9f850e4eca3761d0, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:19.300575 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371e5bc-e939-4860-9bb9-1ea36c80e9ee admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:19.302181 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f086c-2b24-4cb4-843b-fe77f227442f admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:19.311711 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20733ec0-eae1-485e-bca7-12ab7046594a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:19.312428 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20733ec0-eae1-485e-bca7-12ab7046594a service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:19.312718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20733ec0-eae1-485e-bca7-12ab7046594a service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:19.312999 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20733ec0-eae1-485e-bca7-12ab7046594a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:19.315196 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-20733ec0-eae1-485e-bca7-12ab7046594a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:19.330024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1039/2073] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:24:19 2022] PUT /identity/v3/projects/6c443dd708b0443f8ca77d5b28529606/users/5d20468ac7b64f1f9f850e4eca3761d0/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:19.335705 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfe1b8-a74a-44c7-ab8b-e5f29f79cf32 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:19.335992 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfe1b8-a74a-44c7-ab8b-e5f29f79cf32 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:19.336268 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfe1b8-a74a-44c7-ab8b-e5f29f79cf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:19.356335 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-70dfe1b8-a74a-44c7-ab8b-e5f29f79cf32 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:19.357417 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-70dfe1b8-a74a-44c7-ab8b-e5f29f79cf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:19.432197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20733ec0-eae1-485e-bca7-12ab7046594a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:19.433968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20733ec0-eae1-485e-bca7-12ab7046594a service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:19.445941 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1035/2074] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:24:19.545028 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1040/2075] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:24:19.610541 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20733ec0-eae1-485e-bca7-12ab7046594a service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:19.612660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-20733ec0-eae1-485e-bca7-12ab7046594a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:19.817773 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20733ec0-eae1-485e-bca7-12ab7046594a service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:19.942654 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c90a8-fc4b-4538-8c71-93f9b1b58d91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:19.943215 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c90a8-fc4b-4538-8c71-93f9b1b58d91 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:19.943512 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c90a8-fc4b-4538-8c71-93f9b1b58d91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:19.943793 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c90a8-fc4b-4538-8c71-93f9b1b58d91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:19.974556 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c90a8-fc4b-4538-8c71-93f9b1b58d91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:19.976506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c90a8-fc4b-4538-8c71-93f9b1b58d91 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:19.997707 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1036/2076] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:24:21.558477 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c63f1f-3261-4321-8e66-f877d46ba24a None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:21.559034 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c63f1f-3261-4321-8e66-f877d46ba24a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:21.559034 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c63f1f-3261-4321-8e66-f877d46ba24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:21.591308 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-64c63f1f-3261-4321-8e66-f877d46ba24a None None] MFA Rules not processed for user `5d20468ac7b64f1f9f850e4eca3761d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:21.592730 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-64c63f1f-3261-4321-8e66-f877d46ba24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:21.737996 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1041/2077] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:21.750036 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c90a8-fc4b-4538-8c71-93f9b1b58d91 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:21.751556 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-438c90a8-fc4b-4538-8c71-93f9b1b58d91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:21.832007 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c90a8-fc4b-4538-8c71-93f9b1b58d91 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:21.843220 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c4950-ea8f-4cf5-a348-92afe086f5c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:21.844158 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c4950-ea8f-4cf5-a348-92afe086f5c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:21.844640 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c4950-ea8f-4cf5-a348-92afe086f5c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:21.845123 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c4950-ea8f-4cf5-a348-92afe086f5c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:21.855010 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c4950-ea8f-4cf5-a348-92afe086f5c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:21.856937 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c4950-ea8f-4cf5-a348-92afe086f5c5 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:21.864813 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:21.871541 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1037/2078] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:24:22.158961 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abb613-33cc-43d9-bbfa-12510b8bbcf0 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:22.159250 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abb613-33cc-43d9-bbfa-12510b8bbcf0 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:22.159529 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abb613-33cc-43d9-bbfa-12510b8bbcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:22.185919 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:22.197238 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-29abb613-33cc-43d9-bbfa-12510b8bbcf0 None None] MFA Rules not processed for user `0c58a96bc78b4fa3a643125a6140bb00`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:22.199795 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-29abb613-33cc-43d9-bbfa-12510b8bbcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:22.328802 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1042/2079] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:22.330415 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c4950-ea8f-4cf5-a348-92afe086f5c5 service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:22.332294 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-123c4950-ea8f-4cf5-a348-92afe086f5c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:22.367270 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c4950-ea8f-4cf5-a348-92afe086f5c5 service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:22.378526 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fecdf4-c48f-4011-8d04-fb3a66f15a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:22.378986 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fecdf4-c48f-4011-8d04-fb3a66f15a4e admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:22.379277 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fecdf4-c48f-4011-8d04-fb3a66f15a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:22.379558 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fecdf4-c48f-4011-8d04-fb3a66f15a4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:22.380257 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fecdf4-c48f-4011-8d04-fb3a66f15a4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:22.382205 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fecdf4-c48f-4011-8d04-fb3a66f15a4e admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:22.418692 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1038/2080] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:24:22 2022] POST /identity/v3/projects => generated 379 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:24:22.423173 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abb613-33cc-43d9-bbfa-12510b8bbcf0 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:22.446444 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fecdf4-c48f-4011-8d04-fb3a66f15a4e admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:22.446842 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abb613-33cc-43d9-bbfa-12510b8bbcf0 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:22.455595 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-95fecdf4-c48f-4011-8d04-fb3a66f15a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:22.551213 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fecdf4-c48f-4011-8d04-fb3a66f15a4e admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:22.557150 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547d535-0925-4d13-9ad5-97b7221a6718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:22.558308 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547d535-0925-4d13-9ad5-97b7221a6718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:22.558459 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547d535-0925-4d13-9ad5-97b7221a6718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:22.558746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547d535-0925-4d13-9ad5-97b7221a6718 admin admin] PATH_INFO: `/v3/users/7f382fc33bde495cb138d5ef9573d339` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:22.559399 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9f849-fc93-4ffa-a4e2-09521402c8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:22.560054 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547d535-0925-4d13-9ad5-97b7221a6718 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f382fc33bde495cb138d5ef9573d339)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:22.560732 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9f849-fc93-4ffa-a4e2-09521402c8fd admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:22.561239 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9f849-fc93-4ffa-a4e2-09521402c8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:22.561663 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9f849-fc93-4ffa-a4e2-09521402c8fd admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:22.562359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547d535-0925-4d13-9ad5-97b7221a6718 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:22.563039 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9f849-fc93-4ffa-a4e2-09521402c8fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:22.567543 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9f849-fc93-4ffa-a4e2-09521402c8fd admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:22.622358 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1043/2081] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:24:22 2022] POST /identity/v3/users => generated 296 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:24:22.622358 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9f849-fc93-4ffa-a4e2-09521402c8fd admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:22.646072 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9f849-fc93-4ffa-a4e2-09521402c8fd admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:22.650913 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1959e-f002-4693-97dd-172bfaf21f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:22.651587 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1959e-f002-4693-97dd-172bfaf21f5e admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:22.652515 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1959e-f002-4693-97dd-172bfaf21f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:22.652515 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1959e-f002-4693-97dd-172bfaf21f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:22.652856 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1959e-f002-4693-97dd-172bfaf21f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:22.654560 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1959e-f002-4693-97dd-172bfaf21f5e admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:22.662941 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4547d535-0925-4d13-9ad5-97b7221a6718 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f382fc33bde495cb138d5ef9573d339'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:22.669865 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1044/2082] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:24:22.672493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1959e-f002-4693-97dd-172bfaf21f5e admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:22.676812 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4547d535-0925-4d13-9ad5-97b7221a6718 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f382fc33bde495cb138d5ef9573d339'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:22.677583 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4547d535-0925-4d13-9ad5-97b7221a6718 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f382fc33bde495cb138d5ef9573d339'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:22.684286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1959e-f002-4693-97dd-172bfaf21f5e admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:22.690373 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e102b6-50ef-4258-adb7-a1c1bcb994e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:22.691510 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e102b6-50ef-4258-adb7-a1c1bcb994e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:22.691796 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e102b6-50ef-4258-adb7-a1c1bcb994e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:22.692076 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e102b6-50ef-4258-adb7-a1c1bcb994e3 admin admin] PATH_INFO: `/v3/projects/55fb1da014f74d59a0f46deaf02fa0f6/users/f54e6322e5d34cf3bd23ff5646d7f2e4/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:22.693904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4547d535-0925-4d13-9ad5-97b7221a6718 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f382fc33bde495cb138d5ef9573d339'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:22.694802 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4547d535-0925-4d13-9ad5-97b7221a6718 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f382fc33bde495cb138d5ef9573d339'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:22.708703 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1039/2083] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:24:22 2022] DELETE /identity/v3/users/7f382fc33bde495cb138d5ef9573d339 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:22.708908 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e102b6-50ef-4258-adb7-a1c1bcb994e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55fb1da014f74d59a0f46deaf02fa0f6, user_id=f54e6322e5d34cf3bd23ff5646d7f2e4, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:22.712125 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e102b6-50ef-4258-adb7-a1c1bcb994e3 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:22.712841 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb14d9-402d-4de1-9d58-5d1c1e9e2480 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:22.713134 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb14d9-402d-4de1-9d58-5d1c1e9e2480 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:22.713415 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb14d9-402d-4de1-9d58-5d1c1e9e2480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:22.726420 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1045/2084] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:24:22 2022] PUT /identity/v3/projects/55fb1da014f74d59a0f46deaf02fa0f6/users/f54e6322e5d34cf3bd23ff5646d7f2e4/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:22.730326 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e102b6-50ef-4258-adb7-a1c1bcb994e3 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:22.732155 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d5e102b6-50ef-4258-adb7-a1c1bcb994e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:22.735163 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-48cb14d9-402d-4de1-9d58-5d1c1e9e2480 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:22.736593 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-48cb14d9-402d-4de1-9d58-5d1c1e9e2480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:22.802843 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:22.806922 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:22.813656 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e102b6-50ef-4258-adb7-a1c1bcb994e3 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:22.821341 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1040/2085] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:24:22.822407 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9821108-91e9-4fcb-bc78-a4131dad7b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:22.823273 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9821108-91e9-4fcb-bc78-a4131dad7b07 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:22.823850 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9821108-91e9-4fcb-bc78-a4131dad7b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:22.824292 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9821108-91e9-4fcb-bc78-a4131dad7b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:22.825257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9821108-91e9-4fcb-bc78-a4131dad7b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:22.828445 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9821108-91e9-4fcb-bc78-a4131dad7b07 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:22.830355 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb14d9-402d-4de1-9d58-5d1c1e9e2480 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:22.831744 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-48cb14d9-402d-4de1-9d58-5d1c1e9e2480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:22.844464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1046/2086] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:24:22.848540 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9821108-91e9-4fcb-bc78-a4131dad7b07 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:22.860142 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9821108-91e9-4fcb-bc78-a4131dad7b07 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:22.866334 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4329260-e4aa-4483-831d-f8a1fec71d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:22.867156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4329260-e4aa-4483-831d-f8a1fec71d36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:22.867390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4329260-e4aa-4483-831d-f8a1fec71d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:22.867663 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4329260-e4aa-4483-831d-f8a1fec71d36 admin admin] PATH_INFO: `/v3/projects/55fb1da014f74d59a0f46deaf02fa0f6/users/f54e6322e5d34cf3bd23ff5646d7f2e4/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:22.869846 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4329260-e4aa-4483-831d-f8a1fec71d36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55fb1da014f74d59a0f46deaf02fa0f6, user_id=f54e6322e5d34cf3bd23ff5646d7f2e4, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:22.872432 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4329260-e4aa-4483-831d-f8a1fec71d36 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:22.889895 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1047/2087] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:24:22 2022] PUT /identity/v3/projects/55fb1da014f74d59a0f46deaf02fa0f6/users/f54e6322e5d34cf3bd23ff5646d7f2e4/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:24:22.901363 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb14d9-402d-4de1-9d58-5d1c1e9e2480 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:22.972475 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bb621-6f79-46f0-b62a-7a281e7546d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:22.973103 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bb621-6f79-46f0-b62a-7a281e7546d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:22.973470 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bb621-6f79-46f0-b62a-7a281e7546d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:22.973713 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bb621-6f79-46f0-b62a-7a281e7546d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:23.053081 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21bb621-6f79-46f0-b62a-7a281e7546d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:23.054820 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21bb621-6f79-46f0-b62a-7a281e7546d3 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:23.070646 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1041/2088] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:24:23.534684 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4329260-e4aa-4483-831d-f8a1fec71d36 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:23.536916 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b4329260-e4aa-4483-831d-f8a1fec71d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:23.568828 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4329260-e4aa-4483-831d-f8a1fec71d36 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:23.579642 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963681c3-9626-466d-acd8-d658f6fbf67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:23.581030 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963681c3-9626-466d-acd8-d658f6fbf67e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:23.582027 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963681c3-9626-466d-acd8-d658f6fbf67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:23.582807 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963681c3-9626-466d-acd8-d658f6fbf67e admin admin] PATH_INFO: `/v3/projects/a107386c081847d4b006ab93bde01972` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:23.584849 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963681c3-9626-466d-acd8-d658f6fbf67e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a107386c081847d4b006ab93bde01972)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:23.587485 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963681c3-9626-466d-acd8-d658f6fbf67e admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:23.677674 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-963681c3-9626-466d-acd8-d658f6fbf67e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a107386c081847d4b006ab93bde01972', 'request_id': 'req-963681c3-9626-466d-acd8-d658f6fbf67e'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:23.696883 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141e04b-a62e-47df-8eaa-cd6c4e1ba57f None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:23.697204 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141e04b-a62e-47df-8eaa-cd6c4e1ba57f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:23.697506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141e04b-a62e-47df-8eaa-cd6c4e1ba57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:23.705071 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-963681c3-9626-466d-acd8-d658f6fbf67e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a107386c081847d4b006ab93bde01972', 'request_id': 'req-963681c3-9626-466d-acd8-d658f6fbf67e'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:23.720073 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-963681c3-9626-466d-acd8-d658f6fbf67e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a107386c081847d4b006ab93bde01972', 'request_id': 'req-963681c3-9626-466d-acd8-d658f6fbf67e'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:23.722737 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-1141e04b-a62e-47df-8eaa-cd6c4e1ba57f None None] MFA Rules not processed for user `5d20468ac7b64f1f9f850e4eca3761d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:23.724358 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1141e04b-a62e-47df-8eaa-cd6c4e1ba57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:23.741386 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-963681c3-9626-466d-acd8-d658f6fbf67e admin admin] The token cache is being invalidate because project a107386c081847d4b006ab93bde01972 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:24:23.741775 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-963681c3-9626-466d-acd8-d658f6fbf67e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:23.742728 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-963681c3-9626-466d-acd8-d658f6fbf67e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:23.748125 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1048/2089] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:24:23 2022] DELETE /identity/v3/projects/a107386c081847d4b006ab93bde01972 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:23.749463 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963681c3-9626-466d-acd8-d658f6fbf67e admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:23.751876 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-963681c3-9626-466d-acd8-d658f6fbf67e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:23.837528 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1042/2090] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:23.884115 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963681c3-9626-466d-acd8-d658f6fbf67e admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:23.896535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6c500-5fb9-4f09-ae54-9e02ce0b5e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:23.898276 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6c500-5fb9-4f09-ae54-9e02ce0b5e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:23.898623 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6c500-5fb9-4f09-ae54-9e02ce0b5e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:23.899832 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6c500-5fb9-4f09-ae54-9e02ce0b5e28 admin admin] PATH_INFO: `/v3/users/b4b38cab251c4c579e8232fd2e348a91` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:23.900544 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf6c500-5fb9-4f09-ae54-9e02ce0b5e28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4b38cab251c4c579e8232fd2e348a91)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:23.903447 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf6c500-5fb9-4f09-ae54-9e02ce0b5e28 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:23.991792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-ecf6c500-5fb9-4f09-ae54-9e02ce0b5e28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4b38cab251c4c579e8232fd2e348a91'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:23.999912 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-ecf6c500-5fb9-4f09-ae54-9e02ce0b5e28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4b38cab251c4c579e8232fd2e348a91'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:24.000520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-ecf6c500-5fb9-4f09-ae54-9e02ce0b5e28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4b38cab251c4c579e8232fd2e348a91'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:24.001318 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-ecf6c500-5fb9-4f09-ae54-9e02ce0b5e28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4b38cab251c4c579e8232fd2e348a91'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:24.014810 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=83,keystone:INSERT=2,keystone:DELETE=15 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:24.020932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-ecf6c500-5fb9-4f09-ae54-9e02ce0b5e28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4b38cab251c4c579e8232fd2e348a91'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:24.043905 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1049/2091] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:24:23 2022] DELETE /identity/v3/users/b4b38cab251c4c579e8232fd2e348a91 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:25.165056 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141e04b-a62e-47df-8eaa-cd6c4e1ba57f None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:25.181740 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141e04b-a62e-47df-8eaa-cd6c4e1ba57f None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:25.189508 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:25.289353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c956c26-b557-4803-8657-3c4d265f004d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:25.290280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c956c26-b557-4803-8657-3c4d265f004d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:25.290570 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c956c26-b557-4803-8657-3c4d265f004d admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:25.290901 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c956c26-b557-4803-8657-3c4d265f004d admin admin] PATH_INFO: `/v3/projects/3ad1339850a745f084c256cdb1c1ccf5` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:25.293606 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c956c26-b557-4803-8657-3c4d265f004d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ad1339850a745f084c256cdb1c1ccf5)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:25.296449 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c956c26-b557-4803-8657-3c4d265f004d admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:25.417495 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1c956c26-b557-4803-8657-3c4d265f004d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ad1339850a745f084c256cdb1c1ccf5', 'request_id': 'req-1c956c26-b557-4803-8657-3c4d265f004d'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:25.427953 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1c956c26-b557-4803-8657-3c4d265f004d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ad1339850a745f084c256cdb1c1ccf5', 'request_id': 'req-1c956c26-b557-4803-8657-3c4d265f004d'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:25.449856 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1c956c26-b557-4803-8657-3c4d265f004d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ad1339850a745f084c256cdb1c1ccf5', 'request_id': 'req-1c956c26-b557-4803-8657-3c4d265f004d'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:25.484655 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1c956c26-b557-4803-8657-3c4d265f004d admin admin] The token cache is being invalidate because project 3ad1339850a745f084c256cdb1c1ccf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:24:25.484956 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1c956c26-b557-4803-8657-3c4d265f004d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:25.487277 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1c956c26-b557-4803-8657-3c4d265f004d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:25.489791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1043/2092] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:24:25 2022] DELETE /identity/v3/projects/3ad1339850a745f084c256cdb1c1ccf5 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:25.493801 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6c500-5fb9-4f09-ae54-9e02ce0b5e28 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:25.495399 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ecf6c500-5fb9-4f09-ae54-9e02ce0b5e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:25.512292 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6c500-5fb9-4f09-ae54-9e02ce0b5e28 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:25.626491 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7326c-0802-4786-aa46-b589f14d982d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:25.628181 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7326c-0802-4786-aa46-b589f14d982d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:25.628508 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7326c-0802-4786-aa46-b589f14d982d admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:25.628889 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7326c-0802-4786-aa46-b589f14d982d admin admin] PATH_INFO: `/v3/users/90499a3f35d2446f84da4589ad10c6d5` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:25.630472 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7326c-0802-4786-aa46-b589f14d982d admin admin] RBAC: Authorizing `identity:delete_user(user_id=90499a3f35d2446f84da4589ad10c6d5)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:25.633591 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7326c-0802-4786-aa46-b589f14d982d admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:25.728358 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-28a7326c-0802-4786-aa46-b589f14d982d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90499a3f35d2446f84da4589ad10c6d5'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:25.755723 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-28a7326c-0802-4786-aa46-b589f14d982d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90499a3f35d2446f84da4589ad10c6d5'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:25.756913 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-28a7326c-0802-4786-aa46-b589f14d982d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90499a3f35d2446f84da4589ad10c6d5'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:25.757855 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-28a7326c-0802-4786-aa46-b589f14d982d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90499a3f35d2446f84da4589ad10c6d5'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:25.777306 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-28a7326c-0802-4786-aa46-b589f14d982d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90499a3f35d2446f84da4589ad10c6d5'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:25.814896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1050/2093] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:24:25 2022] DELETE /identity/v3/users/90499a3f35d2446f84da4589ad10c6d5 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:26.574187 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c956c26-b557-4803-8657-3c4d265f004d admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:26.576321 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1c956c26-b557-4803-8657-3c4d265f004d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:26.599005 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c956c26-b557-4803-8657-3c4d265f004d admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:26.748951 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd489f-81fa-4951-b051-fc1d8489bac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:26.749992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd489f-81fa-4951-b051-fc1d8489bac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:26.750930 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd489f-81fa-4951-b051-fc1d8489bac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:26.751190 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd489f-81fa-4951-b051-fc1d8489bac3 admin admin] PATH_INFO: `/v3/projects/8ea33cfa796141acb48ccda17feb7785` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:26.753154 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd489f-81fa-4951-b051-fc1d8489bac3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ea33cfa796141acb48ccda17feb7785)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:26.755619 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd489f-81fa-4951-b051-fc1d8489bac3 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:26.849782 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:26.863959 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-53cd489f-81fa-4951-b051-fc1d8489bac3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ea33cfa796141acb48ccda17feb7785', 'request_id': 'req-53cd489f-81fa-4951-b051-fc1d8489bac3'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:26.876281 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-53cd489f-81fa-4951-b051-fc1d8489bac3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ea33cfa796141acb48ccda17feb7785', 'request_id': 'req-53cd489f-81fa-4951-b051-fc1d8489bac3'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:26.891528 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-53cd489f-81fa-4951-b051-fc1d8489bac3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ea33cfa796141acb48ccda17feb7785', 'request_id': 'req-53cd489f-81fa-4951-b051-fc1d8489bac3'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:26.923313 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-53cd489f-81fa-4951-b051-fc1d8489bac3 admin admin] The token cache is being invalidate because project 8ea33cfa796141acb48ccda17feb7785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:24:26.923808 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-53cd489f-81fa-4951-b051-fc1d8489bac3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:26.927184 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-53cd489f-81fa-4951-b051-fc1d8489bac3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:26.929407 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1044/2094] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:24:26 2022] DELETE /identity/v3/projects/8ea33cfa796141acb48ccda17feb7785 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:26.935354 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d2fbe-07a7-46af-a826-64b736542b10 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:26.935840 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d2fbe-07a7-46af-a826-64b736542b10 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:26.936218 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d2fbe-07a7-46af-a826-64b736542b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:26.967909 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-9d0d2fbe-07a7-46af-a826-64b736542b10 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:26.969588 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9d0d2fbe-07a7-46af-a826-64b736542b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:27.124280 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1051/2095] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:27.134540 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227e2c0-7010-4f66-b09c-665c5eb9aab3 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:27.134903 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227e2c0-7010-4f66-b09c-665c5eb9aab3 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:27.135263 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227e2c0-7010-4f66-b09c-665c5eb9aab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:27.170486 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-b227e2c0-7010-4f66-b09c-665c5eb9aab3 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:27.172312 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-b227e2c0-7010-4f66-b09c-665c5eb9aab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:27.193057 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d2fbe-07a7-46af-a826-64b736542b10 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:27.199923 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:27.200059 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1045/2096] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:27.207054 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d2fbe-07a7-46af-a826-64b736542b10 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:27.218377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b990f8-bdcc-48ed-9c38-8cc685d7a0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:27.219174 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b990f8-bdcc-48ed-9c38-8cc685d7a0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:27.221060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b990f8-bdcc-48ed-9c38-8cc685d7a0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:27.221416 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b990f8-bdcc-48ed-9c38-8cc685d7a0a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:27.222638 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b990f8-bdcc-48ed-9c38-8cc685d7a0a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:24:27.225885 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b990f8-bdcc-48ed-9c38-8cc685d7a0a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:27.230751 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b990f8-bdcc-48ed-9c38-8cc685d7a0a2 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:27.257913 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227e2c0-7010-4f66-b09c-665c5eb9aab3 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:27.265408 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1052/2097] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:24:27.273892 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227e2c0-7010-4f66-b09c-665c5eb9aab3 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:27.287838 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868f405-65c9-46f6-96a5-1ed11b7329f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:27.288628 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868f405-65c9-46f6-96a5-1ed11b7329f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:27.288972 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868f405-65c9-46f6-96a5-1ed11b7329f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:27.289871 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868f405-65c9-46f6-96a5-1ed11b7329f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:27.290081 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868f405-65c9-46f6-96a5-1ed11b7329f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:27.295646 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868f405-65c9-46f6-96a5-1ed11b7329f1 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:27.360039 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1046/2098] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:24:27 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:24:27.365221 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b990f8-bdcc-48ed-9c38-8cc685d7a0a2 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:27.379671 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b990f8-bdcc-48ed-9c38-8cc685d7a0a2 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:27.538726 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e227c6-8eae-4fed-9416-318a8373f9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:27.539711 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e227c6-8eae-4fed-9416-318a8373f9a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:27.540166 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e227c6-8eae-4fed-9416-318a8373f9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:27.541729 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e227c6-8eae-4fed-9416-318a8373f9a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:27.542678 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e227c6-8eae-4fed-9416-318a8373f9a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:27.545423 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e227c6-8eae-4fed-9416-318a8373f9a1 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:27.584714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1053/2099] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:24:27 2022] POST /identity/v3/users => generated 291 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:24:27.586180 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868f405-65c9-46f6-96a5-1ed11b7329f1 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:27.603651 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868f405-65c9-46f6-96a5-1ed11b7329f1 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:27.609757 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73111677-53cc-40de-8ab9-33deeb9f2d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:27.610658 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73111677-53cc-40de-8ab9-33deeb9f2d2c admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:27.611097 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73111677-53cc-40de-8ab9-33deeb9f2d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:27.612144 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73111677-53cc-40de-8ab9-33deeb9f2d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:27.613075 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73111677-53cc-40de-8ab9-33deeb9f2d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:27.615315 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73111677-53cc-40de-8ab9-33deeb9f2d2c admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:27.632076 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1047/2100] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:27.636350 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e227c6-8eae-4fed-9416-318a8373f9a1 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:27.654765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e227c6-8eae-4fed-9416-318a8373f9a1 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:27.669749 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84e6d3-41b2-40f0-883a-31f17fb7e2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:27.670819 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84e6d3-41b2-40f0-883a-31f17fb7e2df admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:27.675695 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84e6d3-41b2-40f0-883a-31f17fb7e2df admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:27.676135 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84e6d3-41b2-40f0-883a-31f17fb7e2df admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:27.676994 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84e6d3-41b2-40f0-883a-31f17fb7e2df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:27.679024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84e6d3-41b2-40f0-883a-31f17fb7e2df admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:27.693869 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1054/2101] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:27.696007 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73111677-53cc-40de-8ab9-33deeb9f2d2c admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:27.708173 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73111677-53cc-40de-8ab9-33deeb9f2d2c admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:27.726488 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e656f3-a573-4030-84dc-e6318485eea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:27.727800 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e656f3-a573-4030-84dc-e6318485eea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:27.728241 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e656f3-a573-4030-84dc-e6318485eea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:27.728673 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e656f3-a573-4030-84dc-e6318485eea0 admin admin] PATH_INFO: `/v3/projects/dc54fc4664d847e9ad2f6eba7cd74a20/users/0589aaa97df9420b806efa3727c6d199/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:27.771884 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e656f3-a573-4030-84dc-e6318485eea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc54fc4664d847e9ad2f6eba7cd74a20, user_id=0589aaa97df9420b806efa3727c6d199, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:27.777592 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e656f3-a573-4030-84dc-e6318485eea0 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:27.826931 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1048/2102] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:24:27 2022] PUT /identity/v3/projects/dc54fc4664d847e9ad2f6eba7cd74a20/users/0589aaa97df9420b806efa3727c6d199/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:27.827060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e0379-3c26-4406-bff2-c97181bce469 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:27.827060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e0379-3c26-4406-bff2-c97181bce469 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:27.827060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e0379-3c26-4406-bff2-c97181bce469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:27.921061 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-cd8e0379-3c26-4406-bff2-c97181bce469 None None] MFA Rules not processed for user `0589aaa97df9420b806efa3727c6d199`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:27.922338 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-cd8e0379-3c26-4406-bff2-c97181bce469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:28.129355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1055/2103] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:28.131199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e656f3-a573-4030-84dc-e6318485eea0 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:28.313190 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e656f3-a573-4030-84dc-e6318485eea0 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:28.325547 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330aa5b9-56e4-49b7-b6cf-00a36dcf2283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:28.327563 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330aa5b9-56e4-49b7-b6cf-00a36dcf2283 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:28.327854 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330aa5b9-56e4-49b7-b6cf-00a36dcf2283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:28.328126 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330aa5b9-56e4-49b7-b6cf-00a36dcf2283 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:28.330135 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330aa5b9-56e4-49b7-b6cf-00a36dcf2283 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:28.332273 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330aa5b9-56e4-49b7-b6cf-00a36dcf2283 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:28.381338 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1049/2104] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:24:28 2022] POST /identity/v3/projects => generated 379 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:24:28.382284 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e0379-3c26-4406-bff2-c97181bce469 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:28.400925 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e0379-3c26-4406-bff2-c97181bce469 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:28.579753 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:28.592686 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf37c03-b828-4e96-979d-1a0f92ba618a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:28.593754 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf37c03-b828-4e96-979d-1a0f92ba618a admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:28.594226 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf37c03-b828-4e96-979d-1a0f92ba618a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:28.595331 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf37c03-b828-4e96-979d-1a0f92ba618a admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:28.596212 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf37c03-b828-4e96-979d-1a0f92ba618a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:28.598373 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf37c03-b828-4e96-979d-1a0f92ba618a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:28.642111 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1056/2105] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:24:28 2022] POST /identity/v3/users => generated 296 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:24:28.651691 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330aa5b9-56e4-49b7-b6cf-00a36dcf2283 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:28.677083 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330aa5b9-56e4-49b7-b6cf-00a36dcf2283 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:28.682833 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a3597-32d9-4871-8d38-84039d1ecc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:28.683751 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a3597-32d9-4871-8d38-84039d1ecc01 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:28.684234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a3597-32d9-4871-8d38-84039d1ecc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:28.684747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a3597-32d9-4871-8d38-84039d1ecc01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:28.685963 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a3597-32d9-4871-8d38-84039d1ecc01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:28.688646 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a3597-32d9-4871-8d38-84039d1ecc01 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:28.709796 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf37c03-b828-4e96-979d-1a0f92ba618a admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:28.710276 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1050/2106] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:28.736224 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf37c03-b828-4e96-979d-1a0f92ba618a admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:28.747022 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f6d1a-63ec-498a-ada5-edb7f53d5864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:28.748071 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f6d1a-63ec-498a-ada5-edb7f53d5864 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:28.749050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f6d1a-63ec-498a-ada5-edb7f53d5864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:28.749427 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f6d1a-63ec-498a-ada5-edb7f53d5864 admin admin] PATH_INFO: `/v3/projects/eaa25ff896e341c58a5c2e0995ccd6e1/users/6651bb7c6ffa42eda9aee2259007c243/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:28.784667 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f6d1a-63ec-498a-ada5-edb7f53d5864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaa25ff896e341c58a5c2e0995ccd6e1, user_id=6651bb7c6ffa42eda9aee2259007c243, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:28.787831 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f6d1a-63ec-498a-ada5-edb7f53d5864 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:28.809379 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1057/2107] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:24:28 2022] PUT /identity/v3/projects/eaa25ff896e341c58a5c2e0995ccd6e1/users/6651bb7c6ffa42eda9aee2259007c243/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:28.813779 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a3597-32d9-4871-8d38-84039d1ecc01 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:28.825276 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a3597-32d9-4871-8d38-84039d1ecc01 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:28.920024 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:28.997291 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fc451-b539-40a7-8a52-12e98a1a7a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:28.998013 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fc451-b539-40a7-8a52-12e98a1a7a4a admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:28.998333 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fc451-b539-40a7-8a52-12e98a1a7a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:28.998781 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fc451-b539-40a7-8a52-12e98a1a7a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:28.999525 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308fc451-b539-40a7-8a52-12e98a1a7a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:29.001141 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308fc451-b539-40a7-8a52-12e98a1a7a4a admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:29.035606 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f6d1a-63ec-498a-ada5-edb7f53d5864 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:29.036193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1051/2108] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:29.054283 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f6d1a-63ec-498a-ada5-edb7f53d5864 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:29.060401 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193db75-38eb-4c86-81ef-9ed10d9661d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:29.061618 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193db75-38eb-4c86-81ef-9ed10d9661d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:29.062097 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193db75-38eb-4c86-81ef-9ed10d9661d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:29.062665 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193db75-38eb-4c86-81ef-9ed10d9661d0 admin admin] PATH_INFO: `/v3/projects/eaa25ff896e341c58a5c2e0995ccd6e1/users/6651bb7c6ffa42eda9aee2259007c243/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:29.069669 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193db75-38eb-4c86-81ef-9ed10d9661d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaa25ff896e341c58a5c2e0995ccd6e1, user_id=6651bb7c6ffa42eda9aee2259007c243, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:29.072763 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193db75-38eb-4c86-81ef-9ed10d9661d0 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:29.085162 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1058/2109] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:24:29 2022] PUT /identity/v3/projects/eaa25ff896e341c58a5c2e0995ccd6e1/users/6651bb7c6ffa42eda9aee2259007c243/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:29.101175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ef0b1-0dff-4b2d-acd3-8a25f66a536e None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:29.101464 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ef0b1-0dff-4b2d-acd3-8a25f66a536e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:29.101740 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ef0b1-0dff-4b2d-acd3-8a25f66a536e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:29.195992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-8a6ef0b1-0dff-4b2d-acd3-8a25f66a536e None None] MFA Rules not processed for user `6651bb7c6ffa42eda9aee2259007c243`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:29.197247 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8a6ef0b1-0dff-4b2d-acd3-8a25f66a536e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:29.348055 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1052/2110] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:29.364293 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193db75-38eb-4c86-81ef-9ed10d9661d0 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:29.366274 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8193db75-38eb-4c86-81ef-9ed10d9661d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:29.454540 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193db75-38eb-4c86-81ef-9ed10d9661d0 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:29.458323 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eedc4a-47e4-4670-bbec-ff7fec7664a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:29.458959 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eedc4a-47e4-4670-bbec-ff7fec7664a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:29.459245 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eedc4a-47e4-4670-bbec-ff7fec7664a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:29.459527 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eedc4a-47e4-4670-bbec-ff7fec7664a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:29.473890 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eedc4a-47e4-4670-bbec-ff7fec7664a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:29.477730 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eedc4a-47e4-4670-bbec-ff7fec7664a9 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:29.489097 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1059/2111] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:29 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:24:30.113962 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ef0b1-0dff-4b2d-acd3-8a25f66a536e None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:30.132207 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a542b1-7095-44a0-94e4-514624ba9213 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:30.132500 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a542b1-7095-44a0-94e4-514624ba9213 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:30.132781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a542b1-7095-44a0-94e4-514624ba9213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:30.164190 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-30a542b1-7095-44a0-94e4-514624ba9213 None None] MFA Rules not processed for user `f54e6322e5d34cf3bd23ff5646d7f2e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:30.166030 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-30a542b1-7095-44a0-94e4-514624ba9213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:30.209299 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ef0b1-0dff-4b2d-acd3-8a25f66a536e None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:30.214707 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4699cc2-52e3-4ac3-8a0f-76f316a946e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:30.215756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4699cc2-52e3-4ac3-8a0f-76f316a946e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:30.216037 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4699cc2-52e3-4ac3-8a0f-76f316a946e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:30.216309 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4699cc2-52e3-4ac3-8a0f-76f316a946e1 admin admin] PATH_INFO: `/v3/users/0589aaa97df9420b806efa3727c6d199` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:30.218162 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4699cc2-52e3-4ac3-8a0f-76f316a946e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0589aaa97df9420b806efa3727c6d199)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:30.220114 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4699cc2-52e3-4ac3-8a0f-76f316a946e1 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:30.265944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1060/2112] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:24:30.278123 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c4699cc2-52e3-4ac3-8a0f-76f316a946e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0589aaa97df9420b806efa3727c6d199'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:30.280934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a542b1-7095-44a0-94e4-514624ba9213 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:30.282404 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-30a542b1-7095-44a0-94e4-514624ba9213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:30.287177 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c4699cc2-52e3-4ac3-8a0f-76f316a946e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0589aaa97df9420b806efa3727c6d199'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:30.288130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c4699cc2-52e3-4ac3-8a0f-76f316a946e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0589aaa97df9420b806efa3727c6d199'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:30.295946 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:30.308292 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c4699cc2-52e3-4ac3-8a0f-76f316a946e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0589aaa97df9420b806efa3727c6d199'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:30.309134 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c4699cc2-52e3-4ac3-8a0f-76f316a946e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0589aaa97df9420b806efa3727c6d199'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:30.332072 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1053/2113] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:24:30 2022] DELETE /identity/v3/users/0589aaa97df9420b806efa3727c6d199 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:30.336259 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277a958-85a1-4a15-bd20-e8b2193dab3c None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:30.336552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277a958-85a1-4a15-bd20-e8b2193dab3c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:30.337257 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277a958-85a1-4a15-bd20-e8b2193dab3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:30.349623 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:30.364965 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-a277a958-85a1-4a15-bd20-e8b2193dab3c None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:30.366499 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a277a958-85a1-4a15-bd20-e8b2193dab3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:30.394876 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a542b1-7095-44a0-94e4-514624ba9213 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:30.442718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1054/2114] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:30.452829 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277a958-85a1-4a15-bd20-e8b2193dab3c None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:30.454539 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a277a958-85a1-4a15-bd20-e8b2193dab3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:30.505183 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219d4e0-fe8e-44ab-bd28-526a935a4e5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:30.506066 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219d4e0-fe8e-44ab-bd28-526a935a4e5c service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:30.506418 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219d4e0-fe8e-44ab-bd28-526a935a4e5c service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:30.506766 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219d4e0-fe8e-44ab-bd28-526a935a4e5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:30.508744 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c219d4e0-fe8e-44ab-bd28-526a935a4e5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:30.528158 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277a958-85a1-4a15-bd20-e8b2193dab3c None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:30.536608 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a020e-2c52-477b-9fd2-15979e5ee327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:30.537277 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a020e-2c52-477b-9fd2-15979e5ee327 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:30.537582 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a020e-2c52-477b-9fd2-15979e5ee327 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:30.537887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a020e-2c52-477b-9fd2-15979e5ee327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:30.548416 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a020e-2c52-477b-9fd2-15979e5ee327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:30.549895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a020e-2c52-477b-9fd2-15979e5ee327 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:30.579428 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219d4e0-fe8e-44ab-bd28-526a935a4e5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:30.581305 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219d4e0-fe8e-44ab-bd28-526a935a4e5c service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:30.584470 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1055/2115] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:24:30.598554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1061/2116] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:24:31.278388 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a020e-2c52-477b-9fd2-15979e5ee327 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:31.280662 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-997a020e-2c52-477b-9fd2-15979e5ee327 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:31.306474 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a020e-2c52-477b-9fd2-15979e5ee327 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:31.313183 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60384d0-ba1e-4c8a-8a2a-ed8e7bd25123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:31.314659 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60384d0-ba1e-4c8a-8a2a-ed8e7bd25123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:31.315292 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60384d0-ba1e-4c8a-8a2a-ed8e7bd25123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:31.315784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60384d0-ba1e-4c8a-8a2a-ed8e7bd25123 admin admin] PATH_INFO: `/v3/projects/dc54fc4664d847e9ad2f6eba7cd74a20` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:31.317717 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60384d0-ba1e-4c8a-8a2a-ed8e7bd25123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc54fc4664d847e9ad2f6eba7cd74a20)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:31.320378 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60384d0-ba1e-4c8a-8a2a-ed8e7bd25123 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:31.404524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f60384d0-ba1e-4c8a-8a2a-ed8e7bd25123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc54fc4664d847e9ad2f6eba7cd74a20', 'request_id': 'req-f60384d0-ba1e-4c8a-8a2a-ed8e7bd25123'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:31.413213 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f60384d0-ba1e-4c8a-8a2a-ed8e7bd25123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc54fc4664d847e9ad2f6eba7cd74a20', 'request_id': 'req-f60384d0-ba1e-4c8a-8a2a-ed8e7bd25123'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:31.427379 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f60384d0-ba1e-4c8a-8a2a-ed8e7bd25123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc54fc4664d847e9ad2f6eba7cd74a20', 'request_id': 'req-f60384d0-ba1e-4c8a-8a2a-ed8e7bd25123'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:31.452775 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f60384d0-ba1e-4c8a-8a2a-ed8e7bd25123 admin admin] The token cache is being invalidate because project dc54fc4664d847e9ad2f6eba7cd74a20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:24:31.453084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f60384d0-ba1e-4c8a-8a2a-ed8e7bd25123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:31.453766 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f60384d0-ba1e-4c8a-8a2a-ed8e7bd25123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:31.462410 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1056/2117] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:24:31 2022] DELETE /identity/v3/projects/dc54fc4664d847e9ad2f6eba7cd74a20 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:31.466551 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219d4e0-fe8e-44ab-bd28-526a935a4e5c service nova] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:31.480554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219d4e0-fe8e-44ab-bd28-526a935a4e5c service nova] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:31.553061 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ddfe0-b6fe-47ee-a876-82167d684004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:31.554018 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ddfe0-b6fe-47ee-a876-82167d684004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:31.554306 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ddfe0-b6fe-47ee-a876-82167d684004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:31.554590 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ddfe0-b6fe-47ee-a876-82167d684004 admin admin] PATH_INFO: `/v3/users/6651bb7c6ffa42eda9aee2259007c243` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:31.555879 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ddfe0-b6fe-47ee-a876-82167d684004 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6651bb7c6ffa42eda9aee2259007c243)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:31.557892 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ddfe0-b6fe-47ee-a876-82167d684004 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:31.576996 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:31.617430 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f99ddfe0-b6fe-47ee-a876-82167d684004 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6651bb7c6ffa42eda9aee2259007c243'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:31.626924 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f99ddfe0-b6fe-47ee-a876-82167d684004 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6651bb7c6ffa42eda9aee2259007c243'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:31.627645 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f99ddfe0-b6fe-47ee-a876-82167d684004 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6651bb7c6ffa42eda9aee2259007c243'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:31.628512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f99ddfe0-b6fe-47ee-a876-82167d684004 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6651bb7c6ffa42eda9aee2259007c243'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:31.644172 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f99ddfe0-b6fe-47ee-a876-82167d684004 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6651bb7c6ffa42eda9aee2259007c243'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:31.666777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1062/2118] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:24:31 2022] DELETE /identity/v3/users/6651bb7c6ffa42eda9aee2259007c243 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:32.119545 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60384d0-ba1e-4c8a-8a2a-ed8e7bd25123 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:32.121032 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f60384d0-ba1e-4c8a-8a2a-ed8e7bd25123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:32.142928 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60384d0-ba1e-4c8a-8a2a-ed8e7bd25123 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:32.148660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:32.224985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d17108-0f7f-4a71-988c-62cabc4db2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:32.226458 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d17108-0f7f-4a71-988c-62cabc4db2ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:32.226822 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d17108-0f7f-4a71-988c-62cabc4db2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:32.227082 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d17108-0f7f-4a71-988c-62cabc4db2ed admin admin] PATH_INFO: `/v3/projects/eaa25ff896e341c58a5c2e0995ccd6e1` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:32.229111 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d17108-0f7f-4a71-988c-62cabc4db2ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaa25ff896e341c58a5c2e0995ccd6e1)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:32.231888 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d17108-0f7f-4a71-988c-62cabc4db2ed admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:32.288791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-12d17108-0f7f-4a71-988c-62cabc4db2ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaa25ff896e341c58a5c2e0995ccd6e1', 'request_id': 'req-12d17108-0f7f-4a71-988c-62cabc4db2ed'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:32.296878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-12d17108-0f7f-4a71-988c-62cabc4db2ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaa25ff896e341c58a5c2e0995ccd6e1', 'request_id': 'req-12d17108-0f7f-4a71-988c-62cabc4db2ed'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:32.307236 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-12d17108-0f7f-4a71-988c-62cabc4db2ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaa25ff896e341c58a5c2e0995ccd6e1', 'request_id': 'req-12d17108-0f7f-4a71-988c-62cabc4db2ed'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:32.319702 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-12d17108-0f7f-4a71-988c-62cabc4db2ed admin admin] The token cache is being invalidate because project eaa25ff896e341c58a5c2e0995ccd6e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:24:32.320083 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-12d17108-0f7f-4a71-988c-62cabc4db2ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:32.320817 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-12d17108-0f7f-4a71-988c-62cabc4db2ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:32.322941 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1057/2119] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:24:32 2022] DELETE /identity/v3/projects/eaa25ff896e341c58a5c2e0995ccd6e1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:32.328203 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25e9a5-159b-427f-8382-79a8ce576b9a None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:32.328503 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25e9a5-159b-427f-8382-79a8ce576b9a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:32.328781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25e9a5-159b-427f-8382-79a8ce576b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:32.356847 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-fb25e9a5-159b-427f-8382-79a8ce576b9a None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:32.358582 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-fb25e9a5-159b-427f-8382-79a8ce576b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:32.454157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1063/2120] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:24:32.463462 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b4032-e728-4608-aa68-35c1e76cb3f1 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:32.465420 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b4032-e728-4608-aa68-35c1e76cb3f1 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:32.465955 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b4032-e728-4608-aa68-35c1e76cb3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:32.497412 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-d16b4032-e728-4608-aa68-35c1e76cb3f1 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:32.498764 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d16b4032-e728-4608-aa68-35c1e76cb3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:32.507587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1058/2121] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:32.512212 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25e9a5-159b-427f-8382-79a8ce576b9a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:32.523297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25e9a5-159b-427f-8382-79a8ce576b9a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:32.535404 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329e3a9-a49e-4f76-a09d-3410fa29a171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:32.536341 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329e3a9-a49e-4f76-a09d-3410fa29a171 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:32.536881 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329e3a9-a49e-4f76-a09d-3410fa29a171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:32.537400 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329e3a9-a49e-4f76-a09d-3410fa29a171 admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:32.538375 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329e3a9-a49e-4f76-a09d-3410fa29a171 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:24:32.538957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329e3a9-a49e-4f76-a09d-3410fa29a171 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:32.541085 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329e3a9-a49e-4f76-a09d-3410fa29a171 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:32.563991 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1064/2122] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:24:32.564940 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b4032-e728-4608-aa68-35c1e76cb3f1 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:32.577480 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b4032-e728-4608-aa68-35c1e76cb3f1 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:32.585576 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1ba6c-6c37-4c6b-acd7-97bee09984a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:32.587414 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1ba6c-6c37-4c6b-acd7-97bee09984a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:32.587938 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1ba6c-6c37-4c6b-acd7-97bee09984a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:32.588468 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1ba6c-6c37-4c6b-acd7-97bee09984a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:32.589736 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1ba6c-6c37-4c6b-acd7-97bee09984a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:32.593610 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1ba6c-6c37-4c6b-acd7-97bee09984a2 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:32.645875 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1059/2123] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:24:32 2022] POST /identity/v3/projects => generated 381 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:24:32.649021 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329e3a9-a49e-4f76-a09d-3410fa29a171 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:32.666296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329e3a9-a49e-4f76-a09d-3410fa29a171 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:32.785550 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde670a-a633-4506-aad3-af5e8afc1814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:32.787137 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde670a-a633-4506-aad3-af5e8afc1814 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:32.787888 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde670a-a633-4506-aad3-af5e8afc1814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:32.788510 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde670a-a633-4506-aad3-af5e8afc1814 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:32.791337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde670a-a633-4506-aad3-af5e8afc1814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:32.793743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde670a-a633-4506-aad3-af5e8afc1814 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:32.831256 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1065/2124] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:24:32 2022] POST /identity/v3/users => generated 291 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:24:32.832082 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1ba6c-6c37-4c6b-acd7-97bee09984a2 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:32.848338 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1ba6c-6c37-4c6b-acd7-97bee09984a2 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:32.865008 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e7989-ef7d-4d37-9c18-068467a9d9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:32.865695 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e7989-ef7d-4d37-9c18-068467a9d9fa admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:32.866032 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e7989-ef7d-4d37-9c18-068467a9d9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:32.866292 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e7989-ef7d-4d37-9c18-068467a9d9fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:32.867040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e7989-ef7d-4d37-9c18-068467a9d9fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:32.868783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e7989-ef7d-4d37-9c18-068467a9d9fa admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:32.888709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1060/2125] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:32.893057 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde670a-a633-4506-aad3-af5e8afc1814 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:32.910185 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde670a-a633-4506-aad3-af5e8afc1814 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:32.923774 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746917b-b9ef-4f32-81c6-113bdbc16f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:32.924525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746917b-b9ef-4f32-81c6-113bdbc16f8e admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:32.924839 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746917b-b9ef-4f32-81c6-113bdbc16f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:32.925357 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746917b-b9ef-4f32-81c6-113bdbc16f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:32.926187 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0746917b-b9ef-4f32-81c6-113bdbc16f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:32.927887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0746917b-b9ef-4f32-81c6-113bdbc16f8e admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:32.931009 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:32.944674 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1066/2126] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:32.947523 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e7989-ef7d-4d37-9c18-068467a9d9fa admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:32.959612 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e7989-ef7d-4d37-9c18-068467a9d9fa admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:32.968223 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ca652-9188-4cb3-bda0-5f1f4858db80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:32.969150 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ca652-9188-4cb3-bda0-5f1f4858db80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:32.969436 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ca652-9188-4cb3-bda0-5f1f4858db80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:32.969925 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ca652-9188-4cb3-bda0-5f1f4858db80 admin admin] PATH_INFO: `/v3/projects/dad9556ca08046a9be0bbcfe63acdeae/users/5c879d706d9840e1bf5450590b155f0b/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:33.000790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ca652-9188-4cb3-bda0-5f1f4858db80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dad9556ca08046a9be0bbcfe63acdeae, user_id=5c879d706d9840e1bf5450590b155f0b, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:33.004611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ca652-9188-4cb3-bda0-5f1f4858db80 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:33.031517 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1061/2127] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:24:32 2022] PUT /identity/v3/projects/dad9556ca08046a9be0bbcfe63acdeae/users/5c879d706d9840e1bf5450590b155f0b/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:33.042867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3712f7a-26a3-40a5-8d87-596e982aa7cf None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:33.043228 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3712f7a-26a3-40a5-8d87-596e982aa7cf None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:33.043575 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3712f7a-26a3-40a5-8d87-596e982aa7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:33.081639 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e3712f7a-26a3-40a5-8d87-596e982aa7cf None None] MFA Rules not processed for user `5c879d706d9840e1bf5450590b155f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:33.083571 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e3712f7a-26a3-40a5-8d87-596e982aa7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:33.167505 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1067/2128] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:33.172656 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ca652-9188-4cb3-bda0-5f1f4858db80 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:33.213114 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:33.252633 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ca652-9188-4cb3-bda0-5f1f4858db80 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:33.257576 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38fc61-2a86-4b2d-8070-288fdb4b58f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:33.258628 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38fc61-2a86-4b2d-8070-288fdb4b58f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:33.258990 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38fc61-2a86-4b2d-8070-288fdb4b58f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:33.259343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38fc61-2a86-4b2d-8070-288fdb4b58f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:33.260104 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38fc61-2a86-4b2d-8070-288fdb4b58f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:33.263121 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38fc61-2a86-4b2d-8070-288fdb4b58f1 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:33.298840 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1062/2129] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:24:33 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:24:33.299726 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3712f7a-26a3-40a5-8d87-596e982aa7cf None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:33.313278 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3712f7a-26a3-40a5-8d87-596e982aa7cf None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:33.387400 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a4ed7-4058-4907-abff-597f7db68f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:33.388486 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a4ed7-4058-4907-abff-597f7db68f4f admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:33.389662 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a4ed7-4058-4907-abff-597f7db68f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:33.390101 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a4ed7-4058-4907-abff-597f7db68f4f admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:33.390885 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a4ed7-4058-4907-abff-597f7db68f4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:33.393937 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a4ed7-4058-4907-abff-597f7db68f4f admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:33.418396 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1068/2130] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:24:33 2022] POST /identity/v3/users => generated 296 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:24:33.423240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38fc61-2a86-4b2d-8070-288fdb4b58f1 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:33.437744 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38fc61-2a86-4b2d-8070-288fdb4b58f1 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:33.446278 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15078964-0b33-46bf-986b-0ab5075b9081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:33.447002 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15078964-0b33-46bf-986b-0ab5075b9081 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:33.447286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15078964-0b33-46bf-986b-0ab5075b9081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:33.447793 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15078964-0b33-46bf-986b-0ab5075b9081 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:33.448685 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15078964-0b33-46bf-986b-0ab5075b9081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:33.450516 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15078964-0b33-46bf-986b-0ab5075b9081 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:33.462348 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1063/2131] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:33.466544 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a4ed7-4058-4907-abff-597f7db68f4f admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:33.477764 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a4ed7-4058-4907-abff-597f7db68f4f admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:33.483202 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7238d-f463-43e0-b213-57e44f74a78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:33.484104 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7238d-f463-43e0-b213-57e44f74a78d admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:33.484392 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7238d-f463-43e0-b213-57e44f74a78d admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:33.484667 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7238d-f463-43e0-b213-57e44f74a78d admin admin] PATH_INFO: `/v3/projects/695246d30ad647a0a63ba53bcca2ef7e/users/4ebb94d6012f46758660afa51eac40bd/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:33.503585 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7238d-f463-43e0-b213-57e44f74a78d admin admin] RBAC: Authorizing `identity:create_grant(project_id=695246d30ad647a0a63ba53bcca2ef7e, user_id=4ebb94d6012f46758660afa51eac40bd, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:33.506947 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7238d-f463-43e0-b213-57e44f74a78d admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:33.521984 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1069/2132] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:24:33 2022] PUT /identity/v3/projects/695246d30ad647a0a63ba53bcca2ef7e/users/4ebb94d6012f46758660afa51eac40bd/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:33.525952 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15078964-0b33-46bf-986b-0ab5075b9081 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:33.538693 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15078964-0b33-46bf-986b-0ab5075b9081 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:33.633165 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966a6ea-f13f-4112-9d7b-e1d6f5cf2e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:33.635915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966a6ea-f13f-4112-9d7b-e1d6f5cf2e35 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:33.636363 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966a6ea-f13f-4112-9d7b-e1d6f5cf2e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:33.637003 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966a6ea-f13f-4112-9d7b-e1d6f5cf2e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:33.638495 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966a6ea-f13f-4112-9d7b-e1d6f5cf2e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:33.646135 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966a6ea-f13f-4112-9d7b-e1d6f5cf2e35 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:33.673581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7238d-f463-43e0-b213-57e44f74a78d admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:33.673806 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1064/2133] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:24:33.691184 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7238d-f463-43e0-b213-57e44f74a78d admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:33.706733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654dd5f-d538-45c2-8985-214056c08212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:33.707640 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654dd5f-d538-45c2-8985-214056c08212 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:33.707919 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654dd5f-d538-45c2-8985-214056c08212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:33.708189 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654dd5f-d538-45c2-8985-214056c08212 admin admin] PATH_INFO: `/v3/projects/695246d30ad647a0a63ba53bcca2ef7e/users/4ebb94d6012f46758660afa51eac40bd/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:33.718335 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654dd5f-d538-45c2-8985-214056c08212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=695246d30ad647a0a63ba53bcca2ef7e, user_id=4ebb94d6012f46758660afa51eac40bd, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:33.718335 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654dd5f-d538-45c2-8985-214056c08212 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:33.746438 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1070/2134] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:24:33 2022] PUT /identity/v3/projects/695246d30ad647a0a63ba53bcca2ef7e/users/4ebb94d6012f46758660afa51eac40bd/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:24:33.749319 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f719b-8f2e-4f4d-80aa-1e78b3ef380f None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:33.749626 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f719b-8f2e-4f4d-80aa-1e78b3ef380f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:33.749918 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f719b-8f2e-4f4d-80aa-1e78b3ef380f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:33.789679 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-d58f719b-8f2e-4f4d-80aa-1e78b3ef380f None None] MFA Rules not processed for user `4ebb94d6012f46758660afa51eac40bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:33.791023 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d58f719b-8f2e-4f4d-80aa-1e78b3ef380f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:33.915091 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654dd5f-d538-45c2-8985-214056c08212 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:33.915510 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1065/2135] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:33.917987 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e654dd5f-d538-45c2-8985-214056c08212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:33.975664 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:33.991473 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654dd5f-d538-45c2-8985-214056c08212 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:33.995221 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47187b-4b47-444a-95ee-bf6d896cc4e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:33.995874 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47187b-4b47-444a-95ee-bf6d896cc4e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:33.996324 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47187b-4b47-444a-95ee-bf6d896cc4e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:33.996604 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47187b-4b47-444a-95ee-bf6d896cc4e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:34.006678 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e47187b-4b47-444a-95ee-bf6d896cc4e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:34.008134 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e47187b-4b47-444a-95ee-bf6d896cc4e4 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:34.019291 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1071/2136] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:24:34.122318 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f719b-8f2e-4f4d-80aa-1e78b3ef380f None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:34.132745 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f719b-8f2e-4f4d-80aa-1e78b3ef380f None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:34.139827 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337dfaf0-159d-4f13-bff7-7d8a7f8e5e16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:34.140493 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337dfaf0-159d-4f13-bff7-7d8a7f8e5e16 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:34.140910 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337dfaf0-159d-4f13-bff7-7d8a7f8e5e16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:34.141196 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337dfaf0-159d-4f13-bff7-7d8a7f8e5e16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:34.179679 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:34.241608 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337dfaf0-159d-4f13-bff7-7d8a7f8e5e16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:34.243300 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337dfaf0-159d-4f13-bff7-7d8a7f8e5e16 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:34.254827 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1066/2137] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:24:34.549970 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47187b-4b47-444a-95ee-bf6d896cc4e4 service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:34.624199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47187b-4b47-444a-95ee-bf6d896cc4e4 service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:34.630091 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdfb53-5ef4-4eb1-a040-be58526d388b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:34.631095 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdfb53-5ef4-4eb1-a040-be58526d388b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:34.631447 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdfb53-5ef4-4eb1-a040-be58526d388b admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:34.631791 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdfb53-5ef4-4eb1-a040-be58526d388b admin admin] PATH_INFO: `/v3/users/5c879d706d9840e1bf5450590b155f0b` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:34.633126 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdfb53-5ef4-4eb1-a040-be58526d388b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c879d706d9840e1bf5450590b155f0b)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:34.635213 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdfb53-5ef4-4eb1-a040-be58526d388b admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:34.690462 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-91fdfb53-5ef4-4eb1-a040-be58526d388b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c879d706d9840e1bf5450590b155f0b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:34.699975 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-91fdfb53-5ef4-4eb1-a040-be58526d388b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c879d706d9840e1bf5450590b155f0b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:34.700748 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-91fdfb53-5ef4-4eb1-a040-be58526d388b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c879d706d9840e1bf5450590b155f0b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:34.701974 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-91fdfb53-5ef4-4eb1-a040-be58526d388b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c879d706d9840e1bf5450590b155f0b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:34.716607 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-91fdfb53-5ef4-4eb1-a040-be58526d388b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c879d706d9840e1bf5450590b155f0b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:34.736803 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1072/2138] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:24:34 2022] DELETE /identity/v3/users/5c879d706d9840e1bf5450590b155f0b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:34.741151 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6b4f2-998b-4fb3-879c-d1f42cf99a58 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:34.742139 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6b4f2-998b-4fb3-879c-d1f42cf99a58 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:34.742642 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6b4f2-998b-4fb3-879c-d1f42cf99a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:34.760313 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-95d6b4f2-998b-4fb3-879c-d1f42cf99a58 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:34.762709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-95d6b4f2-998b-4fb3-879c-d1f42cf99a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:34.844815 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1067/2139] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:34.854671 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdfb53-5ef4-4eb1-a040-be58526d388b admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:34.856068 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-91fdfb53-5ef4-4eb1-a040-be58526d388b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:34.918820 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdfb53-5ef4-4eb1-a040-be58526d388b admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:34.922588 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563fbac-fffb-4ec1-8160-3f9e1d71ecbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:34.923236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563fbac-fffb-4ec1-8160-3f9e1d71ecbe service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:34.923563 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563fbac-fffb-4ec1-8160-3f9e1d71ecbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:34.923796 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563fbac-fffb-4ec1-8160-3f9e1d71ecbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:34.936902 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563fbac-fffb-4ec1-8160-3f9e1d71ecbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:34.938454 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563fbac-fffb-4ec1-8160-3f9e1d71ecbe service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:34.948692 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1073/2140] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:24:35.267940 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6b4f2-998b-4fb3-879c-d1f42cf99a58 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:35.270036 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-95d6b4f2-998b-4fb3-879c-d1f42cf99a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:35.289336 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6b4f2-998b-4fb3-879c-d1f42cf99a58 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:35.294190 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133328a-2757-467e-844d-f50026353288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:35.296261 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133328a-2757-467e-844d-f50026353288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:35.296708 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133328a-2757-467e-844d-f50026353288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:35.297013 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133328a-2757-467e-844d-f50026353288 admin admin] PATH_INFO: `/v3/projects/dad9556ca08046a9be0bbcfe63acdeae` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:35.298284 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133328a-2757-467e-844d-f50026353288 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dad9556ca08046a9be0bbcfe63acdeae)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:35.300684 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133328a-2757-467e-844d-f50026353288 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:35.354725 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c133328a-2757-467e-844d-f50026353288 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dad9556ca08046a9be0bbcfe63acdeae', 'request_id': 'req-c133328a-2757-467e-844d-f50026353288'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:35.361113 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c133328a-2757-467e-844d-f50026353288 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dad9556ca08046a9be0bbcfe63acdeae', 'request_id': 'req-c133328a-2757-467e-844d-f50026353288'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:35.369007 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c133328a-2757-467e-844d-f50026353288 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dad9556ca08046a9be0bbcfe63acdeae', 'request_id': 'req-c133328a-2757-467e-844d-f50026353288'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:35.381125 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c133328a-2757-467e-844d-f50026353288 admin admin] The token cache is being invalidate because project dad9556ca08046a9be0bbcfe63acdeae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:24:35.381416 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c133328a-2757-467e-844d-f50026353288 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:35.382092 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c133328a-2757-467e-844d-f50026353288 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:35.383645 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1068/2141] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:24:35 2022] DELETE /identity/v3/projects/dad9556ca08046a9be0bbcfe63acdeae => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:35.387606 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563fbac-fffb-4ec1-8160-3f9e1d71ecbe service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:35.394735 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:35.398969 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563fbac-fffb-4ec1-8160-3f9e1d71ecbe service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:35.472104 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894f08c-a030-4f31-b1dc-936e980eeacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:35.472983 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894f08c-a030-4f31-b1dc-936e980eeacf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:35.473266 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894f08c-a030-4f31-b1dc-936e980eeacf admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:35.473540 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894f08c-a030-4f31-b1dc-936e980eeacf admin admin] PATH_INFO: `/v3/users/4ebb94d6012f46758660afa51eac40bd` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:35.474762 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894f08c-a030-4f31-b1dc-936e980eeacf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ebb94d6012f46758660afa51eac40bd)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:35.476713 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894f08c-a030-4f31-b1dc-936e980eeacf admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:35.521209 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-8894f08c-a030-4f31-b1dc-936e980eeacf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ebb94d6012f46758660afa51eac40bd'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:35.527956 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-8894f08c-a030-4f31-b1dc-936e980eeacf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ebb94d6012f46758660afa51eac40bd'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:35.528611 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-8894f08c-a030-4f31-b1dc-936e980eeacf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ebb94d6012f46758660afa51eac40bd'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:35.529221 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-8894f08c-a030-4f31-b1dc-936e980eeacf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ebb94d6012f46758660afa51eac40bd'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:35.541640 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-8894f08c-a030-4f31-b1dc-936e980eeacf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ebb94d6012f46758660afa51eac40bd'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:35.554230 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1074/2142] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:24:35 2022] DELETE /identity/v3/users/4ebb94d6012f46758660afa51eac40bd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:36.131710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133328a-2757-467e-844d-f50026353288 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:36.133283 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c133328a-2757-467e-844d-f50026353288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:36.149069 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133328a-2757-467e-844d-f50026353288 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:36.211653 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:36.225652 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98e9a8-ab2b-4ad8-8813-6a9b857c606f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:36.226935 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98e9a8-ab2b-4ad8-8813-6a9b857c606f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:36.227596 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98e9a8-ab2b-4ad8-8813-6a9b857c606f admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:36.227973 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98e9a8-ab2b-4ad8-8813-6a9b857c606f admin admin] PATH_INFO: `/v3/projects/695246d30ad647a0a63ba53bcca2ef7e` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:36.229370 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd98e9a8-ab2b-4ad8-8813-6a9b857c606f admin admin] RBAC: Authorizing `identity:delete_project(project_id=695246d30ad647a0a63ba53bcca2ef7e)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:36.231440 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd98e9a8-ab2b-4ad8-8813-6a9b857c606f admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:36.283836 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-bd98e9a8-ab2b-4ad8-8813-6a9b857c606f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '695246d30ad647a0a63ba53bcca2ef7e', 'request_id': 'req-bd98e9a8-ab2b-4ad8-8813-6a9b857c606f'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:36.290469 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-bd98e9a8-ab2b-4ad8-8813-6a9b857c606f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '695246d30ad647a0a63ba53bcca2ef7e', 'request_id': 'req-bd98e9a8-ab2b-4ad8-8813-6a9b857c606f'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:36.300293 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-bd98e9a8-ab2b-4ad8-8813-6a9b857c606f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '695246d30ad647a0a63ba53bcca2ef7e', 'request_id': 'req-bd98e9a8-ab2b-4ad8-8813-6a9b857c606f'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:36.312721 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-bd98e9a8-ab2b-4ad8-8813-6a9b857c606f admin admin] The token cache is being invalidate because project 695246d30ad647a0a63ba53bcca2ef7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:24:36.313000 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-bd98e9a8-ab2b-4ad8-8813-6a9b857c606f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:36.313633 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-bd98e9a8-ab2b-4ad8-8813-6a9b857c606f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:36.315212 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1069/2143] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:24:36 2022] DELETE /identity/v3/projects/695246d30ad647a0a63ba53bcca2ef7e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:36.320218 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6599e53-bd34-4b35-a42d-9717a87e6ff8 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:36.320511 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6599e53-bd34-4b35-a42d-9717a87e6ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:36.320798 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6599e53-bd34-4b35-a42d-9717a87e6ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:36.338476 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-a6599e53-bd34-4b35-a42d-9717a87e6ff8 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:36.339829 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a6599e53-bd34-4b35-a42d-9717a87e6ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:36.404682 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1075/2144] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:36.412921 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d94a2-6e65-4a9c-b5f5-b8dca57c54ff None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:36.413208 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d94a2-6e65-4a9c-b5f5-b8dca57c54ff None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:36.413492 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d94a2-6e65-4a9c-b5f5-b8dca57c54ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:36.438119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-217d94a2-6e65-4a9c-b5f5-b8dca57c54ff None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:36.439347 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-217d94a2-6e65-4a9c-b5f5-b8dca57c54ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:36.447215 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1070/2145] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:36.451515 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6599e53-bd34-4b35-a42d-9717a87e6ff8 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:36.461280 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6599e53-bd34-4b35-a42d-9717a87e6ff8 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:36.465935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910e822-9344-4db8-8ebf-557464056fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:36.466623 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910e822-9344-4db8-8ebf-557464056fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:36.467448 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910e822-9344-4db8-8ebf-557464056fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:36.467729 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910e822-9344-4db8-8ebf-557464056fd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:36.468455 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910e822-9344-4db8-8ebf-557464056fd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:24:36.468763 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910e822-9344-4db8-8ebf-557464056fd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:36.470391 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910e822-9344-4db8-8ebf-557464056fd7 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:36.484620 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1076/2146] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:24:36.489040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d94a2-6e65-4a9c-b5f5-b8dca57c54ff None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:36.500158 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d94a2-6e65-4a9c-b5f5-b8dca57c54ff None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:36.507227 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1214b-4f83-4aef-8071-9f7871c936eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:36.507880 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1214b-4f83-4aef-8071-9f7871c936eb admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:36.508161 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1214b-4f83-4aef-8071-9f7871c936eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:36.508433 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1214b-4f83-4aef-8071-9f7871c936eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:36.509119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1214b-4f83-4aef-8071-9f7871c936eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:36.511068 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1214b-4f83-4aef-8071-9f7871c936eb admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:36.543868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1071/2147] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:24:36 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:24:36.545646 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910e822-9344-4db8-8ebf-557464056fd7 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:36.559464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910e822-9344-4db8-8ebf-557464056fd7 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:36.572816 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:36.635448 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042a81c-3483-464f-90da-3163022f0187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:36.636129 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042a81c-3483-464f-90da-3163022f0187 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:36.636412 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042a81c-3483-464f-90da-3163022f0187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:36.636688 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042a81c-3483-464f-90da-3163022f0187 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:36.637377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e042a81c-3483-464f-90da-3163022f0187 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:36.639382 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e042a81c-3483-464f-90da-3163022f0187 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:36.665859 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1077/2148] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:24:36 2022] POST /identity/v3/users => generated 285 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:24:36.667033 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1214b-4f83-4aef-8071-9f7871c936eb admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:36.678652 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1214b-4f83-4aef-8071-9f7871c936eb admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:36.688845 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8820966-a700-4f97-a675-951a01a31e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:36.689664 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8820966-a700-4f97-a675-951a01a31e8c admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:36.690725 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8820966-a700-4f97-a675-951a01a31e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:36.691022 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8820966-a700-4f97-a675-951a01a31e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:36.691816 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8820966-a700-4f97-a675-951a01a31e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:36.693457 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8820966-a700-4f97-a675-951a01a31e8c admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:36.705986 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1072/2149] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:36.710008 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042a81c-3483-464f-90da-3163022f0187 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:36.722202 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042a81c-3483-464f-90da-3163022f0187 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:36.728138 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc03b3e-d47f-4edd-91af-7a57b9fa6c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:36.728814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc03b3e-d47f-4edd-91af-7a57b9fa6c10 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:36.729095 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc03b3e-d47f-4edd-91af-7a57b9fa6c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:36.729376 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc03b3e-d47f-4edd-91af-7a57b9fa6c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:36.730151 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc03b3e-d47f-4edd-91af-7a57b9fa6c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:36.731768 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc03b3e-d47f-4edd-91af-7a57b9fa6c10 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:36.742770 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1078/2150] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:36.747076 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8820966-a700-4f97-a675-951a01a31e8c admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:36.757087 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8820966-a700-4f97-a675-951a01a31e8c admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:36.761853 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e9276-dbe3-4293-93f8-04eaf9ad2a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:36.762731 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e9276-dbe3-4293-93f8-04eaf9ad2a72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:36.763016 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e9276-dbe3-4293-93f8-04eaf9ad2a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:36.763291 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e9276-dbe3-4293-93f8-04eaf9ad2a72 admin admin] PATH_INFO: `/v3/projects/b4460b3dc60f4164988dd6b8b7785c04/users/3028475d88bd4a7db9df7f27d81f034b/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:36.780518 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e9276-dbe3-4293-93f8-04eaf9ad2a72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4460b3dc60f4164988dd6b8b7785c04, user_id=3028475d88bd4a7db9df7f27d81f034b, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:36.783292 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e9276-dbe3-4293-93f8-04eaf9ad2a72 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:36.797698 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1073/2151] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:24:36 2022] PUT /identity/v3/projects/b4460b3dc60f4164988dd6b8b7785c04/users/3028475d88bd4a7db9df7f27d81f034b/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:36.870625 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0f49b-141a-4291-ad7b-3ad7f353a661 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:36.871141 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0f49b-141a-4291-ad7b-3ad7f353a661 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:36.871452 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0f49b-141a-4291-ad7b-3ad7f353a661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:36.908900 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-20f0f49b-141a-4291-ad7b-3ad7f353a661 None None] MFA Rules not processed for user `3028475d88bd4a7db9df7f27d81f034b`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:36.910428 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-20f0f49b-141a-4291-ad7b-3ad7f353a661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:37.014287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1079/2152] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:37.028466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e9276-dbe3-4293-93f8-04eaf9ad2a72 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:37.031685 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-dc6e9276-dbe3-4293-93f8-04eaf9ad2a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:37.094397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e9276-dbe3-4293-93f8-04eaf9ad2a72 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:37.098169 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452bc94-6621-4168-90f6-8ef6b09aa7fd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cd24a726e4e4ce687d150a3bdc5948f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:37.099054 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452bc94-6621-4168-90f6-8ef6b09aa7fd service glance] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:37.099413 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452bc94-6621-4168-90f6-8ef6b09aa7fd service glance] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:37.099763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452bc94-6621-4168-90f6-8ef6b09aa7fd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:37.109555 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452bc94-6621-4168-90f6-8ef6b09aa7fd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:37.111038 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452bc94-6621-4168-90f6-8ef6b09aa7fd service glance] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:37.120686 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1074/2153] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:37 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:24:39.521765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c6449-aab1-47fe-9d01-d130c8e608f5 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:39.522257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c6449-aab1-47fe-9d01-d130c8e608f5 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:39.522375 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c6449-aab1-47fe-9d01-d130c8e608f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:39.539219 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-c99c6449-aab1-47fe-9d01-d130c8e608f5 None None] MFA Rules not processed for user `3b943ba0c640461e94943764f95458f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:39.540392 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c99c6449-aab1-47fe-9d01-d130c8e608f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:39.598223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1080/2154] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:46.416586 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb17a3f-f7b8-4264-a251-e242e232192b None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:46.417111 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb17a3f-f7b8-4264-a251-e242e232192b None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:46.417236 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb17a3f-f7b8-4264-a251-e242e232192b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:46.434273 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-3cb17a3f-f7b8-4264-a251-e242e232192b None None] MFA Rules not processed for user `5d20468ac7b64f1f9f850e4eca3761d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:46.435982 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-3cb17a3f-f7b8-4264-a251-e242e232192b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:46.449151 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:46.493663 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1075/2155] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:47.729289 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c6449-aab1-47fe-9d01-d130c8e608f5 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:47.730833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c99c6449-aab1-47fe-9d01-d130c8e608f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:47.766197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:47.805560 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c6449-aab1-47fe-9d01-d130c8e608f5 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:47.810108 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6cc31-ea09-4473-84e5-7d278c0d6bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:47.811516 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6cc31-ea09-4473-84e5-7d278c0d6bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:47.811862 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6cc31-ea09-4473-84e5-7d278c0d6bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:47.812105 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6cc31-ea09-4473-84e5-7d278c0d6bb4 admin admin] PATH_INFO: `/v3/users/73a7772df5d8472aa56d027874d9b2e3` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:47.813310 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd6cc31-ea09-4473-84e5-7d278c0d6bb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73a7772df5d8472aa56d027874d9b2e3)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:47.815435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd6cc31-ea09-4473-84e5-7d278c0d6bb4 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:47.861033 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-abd6cc31-ea09-4473-84e5-7d278c0d6bb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73a7772df5d8472aa56d027874d9b2e3'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:47.867733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-abd6cc31-ea09-4473-84e5-7d278c0d6bb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73a7772df5d8472aa56d027874d9b2e3'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:47.868405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-abd6cc31-ea09-4473-84e5-7d278c0d6bb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73a7772df5d8472aa56d027874d9b2e3'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:47.869014 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-abd6cc31-ea09-4473-84e5-7d278c0d6bb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73a7772df5d8472aa56d027874d9b2e3'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:47.881368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-abd6cc31-ea09-4473-84e5-7d278c0d6bb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73a7772df5d8472aa56d027874d9b2e3'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:47.894520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1081/2156] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:24:47 2022] DELETE /identity/v3/users/73a7772df5d8472aa56d027874d9b2e3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:47.899304 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83127c0-b0f6-4805-b17e-74481257d257 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:47.899784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83127c0-b0f6-4805-b17e-74481257d257 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:47.899897 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83127c0-b0f6-4805-b17e-74481257d257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:47.921739 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-b83127c0-b0f6-4805-b17e-74481257d257 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:47.921739 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-b83127c0-b0f6-4805-b17e-74481257d257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:47.980359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1076/2157] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:47.989794 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6cc31-ea09-4473-84e5-7d278c0d6bb4 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:47.991186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-abd6cc31-ea09-4473-84e5-7d278c0d6bb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:48.048861 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6cc31-ea09-4473-84e5-7d278c0d6bb4 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:48.052737 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b635f-b7fd-4e70-ace2-dfc9a16d0bd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:48.053386 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b635f-b7fd-4e70-ace2-dfc9a16d0bd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:48.053667 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b635f-b7fd-4e70-ace2-dfc9a16d0bd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:48.053981 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b635f-b7fd-4e70-ace2-dfc9a16d0bd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:48.063603 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b635f-b7fd-4e70-ace2-dfc9a16d0bd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:48.065037 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b635f-b7fd-4e70-ace2-dfc9a16d0bd5 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:48.076810 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1082/2158] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:24:48.361274 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83127c0-b0f6-4805-b17e-74481257d257 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:48.362734 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-b83127c0-b0f6-4805-b17e-74481257d257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:48.375726 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83127c0-b0f6-4805-b17e-74481257d257 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:48.380397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a022be1-4088-4675-9318-94108023a5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:48.381259 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a022be1-4088-4675-9318-94108023a5f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:48.382065 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a022be1-4088-4675-9318-94108023a5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:48.382519 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a022be1-4088-4675-9318-94108023a5f9 admin admin] PATH_INFO: `/v3/projects/7762253ada114ed099c07c426b32acea` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:48.383709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a022be1-4088-4675-9318-94108023a5f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7762253ada114ed099c07c426b32acea)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:48.385629 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a022be1-4088-4675-9318-94108023a5f9 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:48.443632 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5a022be1-4088-4675-9318-94108023a5f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7762253ada114ed099c07c426b32acea', 'request_id': 'req-5a022be1-4088-4675-9318-94108023a5f9'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:48.449848 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5a022be1-4088-4675-9318-94108023a5f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7762253ada114ed099c07c426b32acea', 'request_id': 'req-5a022be1-4088-4675-9318-94108023a5f9'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:48.461121 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5a022be1-4088-4675-9318-94108023a5f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7762253ada114ed099c07c426b32acea', 'request_id': 'req-5a022be1-4088-4675-9318-94108023a5f9'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:48.472113 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5a022be1-4088-4675-9318-94108023a5f9 admin admin] The token cache is being invalidate because project 7762253ada114ed099c07c426b32acea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:24:48.472402 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5a022be1-4088-4675-9318-94108023a5f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:48.473033 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5a022be1-4088-4675-9318-94108023a5f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:48.474637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1077/2159] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:24:48 2022] DELETE /identity/v3/projects/7762253ada114ed099c07c426b32acea => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:48.479572 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc934c-f164-4464-99e9-2133b624573e None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:48.479863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc934c-f164-4464-99e9-2133b624573e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:48.480141 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc934c-f164-4464-99e9-2133b624573e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:48.497249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e1cc934c-f164-4464-99e9-2133b624573e None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:48.498986 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e1cc934c-f164-4464-99e9-2133b624573e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:48.539841 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:48.560042 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1083/2160] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:48.568162 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bb3ac-e167-4617-b383-9dcb75927513 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:48.568468 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bb3ac-e167-4617-b383-9dcb75927513 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:48.568722 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bb3ac-e167-4617-b383-9dcb75927513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:48.588072 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-9b6bb3ac-e167-4617-b383-9dcb75927513 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:48.589284 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-9b6bb3ac-e167-4617-b383-9dcb75927513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:48.597400 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1078/2161] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:48.601742 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc934c-f164-4464-99e9-2133b624573e None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:48.611465 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc934c-f164-4464-99e9-2133b624573e None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:48.615990 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cf131-096b-4084-a8f1-61fb14286b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:48.616636 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cf131-096b-4084-a8f1-61fb14286b00 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:48.616936 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cf131-096b-4084-a8f1-61fb14286b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:48.617197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cf131-096b-4084-a8f1-61fb14286b00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:48.618033 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9cf131-096b-4084-a8f1-61fb14286b00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:24:48.618349 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9cf131-096b-4084-a8f1-61fb14286b00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:48.619959 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9cf131-096b-4084-a8f1-61fb14286b00 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:48.631973 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1084/2162] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:24:48.636100 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6bb3ac-e167-4617-b383-9dcb75927513 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:48.646049 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6bb3ac-e167-4617-b383-9dcb75927513 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:48.650771 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21aea2-eba6-4cdb-bf48-a8a7e5cfea71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:48.651418 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21aea2-eba6-4cdb-bf48-a8a7e5cfea71 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:48.651704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21aea2-eba6-4cdb-bf48-a8a7e5cfea71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:48.651983 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21aea2-eba6-4cdb-bf48-a8a7e5cfea71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:48.652673 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21aea2-eba6-4cdb-bf48-a8a7e5cfea71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:48.654639 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21aea2-eba6-4cdb-bf48-a8a7e5cfea71 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:48.681509 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1079/2163] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:24:48 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:24:48.686510 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cf131-096b-4084-a8f1-61fb14286b00 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:48.697348 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cf131-096b-4084-a8f1-61fb14286b00 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:48.755890 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bb910-d111-4602-b363-0a4bbaeb6695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:48.756527 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bb910-d111-4602-b363-0a4bbaeb6695 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:48.756743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bb910-d111-4602-b363-0a4bbaeb6695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:48.757022 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bb910-d111-4602-b363-0a4bbaeb6695 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:48.757717 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629bb910-d111-4602-b363-0a4bbaeb6695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:48.759676 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629bb910-d111-4602-b363-0a4bbaeb6695 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:48.784864 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1085/2164] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:24:48 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:24:48.789329 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21aea2-eba6-4cdb-bf48-a8a7e5cfea71 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:48.800394 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21aea2-eba6-4cdb-bf48-a8a7e5cfea71 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:48.805373 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbedf44-8ddc-4b1f-acb0-c761ca23d30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:48.806060 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbedf44-8ddc-4b1f-acb0-c761ca23d30f admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:48.806348 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbedf44-8ddc-4b1f-acb0-c761ca23d30f admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:48.806623 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbedf44-8ddc-4b1f-acb0-c761ca23d30f admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:48.807379 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbedf44-8ddc-4b1f-acb0-c761ca23d30f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:48.808990 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbedf44-8ddc-4b1f-acb0-c761ca23d30f admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:48.819888 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1080/2165] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:48.823703 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bb910-d111-4602-b363-0a4bbaeb6695 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:48.833647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bb910-d111-4602-b363-0a4bbaeb6695 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:48.838287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b1c13-f0d2-4027-85da-c4403ebcb4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:48.838941 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b1c13-f0d2-4027-85da-c4403ebcb4ad admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:48.839225 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b1c13-f0d2-4027-85da-c4403ebcb4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:48.839499 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b1c13-f0d2-4027-85da-c4403ebcb4ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:48.840226 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b1c13-f0d2-4027-85da-c4403ebcb4ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:48.841841 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b1c13-f0d2-4027-85da-c4403ebcb4ad admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:48.852428 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1086/2166] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:48.857746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbedf44-8ddc-4b1f-acb0-c761ca23d30f admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:48.868428 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbedf44-8ddc-4b1f-acb0-c761ca23d30f admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:48.873579 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ca2f4-fa90-472f-b52c-c6b619dd35c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:48.874492 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ca2f4-fa90-472f-b52c-c6b619dd35c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:48.874769 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ca2f4-fa90-472f-b52c-c6b619dd35c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:48.875041 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ca2f4-fa90-472f-b52c-c6b619dd35c4 admin admin] PATH_INFO: `/v3/projects/7cb6d7655c074a36bd8f4fe177057f29/users/73048a96398442fb8f4b4d9b2be8b072/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:48.878069 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:48.892633 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ca2f4-fa90-472f-b52c-c6b619dd35c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cb6d7655c074a36bd8f4fe177057f29, user_id=73048a96398442fb8f4b4d9b2be8b072, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:48.895460 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ca2f4-fa90-472f-b52c-c6b619dd35c4 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:48.907887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1081/2167] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:24:48 2022] PUT /identity/v3/projects/7cb6d7655c074a36bd8f4fe177057f29/users/73048a96398442fb8f4b4d9b2be8b072/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:48.918899 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ba713-ea8c-4894-9fc6-2d9009b9a36d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:48.919198 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ba713-ea8c-4894-9fc6-2d9009b9a36d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:48.919483 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ba713-ea8c-4894-9fc6-2d9009b9a36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:48.947479 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-560ba713-ea8c-4894-9fc6-2d9009b9a36d None None] MFA Rules not processed for user `73048a96398442fb8f4b4d9b2be8b072`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:48.948699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-560ba713-ea8c-4894-9fc6-2d9009b9a36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:49.018250 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1087/2168] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:49.031072 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ca2f4-fa90-472f-b52c-c6b619dd35c4 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:49.032860 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e50ca2f4-fa90-472f-b52c-c6b619dd35c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:49.090804 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ca2f4-fa90-472f-b52c-c6b619dd35c4 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:49.095100 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754edc2f-c12a-4e43-913c-f606a632c2b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:49.095747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754edc2f-c12a-4e43-913c-f606a632c2b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:49.096032 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754edc2f-c12a-4e43-913c-f606a632c2b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:49.096309 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754edc2f-c12a-4e43-913c-f606a632c2b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:49.104870 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754edc2f-c12a-4e43-913c-f606a632c2b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:49.106334 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754edc2f-c12a-4e43-913c-f606a632c2b4 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:49.115067 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1082/2169] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:24:49.139914 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ba713-ea8c-4894-9fc6-2d9009b9a36d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:49.185949 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:49.208786 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ba713-ea8c-4894-9fc6-2d9009b9a36d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:49.213325 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700fe10-0cdb-4e6b-9504-8a2080ddf245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:49.214226 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700fe10-0cdb-4e6b-9504-8a2080ddf245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:49.214508 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700fe10-0cdb-4e6b-9504-8a2080ddf245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:49.214783 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700fe10-0cdb-4e6b-9504-8a2080ddf245 admin admin] PATH_INFO: `/v3/users/73048a96398442fb8f4b4d9b2be8b072` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:49.216027 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f700fe10-0cdb-4e6b-9504-8a2080ddf245 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73048a96398442fb8f4b4d9b2be8b072)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:49.218016 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f700fe10-0cdb-4e6b-9504-8a2080ddf245 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:49.268662 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f700fe10-0cdb-4e6b-9504-8a2080ddf245 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73048a96398442fb8f4b4d9b2be8b072'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:49.275493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f700fe10-0cdb-4e6b-9504-8a2080ddf245 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73048a96398442fb8f4b4d9b2be8b072'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:49.276174 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f700fe10-0cdb-4e6b-9504-8a2080ddf245 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73048a96398442fb8f4b4d9b2be8b072'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:49.276805 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f700fe10-0cdb-4e6b-9504-8a2080ddf245 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73048a96398442fb8f4b4d9b2be8b072'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:49.288647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f700fe10-0cdb-4e6b-9504-8a2080ddf245 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73048a96398442fb8f4b4d9b2be8b072'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:49.302624 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1088/2170] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:24:49 2022] DELETE /identity/v3/users/73048a96398442fb8f4b4d9b2be8b072 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:49.307117 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d4862-7bb0-4b05-b603-386ad8460fe2 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:49.307408 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d4862-7bb0-4b05-b603-386ad8460fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:49.307699 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d4862-7bb0-4b05-b603-386ad8460fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:49.325935 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-360d4862-7bb0-4b05-b603-386ad8460fe2 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:49.327673 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-360d4862-7bb0-4b05-b603-386ad8460fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:49.385757 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1083/2171] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:49.396489 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700fe10-0cdb-4e6b-9504-8a2080ddf245 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:49.397933 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f700fe10-0cdb-4e6b-9504-8a2080ddf245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:49.457277 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700fe10-0cdb-4e6b-9504-8a2080ddf245 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:49.460970 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3c481-f913-4a9c-a070-18c36bb2e495 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:49.461621 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3c481-f913-4a9c-a070-18c36bb2e495 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:49.461937 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3c481-f913-4a9c-a070-18c36bb2e495 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:49.462219 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3c481-f913-4a9c-a070-18c36bb2e495 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:49.471778 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3c481-f913-4a9c-a070-18c36bb2e495 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:49.473211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3c481-f913-4a9c-a070-18c36bb2e495 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:49.489228 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1089/2172] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:24:49.765645 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d4862-7bb0-4b05-b603-386ad8460fe2 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:49.767225 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-360d4862-7bb0-4b05-b603-386ad8460fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:49.784067 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d4862-7bb0-4b05-b603-386ad8460fe2 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:49.788904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098e362-addf-410d-9c27-5b66af2c4ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:49.789777 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098e362-addf-410d-9c27-5b66af2c4ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:49.790091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098e362-addf-410d-9c27-5b66af2c4ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:49.790375 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098e362-addf-410d-9c27-5b66af2c4ae6 admin admin] PATH_INFO: `/v3/projects/7cb6d7655c074a36bd8f4fe177057f29` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:49.791586 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098e362-addf-410d-9c27-5b66af2c4ae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cb6d7655c074a36bd8f4fe177057f29)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:49.793557 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098e362-addf-410d-9c27-5b66af2c4ae6 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:49.849347 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5098e362-addf-410d-9c27-5b66af2c4ae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cb6d7655c074a36bd8f4fe177057f29', 'request_id': 'req-5098e362-addf-410d-9c27-5b66af2c4ae6'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:49.855598 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5098e362-addf-410d-9c27-5b66af2c4ae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cb6d7655c074a36bd8f4fe177057f29', 'request_id': 'req-5098e362-addf-410d-9c27-5b66af2c4ae6'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:49.863850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5098e362-addf-410d-9c27-5b66af2c4ae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cb6d7655c074a36bd8f4fe177057f29', 'request_id': 'req-5098e362-addf-410d-9c27-5b66af2c4ae6'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:49.875407 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5098e362-addf-410d-9c27-5b66af2c4ae6 admin admin] The token cache is being invalidate because project 7cb6d7655c074a36bd8f4fe177057f29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:24:49.875711 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5098e362-addf-410d-9c27-5b66af2c4ae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:49.876360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5098e362-addf-410d-9c27-5b66af2c4ae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:49.877968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1084/2173] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:24:49 2022] DELETE /identity/v3/projects/7cb6d7655c074a36bd8f4fe177057f29 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:24:49.882921 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23939909-13aa-46ee-8c5d-29b6e1c4d3f9 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:49.883433 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23939909-13aa-46ee-8c5d-29b6e1c4d3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:49.883640 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23939909-13aa-46ee-8c5d-29b6e1c4d3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:49.901582 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-23939909-13aa-46ee-8c5d-29b6e1c4d3f9 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:49.902923 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-23939909-13aa-46ee-8c5d-29b6e1c4d3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:49.968609 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1090/2174] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:49.977200 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14370c7c-afe7-482b-9460-bef2441a2cfa None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:49.977656 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14370c7c-afe7-482b-9460-bef2441a2cfa None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:49.977784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14370c7c-afe7-482b-9460-bef2441a2cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:49.996853 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-14370c7c-afe7-482b-9460-bef2441a2cfa None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:49.998126 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-14370c7c-afe7-482b-9460-bef2441a2cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:50.007446 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1085/2175] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:50.011047 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23939909-13aa-46ee-8c5d-29b6e1c4d3f9 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:50.018342 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:50.023617 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23939909-13aa-46ee-8c5d-29b6e1c4d3f9 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:50.030575 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08027c68-48fb-46cd-b099-bd1393a4edb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:50.031280 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08027c68-48fb-46cd-b099-bd1393a4edb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:50.031748 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08027c68-48fb-46cd-b099-bd1393a4edb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:50.032041 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08027c68-48fb-46cd-b099-bd1393a4edb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:50.032959 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08027c68-48fb-46cd-b099-bd1393a4edb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:24:50.033277 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08027c68-48fb-46cd-b099-bd1393a4edb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:50.034944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08027c68-48fb-46cd-b099-bd1393a4edb0 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:50.047282 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1091/2176] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:24:50.051905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14370c7c-afe7-482b-9460-bef2441a2cfa None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:50.057419 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:50.061101 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14370c7c-afe7-482b-9460-bef2441a2cfa None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:50.066965 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273f90b-0c68-49a8-80f6-db61ec53ff17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:50.067604 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273f90b-0c68-49a8-80f6-db61ec53ff17 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:50.067889 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273f90b-0c68-49a8-80f6-db61ec53ff17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:50.068398 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273f90b-0c68-49a8-80f6-db61ec53ff17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:50.069154 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273f90b-0c68-49a8-80f6-db61ec53ff17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:50.071554 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273f90b-0c68-49a8-80f6-db61ec53ff17 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:50.096481 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1086/2177] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:24:50 2022] POST /identity/v3/projects => generated 399 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:24:50.100810 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08027c68-48fb-46cd-b099-bd1393a4edb0 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:50.112387 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08027c68-48fb-46cd-b099-bd1393a4edb0 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:50.167589 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e3c50-a9f0-4efe-9c9f-54cf3259ae92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:50.168246 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e3c50-a9f0-4efe-9c9f-54cf3259ae92 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:50.168536 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e3c50-a9f0-4efe-9c9f-54cf3259ae92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:50.168814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e3c50-a9f0-4efe-9c9f-54cf3259ae92 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:50.169500 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e3c50-a9f0-4efe-9c9f-54cf3259ae92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:50.172098 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e3c50-a9f0-4efe-9c9f-54cf3259ae92 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:50.191297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1092/2178] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:24:50 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:24:50.196158 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273f90b-0c68-49a8-80f6-db61ec53ff17 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:50.207704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273f90b-0c68-49a8-80f6-db61ec53ff17 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:50.213034 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c3210-1f15-44be-a420-02819fbda6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:50.213727 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c3210-1f15-44be-a420-02819fbda6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:50.214042 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c3210-1f15-44be-a420-02819fbda6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:50.214320 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c3210-1f15-44be-a420-02819fbda6a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:50.215050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c3210-1f15-44be-a420-02819fbda6a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:50.217218 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c3210-1f15-44be-a420-02819fbda6a6 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:50.229180 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1087/2179] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:50.233842 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e3c50-a9f0-4efe-9c9f-54cf3259ae92 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:50.244792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e3c50-a9f0-4efe-9c9f-54cf3259ae92 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:50.250165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ffd14-393d-4e68-9d97-bc2758434908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:50.250842 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ffd14-393d-4e68-9d97-bc2758434908 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:50.251128 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ffd14-393d-4e68-9d97-bc2758434908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:50.251405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ffd14-393d-4e68-9d97-bc2758434908 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:50.252398 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ffd14-393d-4e68-9d97-bc2758434908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:50.255503 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ffd14-393d-4e68-9d97-bc2758434908 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:50.268673 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1093/2180] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:24:50.270085 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c3210-1f15-44be-a420-02819fbda6a6 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:50.280847 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c3210-1f15-44be-a420-02819fbda6a6 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:50.286640 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4b0ad-4192-49b5-902d-adc26e1a6ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:50.287518 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4b0ad-4192-49b5-902d-adc26e1a6ea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:50.287795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4b0ad-4192-49b5-902d-adc26e1a6ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:50.288067 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4b0ad-4192-49b5-902d-adc26e1a6ea9 admin admin] PATH_INFO: `/v3/projects/cbfc221ab0384ee3adf6c0825981113e/users/038f7290e1ab487cb09ca2ce99a28b79/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:50.303214 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4b0ad-4192-49b5-902d-adc26e1a6ea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbfc221ab0384ee3adf6c0825981113e, user_id=038f7290e1ab487cb09ca2ce99a28b79, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:50.305853 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4b0ad-4192-49b5-902d-adc26e1a6ea9 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:50.318536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1088/2181] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:24:50 2022] PUT /identity/v3/projects/cbfc221ab0384ee3adf6c0825981113e/users/038f7290e1ab487cb09ca2ce99a28b79/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:50.329558 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb68e52-f0e0-4b3d-8de4-ae0ae5f6041b None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:50.329880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb68e52-f0e0-4b3d-8de4-ae0ae5f6041b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:50.330193 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb68e52-f0e0-4b3d-8de4-ae0ae5f6041b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:50.356415 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-aeb68e52-f0e0-4b3d-8de4-ae0ae5f6041b None None] MFA Rules not processed for user `038f7290e1ab487cb09ca2ce99a28b79`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:50.357590 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-aeb68e52-f0e0-4b3d-8de4-ae0ae5f6041b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:50.424539 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1094/2182] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:24:50.437021 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4b0ad-4192-49b5-902d-adc26e1a6ea9 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:50.438809 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d2b4b0ad-4192-49b5-902d-adc26e1a6ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:50.495708 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4b0ad-4192-49b5-902d-adc26e1a6ea9 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:50.500089 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0f752-233d-44f2-bc21-8e5ca82ce63f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:50.500750 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0f752-233d-44f2-bc21-8e5ca82ce63f service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:50.501046 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0f752-233d-44f2-bc21-8e5ca82ce63f service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:50.501375 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0f752-233d-44f2-bc21-8e5ca82ce63f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:50.512240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd0f752-233d-44f2-bc21-8e5ca82ce63f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:50.513709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd0f752-233d-44f2-bc21-8e5ca82ce63f service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:50.523006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1089/2183] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:24:58.811733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb68e52-f0e0-4b3d-8de4-ae0ae5f6041b None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:58.942430 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb68e52-f0e0-4b3d-8de4-ae0ae5f6041b None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:58.958182 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489454ed-4749-4e08-a589-ca57a0fe3abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:58.959464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489454ed-4749-4e08-a589-ca57a0fe3abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:58.960272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489454ed-4749-4e08-a589-ca57a0fe3abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:58.963156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489454ed-4749-4e08-a589-ca57a0fe3abb admin admin] PATH_INFO: `/v3/users/038f7290e1ab487cb09ca2ce99a28b79` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:58.965795 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489454ed-4749-4e08-a589-ca57a0fe3abb admin admin] RBAC: Authorizing `identity:delete_user(user_id=038f7290e1ab487cb09ca2ce99a28b79)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:58.967854 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489454ed-4749-4e08-a589-ca57a0fe3abb admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:58.975931 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:59.104943 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-489454ed-4749-4e08-a589-ca57a0fe3abb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '038f7290e1ab487cb09ca2ce99a28b79'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:59.114105 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-489454ed-4749-4e08-a589-ca57a0fe3abb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '038f7290e1ab487cb09ca2ce99a28b79'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:59.114958 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-489454ed-4749-4e08-a589-ca57a0fe3abb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '038f7290e1ab487cb09ca2ce99a28b79'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:59.115647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-489454ed-4749-4e08-a589-ca57a0fe3abb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '038f7290e1ab487cb09ca2ce99a28b79'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:59.145845 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-489454ed-4749-4e08-a589-ca57a0fe3abb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '038f7290e1ab487cb09ca2ce99a28b79'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:59.163033 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1095/2184] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:24:58 2022] DELETE /identity/v3/users/038f7290e1ab487cb09ca2ce99a28b79 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:24:59.167575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ceaab-db77-4b3e-88bf-abadd82a51b9 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:59.168116 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ceaab-db77-4b3e-88bf-abadd82a51b9 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:59.168230 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ceaab-db77-4b3e-88bf-abadd82a51b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:59.188558 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-de2ceaab-db77-4b3e-88bf-abadd82a51b9 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:24:59.190006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-de2ceaab-db77-4b3e-88bf-abadd82a51b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:59.288001 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1090/2185] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:24:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:24:59.320076 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489454ed-4749-4e08-a589-ca57a0fe3abb admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:59.321639 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-489454ed-4749-4e08-a589-ca57a0fe3abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:59.434578 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489454ed-4749-4e08-a589-ca57a0fe3abb admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:59.439094 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132808a7-21dd-4d94-8092-af697f521fd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:59.439881 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132808a7-21dd-4d94-8092-af697f521fd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:59.440166 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132808a7-21dd-4d94-8092-af697f521fd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:59.440527 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132808a7-21dd-4d94-8092-af697f521fd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:59.453905 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132808a7-21dd-4d94-8092-af697f521fd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:59.455267 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132808a7-21dd-4d94-8092-af697f521fd6 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:59.466796 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1096/2186] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:24:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:24:59.830283 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ceaab-db77-4b3e-88bf-abadd82a51b9 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:24:59.831788 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-de2ceaab-db77-4b3e-88bf-abadd82a51b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:24:59.851217 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ceaab-db77-4b3e-88bf-abadd82a51b9 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:24:59.861309 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae4511-a799-4747-90f9-0180176e6066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:24:59.862004 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae4511-a799-4747-90f9-0180176e6066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:24:59.862203 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae4511-a799-4747-90f9-0180176e6066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:24:59.862550 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae4511-a799-4747-90f9-0180176e6066 admin admin] PATH_INFO: `/v3/projects/cbfc221ab0384ee3adf6c0825981113e` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:24:59.863875 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae4511-a799-4747-90f9-0180176e6066 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbfc221ab0384ee3adf6c0825981113e)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:24:59.866101 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae4511-a799-4747-90f9-0180176e6066 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:24:59.914279 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:24:59.920822 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d1ae4511-a799-4747-90f9-0180176e6066 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbfc221ab0384ee3adf6c0825981113e', 'request_id': 'req-d1ae4511-a799-4747-90f9-0180176e6066'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:59.929151 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d1ae4511-a799-4747-90f9-0180176e6066 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbfc221ab0384ee3adf6c0825981113e', 'request_id': 'req-d1ae4511-a799-4747-90f9-0180176e6066'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:59.936802 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d1ae4511-a799-4747-90f9-0180176e6066 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbfc221ab0384ee3adf6c0825981113e', 'request_id': 'req-d1ae4511-a799-4747-90f9-0180176e6066'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:59.949636 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d1ae4511-a799-4747-90f9-0180176e6066 admin admin] The token cache is being invalidate because project cbfc221ab0384ee3adf6c0825981113e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:24:59.950197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d1ae4511-a799-4747-90f9-0180176e6066 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:59.951270 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d1ae4511-a799-4747-90f9-0180176e6066 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:24:59.953447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1091/2187] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:24:59 2022] DELETE /identity/v3/projects/cbfc221ab0384ee3adf6c0825981113e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:25:01.252397 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940b2ae-145e-4459-b85e-b7565c6d87f2 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:01.252897 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940b2ae-145e-4459-b85e-b7565c6d87f2 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:01.253209 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940b2ae-145e-4459-b85e-b7565c6d87f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:01.269987 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e940b2ae-145e-4459-b85e-b7565c6d87f2 None None] MFA Rules not processed for user `0c58a96bc78b4fa3a643125a6140bb00`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:25:01.271198 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e940b2ae-145e-4459-b85e-b7565c6d87f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:25:01.328476 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1097/2188] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:25:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:25:06.938016 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab573208-7dfd-4e8b-9f05-3b60471aab3c None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:06.938551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab573208-7dfd-4e8b-9f05-3b60471aab3c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:06.938551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab573208-7dfd-4e8b-9f05-3b60471aab3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:06.956488 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-ab573208-7dfd-4e8b-9f05-3b60471aab3c None None] MFA Rules not processed for user `93baaa9e849b40b199d567615f7e1c94`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:25:06.957700 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ab573208-7dfd-4e8b-9f05-3b60471aab3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:25:07.020115 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1092/2189] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:25:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:25:11.321779 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=77,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:25:17.012095 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:DELETE=4,keystone:SELECT=32,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:25:21.651881 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940b2ae-145e-4459-b85e-b7565c6d87f2 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:25:21.654545 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e940b2ae-145e-4459-b85e-b7565c6d87f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:25:21.790178 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940b2ae-145e-4459-b85e-b7565c6d87f2 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:25:21.796549 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f17839-6402-4c1d-96c4-824ff808b757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:25:21.797431 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f17839-6402-4c1d-96c4-824ff808b757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:21.797718 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f17839-6402-4c1d-96c4-824ff808b757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:21.798034 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f17839-6402-4c1d-96c4-824ff808b757 admin admin] PATH_INFO: `/v3/users/3028475d88bd4a7db9df7f27d81f034b` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:21.799316 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f17839-6402-4c1d-96c4-824ff808b757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3028475d88bd4a7db9df7f27d81f034b)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:25:21.801530 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f17839-6402-4c1d-96c4-824ff808b757 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:25:21.851616 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-07f17839-6402-4c1d-96c4-824ff808b757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3028475d88bd4a7db9df7f27d81f034b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:25:21.859601 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-07f17839-6402-4c1d-96c4-824ff808b757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3028475d88bd4a7db9df7f27d81f034b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:25:21.860286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-07f17839-6402-4c1d-96c4-824ff808b757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3028475d88bd4a7db9df7f27d81f034b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:25:21.860915 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-07f17839-6402-4c1d-96c4-824ff808b757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3028475d88bd4a7db9df7f27d81f034b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:25:21.872969 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-07f17839-6402-4c1d-96c4-824ff808b757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3028475d88bd4a7db9df7f27d81f034b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:25:21.885713 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1098/2190] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:25:21 2022] DELETE /identity/v3/users/3028475d88bd4a7db9df7f27d81f034b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:25:21.890773 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd16260-56ae-45e5-98af-4d2824f0288d None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:21.891247 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd16260-56ae-45e5-98af-4d2824f0288d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:21.891378 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd16260-56ae-45e5-98af-4d2824f0288d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:21.922304 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-2fd16260-56ae-45e5-98af-4d2824f0288d None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:25:21.923657 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2fd16260-56ae-45e5-98af-4d2824f0288d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:25:22.002494 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1093/2191] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:25:22.011865 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f17839-6402-4c1d-96c4-824ff808b757 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:25:22.013780 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-07f17839-6402-4c1d-96c4-824ff808b757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:25:22.048264 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:25:22.148470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f17839-6402-4c1d-96c4-824ff808b757 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:25:22.152709 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da39938-c3c5-452d-9c5b-67f1c534c970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:25:22.153488 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da39938-c3c5-452d-9c5b-67f1c534c970 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:22.154316 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da39938-c3c5-452d-9c5b-67f1c534c970 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:22.154620 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da39938-c3c5-452d-9c5b-67f1c534c970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:22.165272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da39938-c3c5-452d-9c5b-67f1c534c970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:25:22.167065 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da39938-c3c5-452d-9c5b-67f1c534c970 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:25:22.178651 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1099/2192] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:25:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:25:22.476170 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd16260-56ae-45e5-98af-4d2824f0288d None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:25:22.478213 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2fd16260-56ae-45e5-98af-4d2824f0288d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:25:22.502133 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd16260-56ae-45e5-98af-4d2824f0288d None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:25:22.510790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097a000-d41a-4a2b-a6b3-bcf613e20a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:25:22.512384 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097a000-d41a-4a2b-a6b3-bcf613e20a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:22.512741 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097a000-d41a-4a2b-a6b3-bcf613e20a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:22.513087 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097a000-d41a-4a2b-a6b3-bcf613e20a5e admin admin] PATH_INFO: `/v3/projects/b4460b3dc60f4164988dd6b8b7785c04` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:22.515123 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097a000-d41a-4a2b-a6b3-bcf613e20a5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4460b3dc60f4164988dd6b8b7785c04)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:25:22.519733 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097a000-d41a-4a2b-a6b3-bcf613e20a5e admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:25:22.582002 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f097a000-d41a-4a2b-a6b3-bcf613e20a5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4460b3dc60f4164988dd6b8b7785c04', 'request_id': 'req-f097a000-d41a-4a2b-a6b3-bcf613e20a5e'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:25:22.592454 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f097a000-d41a-4a2b-a6b3-bcf613e20a5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4460b3dc60f4164988dd6b8b7785c04', 'request_id': 'req-f097a000-d41a-4a2b-a6b3-bcf613e20a5e'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:25:22.609535 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f097a000-d41a-4a2b-a6b3-bcf613e20a5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4460b3dc60f4164988dd6b8b7785c04', 'request_id': 'req-f097a000-d41a-4a2b-a6b3-bcf613e20a5e'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:25:22.620802 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f097a000-d41a-4a2b-a6b3-bcf613e20a5e admin admin] The token cache is being invalidate because project b4460b3dc60f4164988dd6b8b7785c04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:25:22.621092 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f097a000-d41a-4a2b-a6b3-bcf613e20a5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:25:22.621749 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f097a000-d41a-4a2b-a6b3-bcf613e20a5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:25:22.623368 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1094/2193] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:25:22 2022] DELETE /identity/v3/projects/b4460b3dc60f4164988dd6b8b7785c04 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:25:26.562056 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c521589-a352-45e8-8c5c-8afca0b21271 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:26.562589 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c521589-a352-45e8-8c5c-8afca0b21271 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:26.562738 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c521589-a352-45e8-8c5c-8afca0b21271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:26.580409 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-0c521589-a352-45e8-8c5c-8afca0b21271 None None] MFA Rules not processed for user `aff5d82384e84b669eeb00089ab8e09a`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:25:26.581642 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0c521589-a352-45e8-8c5c-8afca0b21271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:25:26.636908 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1100/2194] 10.222.0.57 () {58 vars in 1009 bytes} [Sat Jun 4 08:25:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:25:26.680904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097a000-d41a-4a2b-a6b3-bcf613e20a5e admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:25:26.682143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f097a000-d41a-4a2b-a6b3-bcf613e20a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:25:26.755430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097a000-d41a-4a2b-a6b3-bcf613e20a5e admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:25:26.761234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62f4b8-ee09-4c9f-ace7-2654766f2a5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05ea412cab4244c58a2670c66f5a311c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:25:26.761912 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62f4b8-ee09-4c9f-ace7-2654766f2a5c service swift] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:26.762202 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62f4b8-ee09-4c9f-ace7-2654766f2a5c service swift] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:26.762485 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62f4b8-ee09-4c9f-ace7-2654766f2a5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:26.772256 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62f4b8-ee09-4c9f-ace7-2654766f2a5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:25:26.774073 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62f4b8-ee09-4c9f-ace7-2654766f2a5c service swift] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:25:26.786280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1095/2195] 10.222.0.57 () {60 vars in 1384 bytes} [Sat Jun 4 08:25:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 08:25:31.246441 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd3e16-fa83-4985-81d8-1f64588a6d14 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:31.247846 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd3e16-fa83-4985-81d8-1f64588a6d14 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:31.247846 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd3e16-fa83-4985-81d8-1f64588a6d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:31.303554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-44bd3e16-fa83-4985-81d8-1f64588a6d14 None None] MFA Rules not processed for user `aff5d82384e84b669eeb00089ab8e09a`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:25:31.305566 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-44bd3e16-fa83-4985-81d8-1f64588a6d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:25:31.321230 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1101/2196] 10.222.0.57 () {58 vars in 1009 bytes} [Sat Jun 4 08:25:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:25:31.345197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62f4b8-ee09-4c9f-ace7-2654766f2a5c service swift] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:25:31.381895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62f4b8-ee09-4c9f-ace7-2654766f2a5c service swift] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:25:31.393050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983dfa9c-71e8-4d92-a6d9-e71729de9f01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05ea412cab4244c58a2670c66f5a311c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:25:31.394422 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983dfa9c-71e8-4d92-a6d9-e71729de9f01 service swift] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:31.395011 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983dfa9c-71e8-4d92-a6d9-e71729de9f01 service swift] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:31.395675 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983dfa9c-71e8-4d92-a6d9-e71729de9f01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:31.407440 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:25:31.416268 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983dfa9c-71e8-4d92-a6d9-e71729de9f01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:25:31.420872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983dfa9c-71e8-4d92-a6d9-e71729de9f01 service swift] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:25:31.441082 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1096/2197] 10.222.0.57 () {60 vars in 1384 bytes} [Sat Jun 4 08:25:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 08:25:35.143477 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd3e16-fa83-4985-81d8-1f64588a6d14 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:25:35.145184 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-44bd3e16-fa83-4985-81d8-1f64588a6d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:25:35.248014 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd3e16-fa83-4985-81d8-1f64588a6d14 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:25:35.256334 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa50f1a-59d9-4cfd-981a-b24b78e16225 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:25:35.257221 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa50f1a-59d9-4cfd-981a-b24b78e16225 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:35.257629 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa50f1a-59d9-4cfd-981a-b24b78e16225 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:35.258036 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa50f1a-59d9-4cfd-981a-b24b78e16225 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:35.259990 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-daa50f1a-59d9-4cfd-981a-b24b78e16225 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:25:35.350331 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:25:35.494744 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa50f1a-59d9-4cfd-981a-b24b78e16225 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:25:35.496506 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa50f1a-59d9-4cfd-981a-b24b78e16225 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:25:35.537132 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1102/2198] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:25:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:25:41.442150 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:25:45.518408 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=16 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:25:46.125793 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144e213-0c3a-47f6-821a-1fa43f414f6d None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:46.126297 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144e213-0c3a-47f6-821a-1fa43f414f6d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:46.126398 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144e213-0c3a-47f6-821a-1fa43f414f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:46.144490 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-2144e213-0c3a-47f6-821a-1fa43f414f6d None None] MFA Rules not processed for user `aff5d82384e84b669eeb00089ab8e09a`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:25:46.145687 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2144e213-0c3a-47f6-821a-1fa43f414f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:25:46.159724 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1097/2199] 10.222.0.57 () {58 vars in 967 bytes} [Sat Jun 4 08:25:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:25:46.171851 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa50f1a-59d9-4cfd-981a-b24b78e16225 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:25:46.183838 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa50f1a-59d9-4cfd-981a-b24b78e16225 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:25:46.189658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d2639-ef4f-4c67-9af7-f01d212ce344 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05ea412cab4244c58a2670c66f5a311c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:25:46.190349 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d2639-ef4f-4c67-9af7-f01d212ce344 service swift] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:46.190626 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d2639-ef4f-4c67-9af7-f01d212ce344 service swift] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:46.190911 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d2639-ef4f-4c67-9af7-f01d212ce344 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:46.199497 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d2639-ef4f-4c67-9af7-f01d212ce344 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:25:46.201694 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d2639-ef4f-4c67-9af7-f01d212ce344 service swift] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:25:46.210025 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1103/2200] 10.222.0.57 () {60 vars in 1384 bytes} [Sat Jun 4 08:25:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 08:25:48.157897 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144e213-0c3a-47f6-821a-1fa43f414f6d None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:25:48.159563 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2144e213-0c3a-47f6-821a-1fa43f414f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:25:48.232378 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144e213-0c3a-47f6-821a-1fa43f414f6d None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:25:48.236915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db40e8-940c-487a-a17a-fa64d6714067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:25:48.237792 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db40e8-940c-487a-a17a-fa64d6714067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:48.238119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db40e8-940c-487a-a17a-fa64d6714067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:48.238393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db40e8-940c-487a-a17a-fa64d6714067 admin admin] PATH_INFO: `/v3/users/5d20468ac7b64f1f9f850e4eca3761d0` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:48.239596 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db40e8-940c-487a-a17a-fa64d6714067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d20468ac7b64f1f9f850e4eca3761d0)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:25:48.241513 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db40e8-940c-487a-a17a-fa64d6714067 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:25:48.287996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-37db40e8-940c-487a-a17a-fa64d6714067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d20468ac7b64f1f9f850e4eca3761d0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:25:48.295905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-37db40e8-940c-487a-a17a-fa64d6714067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d20468ac7b64f1f9f850e4eca3761d0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:25:48.296599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-37db40e8-940c-487a-a17a-fa64d6714067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d20468ac7b64f1f9f850e4eca3761d0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:25:48.309769 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-37db40e8-940c-487a-a17a-fa64d6714067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d20468ac7b64f1f9f850e4eca3761d0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:25:48.310777 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-37db40e8-940c-487a-a17a-fa64d6714067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d20468ac7b64f1f9f850e4eca3761d0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:25:48.325007 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1098/2201] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:25:48 2022] DELETE /identity/v3/users/5d20468ac7b64f1f9f850e4eca3761d0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:25:48.502195 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d2639-ef4f-4c67-9af7-f01d212ce344 service swift] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:25:48.515792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d2639-ef4f-4c67-9af7-f01d212ce344 service swift] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:25:48.574396 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138633a-39f8-497b-b22b-08ca3170e8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:25:48.575417 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138633a-39f8-497b-b22b-08ca3170e8aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:48.575702 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138633a-39f8-497b-b22b-08ca3170e8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:48.575976 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138633a-39f8-497b-b22b-08ca3170e8aa admin admin] PATH_INFO: `/v3/projects/6c443dd708b0443f8ca77d5b28529606` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:48.577194 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138633a-39f8-497b-b22b-08ca3170e8aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c443dd708b0443f8ca77d5b28529606)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:25:48.579168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138633a-39f8-497b-b22b-08ca3170e8aa admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:25:48.626379 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4138633a-39f8-497b-b22b-08ca3170e8aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c443dd708b0443f8ca77d5b28529606', 'request_id': 'req-4138633a-39f8-497b-b22b-08ca3170e8aa'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:25:48.633744 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4138633a-39f8-497b-b22b-08ca3170e8aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c443dd708b0443f8ca77d5b28529606', 'request_id': 'req-4138633a-39f8-497b-b22b-08ca3170e8aa'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:25:48.642049 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4138633a-39f8-497b-b22b-08ca3170e8aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c443dd708b0443f8ca77d5b28529606', 'request_id': 'req-4138633a-39f8-497b-b22b-08ca3170e8aa'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:25:48.652639 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4138633a-39f8-497b-b22b-08ca3170e8aa admin admin] The token cache is being invalidate because project 6c443dd708b0443f8ca77d5b28529606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:25:48.653464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4138633a-39f8-497b-b22b-08ca3170e8aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:25:48.654627 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4138633a-39f8-497b-b22b-08ca3170e8aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:25:48.656350 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1104/2202] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:25:48 2022] DELETE /identity/v3/projects/6c443dd708b0443f8ca77d5b28529606 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:25:48.661102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ed7af-ac20-4e6c-8d31-e135879dbb42 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:48.661420 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ed7af-ac20-4e6c-8d31-e135879dbb42 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:48.661704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ed7af-ac20-4e6c-8d31-e135879dbb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:48.710155 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-253ed7af-ac20-4e6c-8d31-e135879dbb42 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:25:48.711322 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-253ed7af-ac20-4e6c-8d31-e135879dbb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:25:48.749907 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:25:48.775739 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1099/2203] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:25:48.784446 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f87eb0-4410-4272-ac3c-1aa18f1a6ac2 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:48.784741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f87eb0-4410-4272-ac3c-1aa18f1a6ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:48.785023 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f87eb0-4410-4272-ac3c-1aa18f1a6ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:48.803340 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-a2f87eb0-4410-4272-ac3c-1aa18f1a6ac2 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:25:48.804541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a2f87eb0-4410-4272-ac3c-1aa18f1a6ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:25:48.812686 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1105/2204] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:25:48.816959 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ed7af-ac20-4e6c-8d31-e135879dbb42 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:25:48.827915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ed7af-ac20-4e6c-8d31-e135879dbb42 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:25:48.832779 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1c384-ac18-4e6d-9871-600028d67c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:25:48.833440 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1c384-ac18-4e6d-9871-600028d67c6a admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:48.833722 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1c384-ac18-4e6d-9871-600028d67c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:48.834024 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1c384-ac18-4e6d-9871-600028d67c6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:48.834778 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1c384-ac18-4e6d-9871-600028d67c6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:25:48.835082 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1c384-ac18-4e6d-9871-600028d67c6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:25:48.836734 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1c384-ac18-4e6d-9871-600028d67c6a admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:25:48.849612 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1100/2205] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:25:48.854058 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f87eb0-4410-4272-ac3c-1aa18f1a6ac2 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:25:48.863451 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f87eb0-4410-4272-ac3c-1aa18f1a6ac2 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:25:48.868133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641f986-5bc9-4f69-9985-904ea2454d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:25:48.868780 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641f986-5bc9-4f69-9985-904ea2454d2e admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:48.869070 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641f986-5bc9-4f69-9985-904ea2454d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:48.869349 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641f986-5bc9-4f69-9985-904ea2454d2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:48.870257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d641f986-5bc9-4f69-9985-904ea2454d2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:25:48.872210 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d641f986-5bc9-4f69-9985-904ea2454d2e admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:25:48.897658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1106/2206] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:25:48 2022] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:25:48.901941 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1c384-ac18-4e6d-9871-600028d67c6a admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:25:48.912386 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1c384-ac18-4e6d-9871-600028d67c6a admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:25:48.969545 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf97ada-d006-43d5-8bdd-bc05816df828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:25:48.970162 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf97ada-d006-43d5-8bdd-bc05816df828 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:48.970449 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf97ada-d006-43d5-8bdd-bc05816df828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:48.970724 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf97ada-d006-43d5-8bdd-bc05816df828 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:48.971406 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf97ada-d006-43d5-8bdd-bc05816df828 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:25:48.973335 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf97ada-d006-43d5-8bdd-bc05816df828 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:25:48.993612 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1101/2207] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:25:48 2022] POST /identity/v3/users => generated 282 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:25:48.998499 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641f986-5bc9-4f69-9985-904ea2454d2e admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:25:49.008613 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641f986-5bc9-4f69-9985-904ea2454d2e admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:25:49.013148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d154c54-e82c-4cf0-b6f4-43b8a530f122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:25:49.013781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d154c54-e82c-4cf0-b6f4-43b8a530f122 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:49.014092 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d154c54-e82c-4cf0-b6f4-43b8a530f122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:49.014365 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d154c54-e82c-4cf0-b6f4-43b8a530f122 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:49.015079 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d154c54-e82c-4cf0-b6f4-43b8a530f122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:25:49.016657 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d154c54-e82c-4cf0-b6f4-43b8a530f122 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:25:49.026755 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1107/2208] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:25:49.030609 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf97ada-d006-43d5-8bdd-bc05816df828 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:25:49.040409 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf97ada-d006-43d5-8bdd-bc05816df828 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:25:49.045518 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf96ed-3352-4d6a-b33e-3f7ffc2cf612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:25:49.046196 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf96ed-3352-4d6a-b33e-3f7ffc2cf612 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:49.046480 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf96ed-3352-4d6a-b33e-3f7ffc2cf612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:49.046756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf96ed-3352-4d6a-b33e-3f7ffc2cf612 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:49.047471 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf96ed-3352-4d6a-b33e-3f7ffc2cf612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:25:49.049064 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf96ed-3352-4d6a-b33e-3f7ffc2cf612 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:25:49.060205 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1102/2209] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:25:49.063528 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d154c54-e82c-4cf0-b6f4-43b8a530f122 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:25:49.073270 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d154c54-e82c-4cf0-b6f4-43b8a530f122 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:25:49.077800 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eeec34-4408-46d5-b550-eb7419491c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:25:49.078730 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eeec34-4408-46d5-b550-eb7419491c1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:49.079010 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eeec34-4408-46d5-b550-eb7419491c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:49.079284 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eeec34-4408-46d5-b550-eb7419491c1f admin admin] PATH_INFO: `/v3/projects/30266a8820c54f5a8af82682d6d8e5b1/users/3fcdc7da38554604b3ff11f03e368611/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:49.093540 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eeec34-4408-46d5-b550-eb7419491c1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=30266a8820c54f5a8af82682d6d8e5b1, user_id=3fcdc7da38554604b3ff11f03e368611, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:25:49.096234 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eeec34-4408-46d5-b550-eb7419491c1f admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:25:49.108948 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1108/2210] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:25:49 2022] PUT /identity/v3/projects/30266a8820c54f5a8af82682d6d8e5b1/users/3fcdc7da38554604b3ff11f03e368611/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:25:49.118960 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47a68b-63fb-4f4f-8f17-7c8117ccd253 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:49.119257 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47a68b-63fb-4f4f-8f17-7c8117ccd253 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:49.119538 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47a68b-63fb-4f4f-8f17-7c8117ccd253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:49.146981 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-fd47a68b-63fb-4f4f-8f17-7c8117ccd253 None None] MFA Rules not processed for user `3fcdc7da38554604b3ff11f03e368611`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:25:49.148201 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-fd47a68b-63fb-4f4f-8f17-7c8117ccd253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:25:49.214919 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1103/2211] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:25:49 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:25:49.226743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eeec34-4408-46d5-b550-eb7419491c1f admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:25:49.228420 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c7eeec34-4408-46d5-b550-eb7419491c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:25:49.246702 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:25:49.309125 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eeec34-4408-46d5-b550-eb7419491c1f admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:25:49.312790 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079408c-101c-4f27-9c0b-8a74a057f9c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:25:49.313427 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079408c-101c-4f27-9c0b-8a74a057f9c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:49.313709 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079408c-101c-4f27-9c0b-8a74a057f9c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:49.314015 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079408c-101c-4f27-9c0b-8a74a057f9c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:49.322173 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079408c-101c-4f27-9c0b-8a74a057f9c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:25:49.323597 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079408c-101c-4f27-9c0b-8a74a057f9c5 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:25:49.332243 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1109/2212] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:25:49 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:25:50.393004 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443e8df-d519-486e-916d-d5b99fd7d149 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:50.393557 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443e8df-d519-486e-916d-d5b99fd7d149 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:50.393662 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443e8df-d519-486e-916d-d5b99fd7d149 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:50.394992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1104/2213] 10.222.0.57 () {54 vars in 921 bytes} [Sat Jun 4 08:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:25:50.401407 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673ae90-17d1-43b4-9002-6dd60d657cc8 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:50.401993 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673ae90-17d1-43b4-9002-6dd60d657cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:50.402092 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673ae90-17d1-43b4-9002-6dd60d657cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:50.452636 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-2673ae90-17d1-43b4-9002-6dd60d657cc8 None None] MFA Rules not processed for user `7e64d002241242928936dd0d991ecdc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:25:50.453922 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2673ae90-17d1-43b4-9002-6dd60d657cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:25:50.528988 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1110/2214] 10.222.0.57 () {58 vars in 1018 bytes} [Sat Jun 4 08:25:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:25:50.540309 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443e8df-d519-486e-916d-d5b99fd7d149 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:25:50.542038 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1443e8df-d519-486e-916d-d5b99fd7d149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:25:50.584957 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:25:50.601177 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443e8df-d519-486e-916d-d5b99fd7d149 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:25:50.604745 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6932c-81c5-4e33-a09c-64472d8d9823 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cd24a726e4e4ce687d150a3bdc5948f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:25:50.605388 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6932c-81c5-4e33-a09c-64472d8d9823 service glance] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:50.605724 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6932c-81c5-4e33-a09c-64472d8d9823 service glance] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:50.606565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6932c-81c5-4e33-a09c-64472d8d9823 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:50.616765 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6932c-81c5-4e33-a09c-64472d8d9823 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:25:50.618232 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6932c-81c5-4e33-a09c-64472d8d9823 service glance] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:25:50.629724 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1105/2215] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:25:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:25:50.697394 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16895bbf-1f2b-46a9-8472-0599329fddb5 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:50.697687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16895bbf-1f2b-46a9-8472-0599329fddb5 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:50.697998 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16895bbf-1f2b-46a9-8472-0599329fddb5 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:50.699737 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1111/2216] 10.222.0.57 () {54 vars in 921 bytes} [Sat Jun 4 08:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:25:50.704915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ffbb2-618f-440c-a858-58b46714a317 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:50.705212 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ffbb2-618f-440c-a858-58b46714a317 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:50.705507 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ffbb2-618f-440c-a858-58b46714a317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:50.725165 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-784ffbb2-618f-440c-a858-58b46714a317 None None] MFA Rules not processed for user `5fd5768a512c4177abae05f4ccd5c59f`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:25:50.725323 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-784ffbb2-618f-440c-a858-58b46714a317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:25:50.780701 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1106/2217] 10.222.0.57 () {58 vars in 1018 bytes} [Sat Jun 4 08:25:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:25:50.792777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16895bbf-1f2b-46a9-8472-0599329fddb5 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:25:50.795077 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-16895bbf-1f2b-46a9-8472-0599329fddb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:25:50.808743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16895bbf-1f2b-46a9-8472-0599329fddb5 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:25:50.813031 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4929474-cd5a-45b1-9c40-6db6bc63e1f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:25:50.813780 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4929474-cd5a-45b1-9c40-6db6bc63e1f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:50.814083 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4929474-cd5a-45b1-9c40-6db6bc63e1f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:50.814406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4929474-cd5a-45b1-9c40-6db6bc63e1f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:50.821944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4929474-cd5a-45b1-9c40-6db6bc63e1f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:25:50.823367 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4929474-cd5a-45b1-9c40-6db6bc63e1f8 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:25:50.831615 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1112/2218] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:25:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:25:50.914557 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17b2fb-2170-4de1-a7c5-03516e9a1e96 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:50.914849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17b2fb-2170-4de1-a7c5-03516e9a1e96 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:50.915137 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17b2fb-2170-4de1-a7c5-03516e9a1e96 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:50.916566 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1107/2219] 10.222.0.57 () {54 vars in 921 bytes} [Sat Jun 4 08:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:25:50.926277 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2557a76-54d7-4e06-966b-fbd88dff8287 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:50.926649 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2557a76-54d7-4e06-966b-fbd88dff8287 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:50.926998 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2557a76-54d7-4e06-966b-fbd88dff8287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:50.944709 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-b2557a76-54d7-4e06-966b-fbd88dff8287 None None] MFA Rules not processed for user `7e64d002241242928936dd0d991ecdc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:25:50.946035 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b2557a76-54d7-4e06-966b-fbd88dff8287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:25:50.955362 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1113/2220] 10.222.0.57 () {58 vars in 1018 bytes} [Sat Jun 4 08:25:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:25:50.967293 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17b2fb-2170-4de1-a7c5-03516e9a1e96 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:25:50.979168 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17b2fb-2170-4de1-a7c5-03516e9a1e96 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:25:50.983681 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4e55e-c1f6-4358-a43a-9da537255536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:25:50.984358 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4e55e-c1f6-4358-a43a-9da537255536 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:50.984641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4e55e-c1f6-4358-a43a-9da537255536 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:50.984943 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4e55e-c1f6-4358-a43a-9da537255536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:50.996760 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4e55e-c1f6-4358-a43a-9da537255536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:25:50.998504 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4e55e-c1f6-4358-a43a-9da537255536 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:25:51.009943 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1108/2221] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:25:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:25:53.356275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a22e3-f778-4f06-8d2a-22e80719f1b7 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:53.357293 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a22e3-f778-4f06-8d2a-22e80719f1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:53.357394 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a22e3-f778-4f06-8d2a-22e80719f1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:53.375750 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-ec4a22e3-f778-4f06-8d2a-22e80719f1b7 None None] MFA Rules not processed for user `aff5d82384e84b669eeb00089ab8e09a`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:25:53.376951 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ec4a22e3-f778-4f06-8d2a-22e80719f1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:25:53.413077 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:25:53.440682 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1114/2222] 10.222.0.57 () {58 vars in 1009 bytes} [Sat Jun 4 08:25:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:25:53.453997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4e55e-c1f6-4358-a43a-9da537255536 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:25:53.455390 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-46c4e55e-c1f6-4358-a43a-9da537255536 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:25:53.526591 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4e55e-c1f6-4358-a43a-9da537255536 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:25:53.531703 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234c0dd-3069-4c92-8112-c78df0f9ed55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05ea412cab4244c58a2670c66f5a311c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:25:53.532353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234c0dd-3069-4c92-8112-c78df0f9ed55 service swift] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:25:53.532643 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234c0dd-3069-4c92-8112-c78df0f9ed55 service swift] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:25:53.532917 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234c0dd-3069-4c92-8112-c78df0f9ed55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:25:53.541586 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234c0dd-3069-4c92-8112-c78df0f9ed55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:25:53.543231 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234c0dd-3069-4c92-8112-c78df0f9ed55 service swift] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:25:53.552156 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1109/2223] 10.222.0.57 () {60 vars in 1384 bytes} [Sat Jun 4 08:25:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 08:26:03.432288 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=9 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:26:03.548535 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=70 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:26:06.179381 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a22e3-f778-4f06-8d2a-22e80719f1b7 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:26:06.180843 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ec4a22e3-f778-4f06-8d2a-22e80719f1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:26:06.273518 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a22e3-f778-4f06-8d2a-22e80719f1b7 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:26:06.278697 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1b2de-4b61-4b2e-bc39-3bc659697d2f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fb6720f0d0141fea795cecfbf6f2538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:26:06.279378 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1b2de-4b61-4b2e-bc39-3bc659697d2f service placement] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:06.279665 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1b2de-4b61-4b2e-bc39-3bc659697d2f service placement] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:06.279953 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1b2de-4b61-4b2e-bc39-3bc659697d2f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:06.281780 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-62e1b2de-4b61-4b2e-bc39-3bc659697d2f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:26:06.293335 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1b2de-4b61-4b2e-bc39-3bc659697d2f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:26:06.295458 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1b2de-4b61-4b2e-bc39-3bc659697d2f service placement] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:26:06.305563 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1115/2224] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:26:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:26:16.301363 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=41 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:26:16.947725 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e36da9-e843-46c2-8a3c-06a42ef7b07f None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:16.948249 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e36da9-e843-46c2-8a3c-06a42ef7b07f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:16.948407 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e36da9-e843-46c2-8a3c-06a42ef7b07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:16.998849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-d1e36da9-e843-46c2-8a3c-06a42ef7b07f None None] MFA Rules not processed for user `aff5d82384e84b669eeb00089ab8e09a`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:26:17.000108 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d1e36da9-e843-46c2-8a3c-06a42ef7b07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:26:17.016505 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1110/2225] 10.222.0.57 () {58 vars in 967 bytes} [Sat Jun 4 08:26:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:26:17.028689 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1b2de-4b61-4b2e-bc39-3bc659697d2f service placement] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:26:17.050051 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1b2de-4b61-4b2e-bc39-3bc659697d2f service placement] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:26:17.055463 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8cd65-6f9d-4b85-bb11-428a3c4c284c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05ea412cab4244c58a2670c66f5a311c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:26:17.056104 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8cd65-6f9d-4b85-bb11-428a3c4c284c service swift] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:17.056385 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8cd65-6f9d-4b85-bb11-428a3c4c284c service swift] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:17.056648 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8cd65-6f9d-4b85-bb11-428a3c4c284c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:17.066058 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8cd65-6f9d-4b85-bb11-428a3c4c284c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:26:17.067721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8cd65-6f9d-4b85-bb11-428a3c4c284c service swift] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:26:17.075879 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1116/2226] 10.222.0.57 () {60 vars in 1384 bytes} [Sat Jun 4 08:26:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 08:26:27.013707 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=18 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:26:27.072495 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=10 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:26:27.481090 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e36da9-e843-46c2-8a3c-06a42ef7b07f None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:26:27.541957 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e36da9-e843-46c2-8a3c-06a42ef7b07f None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:26:27.546377 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1661a8-b6e8-423b-bee7-7bb189062ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:26:27.547234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1661a8-b6e8-423b-bee7-7bb189062ad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:27.547513 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1661a8-b6e8-423b-bee7-7bb189062ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:27.547782 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1661a8-b6e8-423b-bee7-7bb189062ad2 admin admin] PATH_INFO: `/v3/users/3fcdc7da38554604b3ff11f03e368611` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:27.549202 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1661a8-b6e8-423b-bee7-7bb189062ad2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fcdc7da38554604b3ff11f03e368611)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:26:27.551196 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1661a8-b6e8-423b-bee7-7bb189062ad2 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:26:27.597326 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-8c1661a8-b6e8-423b-bee7-7bb189062ad2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fcdc7da38554604b3ff11f03e368611'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:26:27.604172 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-8c1661a8-b6e8-423b-bee7-7bb189062ad2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fcdc7da38554604b3ff11f03e368611'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:26:27.604832 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-8c1661a8-b6e8-423b-bee7-7bb189062ad2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fcdc7da38554604b3ff11f03e368611'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:26:27.616962 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-8c1661a8-b6e8-423b-bee7-7bb189062ad2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fcdc7da38554604b3ff11f03e368611'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:26:27.617634 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-8c1661a8-b6e8-423b-bee7-7bb189062ad2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fcdc7da38554604b3ff11f03e368611'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:26:27.630361 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1111/2227] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:26:27 2022] DELETE /identity/v3/users/3fcdc7da38554604b3ff11f03e368611 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:26:27.634821 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1e2be-dc02-478a-b49d-852192a272f8 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:27.635135 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1e2be-dc02-478a-b49d-852192a272f8 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:27.635413 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1e2be-dc02-478a-b49d-852192a272f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:27.653703 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e7c1e2be-dc02-478a-b49d-852192a272f8 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:26:27.655733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e7c1e2be-dc02-478a-b49d-852192a272f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:26:27.712005 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1117/2228] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:26:27.721995 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1661a8-b6e8-423b-bee7-7bb189062ad2 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:26:27.723379 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8c1661a8-b6e8-423b-bee7-7bb189062ad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:26:27.780956 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1661a8-b6e8-423b-bee7-7bb189062ad2 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:26:27.784716 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e89a0-631b-4cf2-a054-b02228adbcb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:26:27.785363 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e89a0-631b-4cf2-a054-b02228adbcb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:27.785651 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e89a0-631b-4cf2-a054-b02228adbcb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:27.785966 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e89a0-631b-4cf2-a054-b02228adbcb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:27.795093 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e89a0-631b-4cf2-a054-b02228adbcb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:26:27.796521 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e89a0-631b-4cf2-a054-b02228adbcb0 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:26:27.806248 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1112/2229] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:26:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:26:28.071241 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1e2be-dc02-478a-b49d-852192a272f8 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:26:28.072747 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e7c1e2be-dc02-478a-b49d-852192a272f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:26:28.085266 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1e2be-dc02-478a-b49d-852192a272f8 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:26:28.090383 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8527796-bcfe-4a7f-b305-d1a048483645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:26:28.091239 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8527796-bcfe-4a7f-b305-d1a048483645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:28.091520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8527796-bcfe-4a7f-b305-d1a048483645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:28.091875 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8527796-bcfe-4a7f-b305-d1a048483645 admin admin] PATH_INFO: `/v3/projects/30266a8820c54f5a8af82682d6d8e5b1` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:28.097864 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8527796-bcfe-4a7f-b305-d1a048483645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30266a8820c54f5a8af82682d6d8e5b1)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:26:28.099830 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8527796-bcfe-4a7f-b305-d1a048483645 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:26:28.147235 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a8527796-bcfe-4a7f-b305-d1a048483645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30266a8820c54f5a8af82682d6d8e5b1', 'request_id': 'req-a8527796-bcfe-4a7f-b305-d1a048483645'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:26:28.153369 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a8527796-bcfe-4a7f-b305-d1a048483645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30266a8820c54f5a8af82682d6d8e5b1', 'request_id': 'req-a8527796-bcfe-4a7f-b305-d1a048483645'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:26:28.160179 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a8527796-bcfe-4a7f-b305-d1a048483645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30266a8820c54f5a8af82682d6d8e5b1', 'request_id': 'req-a8527796-bcfe-4a7f-b305-d1a048483645'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:26:28.170919 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a8527796-bcfe-4a7f-b305-d1a048483645 admin admin] The token cache is being invalidate because project 30266a8820c54f5a8af82682d6d8e5b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:26:28.171205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a8527796-bcfe-4a7f-b305-d1a048483645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:26:28.171833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a8527796-bcfe-4a7f-b305-d1a048483645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:26:28.173370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1118/2230] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:26:28 2022] DELETE /identity/v3/projects/30266a8820c54f5a8af82682d6d8e5b1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:26:28.178643 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cf3c8-3f14-4f13-a4f6-74be2f0ba4a8 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:28.179120 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cf3c8-3f14-4f13-a4f6-74be2f0ba4a8 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:28.179216 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cf3c8-3f14-4f13-a4f6-74be2f0ba4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:28.196775 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-d41cf3c8-3f14-4f13-a4f6-74be2f0ba4a8 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:26:28.198023 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d41cf3c8-3f14-4f13-a4f6-74be2f0ba4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:26:28.215500 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:26:28.259356 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1113/2231] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:26:28.268492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566eb6f3-74d4-4bcd-854d-6eb1403b27d1 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:28.268785 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566eb6f3-74d4-4bcd-854d-6eb1403b27d1 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:28.269067 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566eb6f3-74d4-4bcd-854d-6eb1403b27d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:28.287742 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-566eb6f3-74d4-4bcd-854d-6eb1403b27d1 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:26:28.288924 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-566eb6f3-74d4-4bcd-854d-6eb1403b27d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:26:28.297137 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1119/2232] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:26:28.301338 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cf3c8-3f14-4f13-a4f6-74be2f0ba4a8 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:26:28.311636 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cf3c8-3f14-4f13-a4f6-74be2f0ba4a8 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:26:28.316192 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a95305-45a7-4288-bd77-67a7c72064c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:26:28.316844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a95305-45a7-4288-bd77-67a7c72064c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:28.317125 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a95305-45a7-4288-bd77-67a7c72064c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:28.317400 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a95305-45a7-4288-bd77-67a7c72064c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:28.318157 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a95305-45a7-4288-bd77-67a7c72064c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:26:28.318460 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a95305-45a7-4288-bd77-67a7c72064c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:26:28.320046 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a95305-45a7-4288-bd77-67a7c72064c5 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:26:28.332054 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1114/2233] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:26:28.336131 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566eb6f3-74d4-4bcd-854d-6eb1403b27d1 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:26:28.345752 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566eb6f3-74d4-4bcd-854d-6eb1403b27d1 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:26:28.350463 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca2125-5cbf-43d9-bae5-3f10affd748c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:26:28.351125 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca2125-5cbf-43d9-bae5-3f10affd748c admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:28.351409 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca2125-5cbf-43d9-bae5-3f10affd748c admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:28.351684 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca2125-5cbf-43d9-bae5-3f10affd748c admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:28.352374 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca2125-5cbf-43d9-bae5-3f10affd748c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:26:28.354321 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca2125-5cbf-43d9-bae5-3f10affd748c admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:26:28.382358 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1120/2234] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:26:28 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:26:28.386572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a95305-45a7-4288-bd77-67a7c72064c5 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:26:28.397135 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a95305-45a7-4288-bd77-67a7c72064c5 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:26:28.459519 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198e878-7183-40e7-bc64-d62826282313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:26:28.460213 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198e878-7183-40e7-bc64-d62826282313 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:28.464575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198e878-7183-40e7-bc64-d62826282313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:28.464575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198e878-7183-40e7-bc64-d62826282313 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:28.464575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198e878-7183-40e7-bc64-d62826282313 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:26:28.464575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198e878-7183-40e7-bc64-d62826282313 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:26:28.490547 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1115/2235] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:26:28 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:26:28.491719 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca2125-5cbf-43d9-bae5-3f10affd748c admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:26:28.502551 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca2125-5cbf-43d9-bae5-3f10affd748c admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:26:28.507310 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d479582-e7db-4f83-8aa8-e7b447b01c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:26:28.507986 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d479582-e7db-4f83-8aa8-e7b447b01c48 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:28.508272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d479582-e7db-4f83-8aa8-e7b447b01c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:28.508550 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d479582-e7db-4f83-8aa8-e7b447b01c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:28.509319 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d479582-e7db-4f83-8aa8-e7b447b01c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:26:28.511002 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d479582-e7db-4f83-8aa8-e7b447b01c48 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:26:28.522306 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1121/2236] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:26:28.526370 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198e878-7183-40e7-bc64-d62826282313 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:26:28.537553 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198e878-7183-40e7-bc64-d62826282313 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:26:28.542385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd857cb5-6319-4627-9dad-140fd634e159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:26:28.543070 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd857cb5-6319-4627-9dad-140fd634e159 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:28.543356 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd857cb5-6319-4627-9dad-140fd634e159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:28.543637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd857cb5-6319-4627-9dad-140fd634e159 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:28.544375 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd857cb5-6319-4627-9dad-140fd634e159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:26:28.546877 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd857cb5-6319-4627-9dad-140fd634e159 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:26:28.560810 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1116/2237] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:26:28.561960 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d479582-e7db-4f83-8aa8-e7b447b01c48 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:26:28.572318 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d479582-e7db-4f83-8aa8-e7b447b01c48 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:26:28.577229 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4ec94-e095-455a-92c8-12507a23a218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:26:28.578153 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4ec94-e095-455a-92c8-12507a23a218 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:28.578435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4ec94-e095-455a-92c8-12507a23a218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:28.578710 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4ec94-e095-455a-92c8-12507a23a218 admin admin] PATH_INFO: `/v3/projects/950149f4530b41eea35bc273803918a9/users/a0fd7c1e6662495a98d502415eef3089/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:28.594687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4ec94-e095-455a-92c8-12507a23a218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=950149f4530b41eea35bc273803918a9, user_id=a0fd7c1e6662495a98d502415eef3089, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:26:28.597358 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4ec94-e095-455a-92c8-12507a23a218 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:26:28.612448 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1122/2238] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:26:28 2022] PUT /identity/v3/projects/950149f4530b41eea35bc273803918a9/users/a0fd7c1e6662495a98d502415eef3089/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:26:28.617609 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb59318-e37d-4f34-ba51-19f52d3fa9f4 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:28.618050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb59318-e37d-4f34-ba51-19f52d3fa9f4 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:28.618351 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb59318-e37d-4f34-ba51-19f52d3fa9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:28.636910 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-bbb59318-e37d-4f34-ba51-19f52d3fa9f4 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:26:28.638166 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-bbb59318-e37d-4f34-ba51-19f52d3fa9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:26:28.700641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1117/2239] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:26:28.710449 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4ec94-e095-455a-92c8-12507a23a218 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:26:28.712131 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4cb4ec94-e095-455a-92c8-12507a23a218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:26:28.733472 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:26:28.772416 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4ec94-e095-455a-92c8-12507a23a218 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:26:28.776311 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1bbaa-fad1-4614-bb0b-0c182864f361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:26:28.776961 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1bbaa-fad1-4614-bb0b-0c182864f361 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:28.777248 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1bbaa-fad1-4614-bb0b-0c182864f361 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:28.777522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1bbaa-fad1-4614-bb0b-0c182864f361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:28.793482 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1bbaa-fad1-4614-bb0b-0c182864f361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:26:28.795515 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1bbaa-fad1-4614-bb0b-0c182864f361 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:26:28.808174 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1123/2240] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:26:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:26:34.014065 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd3c51-c34f-4707-9094-61a0bf76772c None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:34.015137 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd3c51-c34f-4707-9094-61a0bf76772c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:34.015420 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd3c51-c34f-4707-9094-61a0bf76772c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:34.050990 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-1edd3c51-c34f-4707-9094-61a0bf76772c None None] MFA Rules not processed for user `a0fd7c1e6662495a98d502415eef3089`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:26:34.052212 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1edd3c51-c34f-4707-9094-61a0bf76772c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:26:34.076122 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:26:34.155385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1118/2241] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:26:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:26:34.159608 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1bbaa-fad1-4614-bb0b-0c182864f361 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:26:34.185779 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1bbaa-fad1-4614-bb0b-0c182864f361 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:26:34.194871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc166a63-9ed8-4c16-96cf-fd64be731798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:26:34.195824 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc166a63-9ed8-4c16-96cf-fd64be731798 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:34.196681 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc166a63-9ed8-4c16-96cf-fd64be731798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:34.197519 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc166a63-9ed8-4c16-96cf-fd64be731798 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:34.198836 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc166a63-9ed8-4c16-96cf-fd64be731798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:26:34.203756 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc166a63-9ed8-4c16-96cf-fd64be731798 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:26:34.244140 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1124/2242] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:26:34 2022] POST /identity/v3/projects => generated 383 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:26:34.247963 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd3c51-c34f-4707-9094-61a0bf76772c None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:26:34.262304 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd3c51-c34f-4707-9094-61a0bf76772c None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:26:34.346454 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a8853-e9a9-4b8b-bd47-3a3fdb47ace0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:26:34.347189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a8853-e9a9-4b8b-bd47-3a3fdb47ace0 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:34.347576 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a8853-e9a9-4b8b-bd47-3a3fdb47ace0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:34.347950 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a8853-e9a9-4b8b-bd47-3a3fdb47ace0 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:34.348746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a8853-e9a9-4b8b-bd47-3a3fdb47ace0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:26:34.350827 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a8853-e9a9-4b8b-bd47-3a3fdb47ace0 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:26:34.376328 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1119/2243] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:26:34 2022] POST /identity/v3/users => generated 298 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:26:34.380266 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc166a63-9ed8-4c16-96cf-fd64be731798 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:26:34.394617 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc166a63-9ed8-4c16-96cf-fd64be731798 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:26:34.400150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f8c94-64aa-4669-bfb7-84eeb7f56c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:26:34.401142 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f8c94-64aa-4669-bfb7-84eeb7f56c86 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:34.401668 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f8c94-64aa-4669-bfb7-84eeb7f56c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:34.402058 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f8c94-64aa-4669-bfb7-84eeb7f56c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:34.403330 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f8c94-64aa-4669-bfb7-84eeb7f56c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:26:34.405944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f8c94-64aa-4669-bfb7-84eeb7f56c86 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:26:34.422155 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1125/2244] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:26:34.423722 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a8853-e9a9-4b8b-bd47-3a3fdb47ace0 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:26:34.434282 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a8853-e9a9-4b8b-bd47-3a3fdb47ace0 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:26:34.439279 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d4ab3-a4fe-4412-a91c-36f6b9690107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:26:34.440461 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d4ab3-a4fe-4412-a91c-36f6b9690107 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:34.440895 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d4ab3-a4fe-4412-a91c-36f6b9690107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:34.441324 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d4ab3-a4fe-4412-a91c-36f6b9690107 admin admin] PATH_INFO: `/v3/projects/bc232df684c24fa5a33de80838db1572/users/805ae3defe0d4a0e82daba63888612cd/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:34.463266 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d4ab3-a4fe-4412-a91c-36f6b9690107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc232df684c24fa5a33de80838db1572, user_id=805ae3defe0d4a0e82daba63888612cd, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:26:34.467479 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d4ab3-a4fe-4412-a91c-36f6b9690107 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:26:34.491139 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f8c94-64aa-4669-bfb7-84eeb7f56c86 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:26:34.496829 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1120/2245] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:26:34 2022] PUT /identity/v3/projects/bc232df684c24fa5a33de80838db1572/users/805ae3defe0d4a0e82daba63888612cd/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:26:34.502924 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f8c94-64aa-4669-bfb7-84eeb7f56c86 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:26:34.614815 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05588650-ecd4-47a1-94f1-8cf179c8615f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:26:34.615551 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05588650-ecd4-47a1-94f1-8cf179c8615f admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:34.615902 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05588650-ecd4-47a1-94f1-8cf179c8615f admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:34.616272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05588650-ecd4-47a1-94f1-8cf179c8615f admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:34.617099 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05588650-ecd4-47a1-94f1-8cf179c8615f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:26:34.620598 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05588650-ecd4-47a1-94f1-8cf179c8615f admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:26:34.644240 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1126/2246] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:26:34.648140 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d4ab3-a4fe-4412-a91c-36f6b9690107 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:26:34.659258 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d4ab3-a4fe-4412-a91c-36f6b9690107 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:26:34.677886 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47b090-3cc3-4305-b194-04efe6dc1fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:26:34.678811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47b090-3cc3-4305-b194-04efe6dc1fee admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:34.679094 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47b090-3cc3-4305-b194-04efe6dc1fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:34.679372 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47b090-3cc3-4305-b194-04efe6dc1fee admin admin] PATH_INFO: `/v3/projects/bc232df684c24fa5a33de80838db1572/users/805ae3defe0d4a0e82daba63888612cd/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:34.681488 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f47b090-3cc3-4305-b194-04efe6dc1fee admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc232df684c24fa5a33de80838db1572, user_id=805ae3defe0d4a0e82daba63888612cd, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:26:34.684409 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f47b090-3cc3-4305-b194-04efe6dc1fee admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:26:34.723192 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1121/2247] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:26:34 2022] PUT /identity/v3/projects/bc232df684c24fa5a33de80838db1572/users/805ae3defe0d4a0e82daba63888612cd/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:26:40.899728 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3c184-f68b-4211-bfc5-1265d4eafda4 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:40.900189 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3c184-f68b-4211-bfc5-1265d4eafda4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:40.900283 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3c184-f68b-4211-bfc5-1265d4eafda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:40.931888 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6bb3c184-f68b-4211-bfc5-1265d4eafda4 None None] MFA Rules not processed for user `805ae3defe0d4a0e82daba63888612cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:26:40.933223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6bb3c184-f68b-4211-bfc5-1265d4eafda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:26:41.016238 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1127/2248] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:26:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:26:41.024609 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47b090-3cc3-4305-b194-04efe6dc1fee admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:26:41.026645 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0f47b090-3cc3-4305-b194-04efe6dc1fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:26:41.116746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47b090-3cc3-4305-b194-04efe6dc1fee admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:26:41.120902 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2202b0-15a3-4ecb-9a26-ce2435f02042 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cd24a726e4e4ce687d150a3bdc5948f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:26:41.121602 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2202b0-15a3-4ecb-9a26-ce2435f02042 service glance] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:41.122001 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2202b0-15a3-4ecb-9a26-ce2435f02042 service glance] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:41.122987 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2202b0-15a3-4ecb-9a26-ce2435f02042 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:41.128589 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:26:41.191801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2202b0-15a3-4ecb-9a26-ce2435f02042 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:26:41.193580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2202b0-15a3-4ecb-9a26-ce2435f02042 service glance] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:26:41.205146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1122/2249] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:26:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:26:41.321115 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f6848-0624-49f0-bb8b-2efd59b142ec None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:41.321407 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f6848-0624-49f0-bb8b-2efd59b142ec None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:41.321690 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f6848-0624-49f0-bb8b-2efd59b142ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:41.341617 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6d3f6848-0624-49f0-bb8b-2efd59b142ec None None] MFA Rules not processed for user `aff5d82384e84b669eeb00089ab8e09a`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:26:41.342869 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6d3f6848-0624-49f0-bb8b-2efd59b142ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:26:41.348457 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:26:41.399764 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1128/2250] 10.222.0.57 () {58 vars in 1009 bytes} [Sat Jun 4 08:26:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:26:41.420878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2202b0-15a3-4ecb-9a26-ce2435f02042 service glance] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:26:41.422350 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-cc2202b0-15a3-4ecb-9a26-ce2435f02042 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:26:41.505654 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2202b0-15a3-4ecb-9a26-ce2435f02042 service glance] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:26:41.511325 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc45c7c-0858-4559-b725-49838396818b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05ea412cab4244c58a2670c66f5a311c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:26:41.511987 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc45c7c-0858-4559-b725-49838396818b service swift] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:41.512284 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc45c7c-0858-4559-b725-49838396818b service swift] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:41.513477 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc45c7c-0858-4559-b725-49838396818b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:41.522217 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc45c7c-0858-4559-b725-49838396818b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:26:41.523913 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc45c7c-0858-4559-b725-49838396818b service swift] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:26:41.532642 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1123/2251] 10.222.0.57 () {60 vars in 1384 bytes} [Sat Jun 4 08:26:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 08:26:45.635941 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9930e8-bdf1-4d43-91f7-07b0086dd786 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:45.636476 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9930e8-bdf1-4d43-91f7-07b0086dd786 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:45.636742 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9930e8-bdf1-4d43-91f7-07b0086dd786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:45.676811 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-ef9930e8-bdf1-4d43-91f7-07b0086dd786 None None] MFA Rules not processed for user `3b943ba0c640461e94943764f95458f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:26:45.679814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ef9930e8-bdf1-4d43-91f7-07b0086dd786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:26:45.868163 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1129/2252] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:26:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:26:48.388809 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178ec69-46ba-422e-bfd6-d9c57a7d4c7e None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:48.389373 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178ec69-46ba-422e-bfd6-d9c57a7d4c7e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:48.389373 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178ec69-46ba-422e-bfd6-d9c57a7d4c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:48.409135 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-f178ec69-46ba-422e-bfd6-d9c57a7d4c7e None None] MFA Rules not processed for user `93baaa9e849b40b199d567615f7e1c94`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:26:48.410488 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f178ec69-46ba-422e-bfd6-d9c57a7d4c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:26:48.484365 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1124/2253] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:26:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:26:53.966977 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53925ff-b077-4d3d-9df6-60495341efdc None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:53.967535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53925ff-b077-4d3d-9df6-60495341efdc None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:53.967535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53925ff-b077-4d3d-9df6-60495341efdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:53.985983 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-d53925ff-b077-4d3d-9df6-60495341efdc None None] MFA Rules not processed for user `a0fd7c1e6662495a98d502415eef3089`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:26:53.987556 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d53925ff-b077-4d3d-9df6-60495341efdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:26:53.994471 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1130/2254] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:26:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:26:55.775436 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3510888-db49-4e79-8143-0c452c9584fa None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:55.775970 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3510888-db49-4e79-8143-0c452c9584fa None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:55.775970 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3510888-db49-4e79-8143-0c452c9584fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:55.796872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-f3510888-db49-4e79-8143-0c452c9584fa None None] MFA Rules not processed for user `aff5d82384e84b669eeb00089ab8e09a`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:26:55.798390 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f3510888-db49-4e79-8143-0c452c9584fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:26:55.807473 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1125/2255] 10.222.0.57 () {58 vars in 1009 bytes} [Sat Jun 4 08:26:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:26:55.825597 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53925ff-b077-4d3d-9df6-60495341efdc None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:26:55.839531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53925ff-b077-4d3d-9df6-60495341efdc None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:26:55.845013 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af3e00-a282-476e-9ede-cf704076c7b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05ea412cab4244c58a2670c66f5a311c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:26:55.845807 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af3e00-a282-476e-9ede-cf704076c7b1 service swift] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:26:55.846379 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af3e00-a282-476e-9ede-cf704076c7b1 service swift] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:26:55.846793 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af3e00-a282-476e-9ede-cf704076c7b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:26:55.857004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af3e00-a282-476e-9ede-cf704076c7b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:26:55.858842 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af3e00-a282-476e-9ede-cf704076c7b1 service swift] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:26:55.870802 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1131/2256] 10.222.0.57 () {60 vars in 1384 bytes} [Sat Jun 4 08:26:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 08:27:05.790310 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=90 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:27:05.865274 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=54 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:27:13.990692 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f9a6d-3aa7-453c-ac49-2fd1c1e6d0b8 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:27:13.991304 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f9a6d-3aa7-453c-ac49-2fd1c1e6d0b8 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:27:13.991521 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f9a6d-3aa7-453c-ac49-2fd1c1e6d0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:27:14.019195 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-3e9f9a6d-3aa7-453c-ac49-2fd1c1e6d0b8 None None] MFA Rules not processed for user `e1e8c33d40ee43c693c28beaf794dff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:27:14.021162 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-3e9f9a6d-3aa7-453c-ac49-2fd1c1e6d0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:27:14.114446 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1126/2257] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:27:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:27:24.104532 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=25 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:27:27.854007 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af3e00-a282-476e-9ede-cf704076c7b1 service swift] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:27:27.910958 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af3e00-a282-476e-9ede-cf704076c7b1 service swift] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:27:27.914572 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c51f7-2ce6-4a87-b6c5-1d06b400d99c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:27:27.918019 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c51f7-2ce6-4a87-b6c5-1d06b400d99c service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:27:27.918019 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c51f7-2ce6-4a87-b6c5-1d06b400d99c service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:27:27.918019 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c51f7-2ce6-4a87-b6c5-1d06b400d99c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:27:27.928958 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c51f7-2ce6-4a87-b6c5-1d06b400d99c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:27:27.930454 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c51f7-2ce6-4a87-b6c5-1d06b400d99c service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:27:27.941640 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1132/2258] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:27:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:27:37.937462 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=26 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:27:43.830116 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a82d17-2abb-4e68-8f93-ec6db72495a8 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:27:43.830635 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a82d17-2abb-4e68-8f93-ec6db72495a8 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:27:43.830739 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a82d17-2abb-4e68-8f93-ec6db72495a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:27:43.849791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-96a82d17-2abb-4e68-8f93-ec6db72495a8 None None] MFA Rules not processed for user `45692f4ec1254103a5b0132b3b42b60b`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:27:43.851188 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-96a82d17-2abb-4e68-8f93-ec6db72495a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:27:43.906552 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1127/2259] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:27:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:27:51.345811 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c51f7-2ce6-4a87-b6c5-1d06b400d99c service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:27:51.347397 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d90c51f7-2ce6-4a87-b6c5-1d06b400d99c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:27:51.361659 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c51f7-2ce6-4a87-b6c5-1d06b400d99c service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:27:51.365240 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbeeb3-a702-43f8-865f-288eeb8a64e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:27:51.365904 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbeeb3-a702-43f8-865f-288eeb8a64e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:27:51.366187 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbeeb3-a702-43f8-865f-288eeb8a64e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:27:51.366457 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbeeb3-a702-43f8-865f-288eeb8a64e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:27:51.368180 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-93dbeeb3-a702-43f8-865f-288eeb8a64e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:27:51.442436 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbeeb3-a702-43f8-865f-288eeb8a64e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:27:51.443885 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbeeb3-a702-43f8-865f-288eeb8a64e8 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:27:51.454821 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1133/2260] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:27:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:27:51.832051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a82d17-2abb-4e68-8f93-ec6db72495a8 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:27:51.842487 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a82d17-2abb-4e68-8f93-ec6db72495a8 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:27:51.846190 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba74d1-7e8d-4aa9-826f-7059471000bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:27:51.846833 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba74d1-7e8d-4aa9-826f-7059471000bd service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:27:51.847116 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba74d1-7e8d-4aa9-826f-7059471000bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:27:51.847394 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba74d1-7e8d-4aa9-826f-7059471000bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:27:51.849195 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-aaba74d1-7e8d-4aa9-826f-7059471000bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:27:51.862628 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba74d1-7e8d-4aa9-826f-7059471000bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:27:51.864052 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba74d1-7e8d-4aa9-826f-7059471000bd service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:27:51.874986 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1128/2261] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:27:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:27:55.396197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbeeb3-a702-43f8-865f-288eeb8a64e8 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:27:55.405683 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbeeb3-a702-43f8-865f-288eeb8a64e8 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:27:55.416367 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a7731-c141-4dc5-8eb9-01a263c561e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:27:55.417052 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a7731-c141-4dc5-8eb9-01a263c561e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:27:55.417518 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a7731-c141-4dc5-8eb9-01a263c561e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:27:55.417918 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a7731-c141-4dc5-8eb9-01a263c561e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:27:55.420366 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9b1a7731-c141-4dc5-8eb9-01a263c561e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:27:55.493769 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a7731-c141-4dc5-8eb9-01a263c561e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:27:55.495272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a7731-c141-4dc5-8eb9-01a263c561e2 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:27:55.510552 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1134/2262] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:27:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:28:00.097517 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba74d1-7e8d-4aa9-826f-7059471000bd service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:00.099330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-aaba74d1-7e8d-4aa9-826f-7059471000bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:00.118866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba74d1-7e8d-4aa9-826f-7059471000bd service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:00.126722 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c658b2-d38c-472b-a580-7c3876f776f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:00.128568 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c658b2-d38c-472b-a580-7c3876f776f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:00.129380 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c658b2-d38c-472b-a580-7c3876f776f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:00.129507 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c658b2-d38c-472b-a580-7c3876f776f1 admin admin] PATH_INFO: `/v3/users/3b943ba0c640461e94943764f95458f8` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:00.131717 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c658b2-d38c-472b-a580-7c3876f776f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b943ba0c640461e94943764f95458f8)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:00.133810 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c658b2-d38c-472b-a580-7c3876f776f1 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:00.222223 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c6c658b2-d38c-472b-a580-7c3876f776f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b943ba0c640461e94943764f95458f8'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:00.234398 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c6c658b2-d38c-472b-a580-7c3876f776f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b943ba0c640461e94943764f95458f8'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:00.235299 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c6c658b2-d38c-472b-a580-7c3876f776f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b943ba0c640461e94943764f95458f8'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:00.257647 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c6c658b2-d38c-472b-a580-7c3876f776f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b943ba0c640461e94943764f95458f8'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:00.258515 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c6c658b2-d38c-472b-a580-7c3876f776f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b943ba0c640461e94943764f95458f8'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:00.289559 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1129/2263] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:28:00 2022] DELETE /identity/v3/users/3b943ba0c640461e94943764f95458f8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:00.562418 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a7731-c141-4dc5-8eb9-01a263c561e2 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:00.587708 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a7731-c141-4dc5-8eb9-01a263c561e2 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:00.675015 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d6d1d-8102-43d3-a917-b8a1acdcb50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:00.675806 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d6d1d-8102-43d3-a917-b8a1acdcb50e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:00.676097 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d6d1d-8102-43d3-a917-b8a1acdcb50e admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:00.676645 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d6d1d-8102-43d3-a917-b8a1acdcb50e admin admin] PATH_INFO: `/v3/projects/d5a99059e0694a6f91e0cffa23ec52d8` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:00.677804 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d6d1d-8102-43d3-a917-b8a1acdcb50e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5a99059e0694a6f91e0cffa23ec52d8)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:00.679791 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d6d1d-8102-43d3-a917-b8a1acdcb50e admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:00.706142 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:00.910966 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-fa8d6d1d-8102-43d3-a917-b8a1acdcb50e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5a99059e0694a6f91e0cffa23ec52d8', 'request_id': 'req-fa8d6d1d-8102-43d3-a917-b8a1acdcb50e'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:00.921497 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-fa8d6d1d-8102-43d3-a917-b8a1acdcb50e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5a99059e0694a6f91e0cffa23ec52d8', 'request_id': 'req-fa8d6d1d-8102-43d3-a917-b8a1acdcb50e'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:00.930868 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-fa8d6d1d-8102-43d3-a917-b8a1acdcb50e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5a99059e0694a6f91e0cffa23ec52d8', 'request_id': 'req-fa8d6d1d-8102-43d3-a917-b8a1acdcb50e'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:00.943621 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-fa8d6d1d-8102-43d3-a917-b8a1acdcb50e admin admin] The token cache is being invalidate because project d5a99059e0694a6f91e0cffa23ec52d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:28:00.943914 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-fa8d6d1d-8102-43d3-a917-b8a1acdcb50e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:00.944568 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-fa8d6d1d-8102-43d3-a917-b8a1acdcb50e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:00.946422 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1135/2264] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:28:00 2022] DELETE /identity/v3/projects/d5a99059e0694a6f91e0cffa23ec52d8 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:00.951877 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f9e77-f63a-4354-82de-22b7b2ea7721 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:00.952167 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f9e77-f63a-4354-82de-22b7b2ea7721 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:00.952451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f9e77-f63a-4354-82de-22b7b2ea7721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:00.978081 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-808f9e77-f63a-4354-82de-22b7b2ea7721 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:00.979505 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-808f9e77-f63a-4354-82de-22b7b2ea7721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:01.081888 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1130/2265] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:01.087240 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30962a-773e-400e-aa48-73e3e3a6f4ea None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:01.087581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30962a-773e-400e-aa48-73e3e3a6f4ea None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:01.087830 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30962a-773e-400e-aa48-73e3e3a6f4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:01.109770 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-ef30962a-773e-400e-aa48-73e3e3a6f4ea None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:01.111069 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ef30962a-773e-400e-aa48-73e3e3a6f4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:01.120001 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1136/2266] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:28:01.124720 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f9e77-f63a-4354-82de-22b7b2ea7721 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:01.135143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f9e77-f63a-4354-82de-22b7b2ea7721 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:01.136123 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:01.142719 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd4a49-c5ab-4c28-8965-7f8b4ffc72c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:01.143525 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd4a49-c5ab-4c28-8965-7f8b4ffc72c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:01.144086 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd4a49-c5ab-4c28-8965-7f8b4ffc72c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:01.144603 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd4a49-c5ab-4c28-8965-7f8b4ffc72c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:01.146029 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd4a49-c5ab-4c28-8965-7f8b4ffc72c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:28:01.146506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd4a49-c5ab-4c28-8965-7f8b4ffc72c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:01.148964 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd4a49-c5ab-4c28-8965-7f8b4ffc72c9 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:01.162951 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1131/2267] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:28:01.167342 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30962a-773e-400e-aa48-73e3e3a6f4ea None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:01.177491 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30962a-773e-400e-aa48-73e3e3a6f4ea None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:01.182460 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c01a5-184a-4193-b311-9fd8f1ea7014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:01.183058 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c01a5-184a-4193-b311-9fd8f1ea7014 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:01.183856 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c01a5-184a-4193-b311-9fd8f1ea7014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:01.184134 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c01a5-184a-4193-b311-9fd8f1ea7014 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:01.184833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c01a5-184a-4193-b311-9fd8f1ea7014 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:01.186802 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c01a5-184a-4193-b311-9fd8f1ea7014 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:01.221607 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1137/2268] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:28:01 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:28:01.222918 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd4a49-c5ab-4c28-8965-7f8b4ffc72c9 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:01.238105 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd4a49-c5ab-4c28-8965-7f8b4ffc72c9 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:01.382995 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf1d83-2e59-46c9-9b30-fcdca5b9d600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:01.383701 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf1d83-2e59-46c9-9b30-fcdca5b9d600 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:01.383990 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf1d83-2e59-46c9-9b30-fcdca5b9d600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:01.384267 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf1d83-2e59-46c9-9b30-fcdca5b9d600 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:01.385534 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf1d83-2e59-46c9-9b30-fcdca5b9d600 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:01.389353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf1d83-2e59-46c9-9b30-fcdca5b9d600 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:01.424890 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1132/2269] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:28:01 2022] POST /identity/v3/users => generated 287 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:28:01.429084 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c01a5-184a-4193-b311-9fd8f1ea7014 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:01.448772 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c01a5-184a-4193-b311-9fd8f1ea7014 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:01.458599 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e86198-d532-4f53-9415-f74b650dcb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:01.459465 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e86198-d532-4f53-9415-f74b650dcb67 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:01.459812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e86198-d532-4f53-9415-f74b650dcb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:01.460185 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e86198-d532-4f53-9415-f74b650dcb67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:01.461044 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e86198-d532-4f53-9415-f74b650dcb67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:01.462942 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e86198-d532-4f53-9415-f74b650dcb67 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:01.479533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1138/2270] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:28:01.481482 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf1d83-2e59-46c9-9b30-fcdca5b9d600 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:01.495088 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf1d83-2e59-46c9-9b30-fcdca5b9d600 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:01.501642 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b02692-7c1d-40bb-932a-131e1a708ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:01.502479 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b02692-7c1d-40bb-932a-131e1a708ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:01.503767 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b02692-7c1d-40bb-932a-131e1a708ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:01.504037 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b02692-7c1d-40bb-932a-131e1a708ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:01.504797 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b02692-7c1d-40bb-932a-131e1a708ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:01.506470 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b02692-7c1d-40bb-932a-131e1a708ae0 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:01.517491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1133/2271] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:28:01.524027 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e86198-d532-4f53-9415-f74b650dcb67 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:01.536208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e86198-d532-4f53-9415-f74b650dcb67 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:01.542521 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7aab2-747a-497e-8967-262280596eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:01.544099 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7aab2-747a-497e-8967-262280596eec admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:01.544257 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7aab2-747a-497e-8967-262280596eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:01.544523 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7aab2-747a-497e-8967-262280596eec admin admin] PATH_INFO: `/v3/projects/20b4f9729ecb4d588edbe1a6381dbdd1/users/f80ecd8a258c4de6a1fc95762ad0b2fe/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:01.571721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc7aab2-747a-497e-8967-262280596eec admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b4f9729ecb4d588edbe1a6381dbdd1, user_id=f80ecd8a258c4de6a1fc95762ad0b2fe, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:01.574538 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc7aab2-747a-497e-8967-262280596eec admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:01.598193 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1139/2272] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:28:01 2022] PUT /identity/v3/projects/20b4f9729ecb4d588edbe1a6381dbdd1/users/f80ecd8a258c4de6a1fc95762ad0b2fe/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:01.604762 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2a736-3f70-4fbf-99ae-a01afdc1b544 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:01.605050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2a736-3f70-4fbf-99ae-a01afdc1b544 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:01.606212 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2a736-3f70-4fbf-99ae-a01afdc1b544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:01.647622 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-e6e2a736-3f70-4fbf-99ae-a01afdc1b544 None None] MFA Rules not processed for user `f80ecd8a258c4de6a1fc95762ad0b2fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:01.649561 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e6e2a736-3f70-4fbf-99ae-a01afdc1b544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:01.726707 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1134/2273] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:01.731327 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7aab2-747a-497e-8967-262280596eec admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:01.811364 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7aab2-747a-497e-8967-262280596eec admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:01.817618 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24491fe-7de8-4dab-8794-226b741f7dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:01.818350 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24491fe-7de8-4dab-8794-226b741f7dfd admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:01.818644 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24491fe-7de8-4dab-8794-226b741f7dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:01.818944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24491fe-7de8-4dab-8794-226b741f7dfd admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:01.819608 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24491fe-7de8-4dab-8794-226b741f7dfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:01.821554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24491fe-7de8-4dab-8794-226b741f7dfd admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:01.860465 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1140/2274] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:28:01 2022] POST /identity/v3/projects => generated 369 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:28:01.864693 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2a736-3f70-4fbf-99ae-a01afdc1b544 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:01.876940 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2a736-3f70-4fbf-99ae-a01afdc1b544 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:01.951002 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8fc4c-637c-45d7-8e4f-830777bf85ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:01.951990 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8fc4c-637c-45d7-8e4f-830777bf85ec admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:01.952411 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8fc4c-637c-45d7-8e4f-830777bf85ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:01.952817 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8fc4c-637c-45d7-8e4f-830777bf85ec admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:01.953921 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8fc4c-637c-45d7-8e4f-830777bf85ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:01.957018 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8fc4c-637c-45d7-8e4f-830777bf85ec admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:01.966813 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:01.986257 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1135/2275] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:28:01 2022] POST /identity/v3/users => generated 291 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:28:01.990808 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24491fe-7de8-4dab-8794-226b741f7dfd admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:02.002792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24491fe-7de8-4dab-8794-226b741f7dfd admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:02.008092 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05516265-a34c-4b3d-8cba-fbecc1663287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:02.008804 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05516265-a34c-4b3d-8cba-fbecc1663287 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:02.009071 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05516265-a34c-4b3d-8cba-fbecc1663287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:02.009348 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05516265-a34c-4b3d-8cba-fbecc1663287 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:02.010133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05516265-a34c-4b3d-8cba-fbecc1663287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:02.012450 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05516265-a34c-4b3d-8cba-fbecc1663287 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:02.024191 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1141/2276] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:28:02.028455 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8fc4c-637c-45d7-8e4f-830777bf85ec admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:02.039805 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8fc4c-637c-45d7-8e4f-830777bf85ec admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:02.044631 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435c7fc-8996-41ff-8248-5c526a97451d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:02.045551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435c7fc-8996-41ff-8248-5c526a97451d admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:02.045968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435c7fc-8996-41ff-8248-5c526a97451d admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:02.046297 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435c7fc-8996-41ff-8248-5c526a97451d admin admin] PATH_INFO: `/v3/projects/3c5346a2bf72444a86e0fb6488a5e402/users/9fe378b363314c1a987319ea9e0ef292/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:02.074870 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2435c7fc-8996-41ff-8248-5c526a97451d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c5346a2bf72444a86e0fb6488a5e402, user_id=9fe378b363314c1a987319ea9e0ef292, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:02.079612 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2435c7fc-8996-41ff-8248-5c526a97451d admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:02.111205 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1136/2277] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:28:02 2022] PUT /identity/v3/projects/3c5346a2bf72444a86e0fb6488a5e402/users/9fe378b363314c1a987319ea9e0ef292/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:02.116354 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05516265-a34c-4b3d-8cba-fbecc1663287 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:02.127765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05516265-a34c-4b3d-8cba-fbecc1663287 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:02.146905 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:02.197572 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a74e8-0e3c-4d9b-8aea-e508a86415e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:02.198277 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a74e8-0e3c-4d9b-8aea-e508a86415e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:02.198559 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a74e8-0e3c-4d9b-8aea-e508a86415e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:02.198878 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a74e8-0e3c-4d9b-8aea-e508a86415e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:02.199662 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a74e8-0e3c-4d9b-8aea-e508a86415e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:02.201493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a74e8-0e3c-4d9b-8aea-e508a86415e1 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:02.212575 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1142/2278] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:28:02.217578 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435c7fc-8996-41ff-8248-5c526a97451d admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:02.229679 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435c7fc-8996-41ff-8248-5c526a97451d admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:02.235250 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b63a6-4d81-4fe7-8f08-d0b9a12fe3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:02.236247 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b63a6-4d81-4fe7-8f08-d0b9a12fe3f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:02.236654 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b63a6-4d81-4fe7-8f08-d0b9a12fe3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:02.236950 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b63a6-4d81-4fe7-8f08-d0b9a12fe3f2 admin admin] PATH_INFO: `/v3/projects/3c5346a2bf72444a86e0fb6488a5e402/users/9fe378b363314c1a987319ea9e0ef292/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:02.239316 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b63a6-4d81-4fe7-8f08-d0b9a12fe3f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c5346a2bf72444a86e0fb6488a5e402, user_id=9fe378b363314c1a987319ea9e0ef292, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:02.242146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b63a6-4d81-4fe7-8f08-d0b9a12fe3f2 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:02.253814 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1137/2279] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:28:02 2022] PUT /identity/v3/projects/3c5346a2bf72444a86e0fb6488a5e402/users/9fe378b363314c1a987319ea9e0ef292/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:02.264820 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd516ea-ad8d-4e3d-9539-52c70bd48e1e None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:02.265113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd516ea-ad8d-4e3d-9539-52c70bd48e1e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:02.265423 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd516ea-ad8d-4e3d-9539-52c70bd48e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:02.298350 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-cbd516ea-ad8d-4e3d-9539-52c70bd48e1e None None] MFA Rules not processed for user `9fe378b363314c1a987319ea9e0ef292`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:02.300256 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-cbd516ea-ad8d-4e3d-9539-52c70bd48e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:02.375549 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1143/2280] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:02 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:02.387645 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b63a6-4d81-4fe7-8f08-d0b9a12fe3f2 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:02.389363 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e62b63a6-4d81-4fe7-8f08-d0b9a12fe3f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:02.480743 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b63a6-4d81-4fe7-8f08-d0b9a12fe3f2 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:02.485229 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0e56d-45e4-4059-95e1-096c736c68c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:02.486091 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0e56d-45e4-4059-95e1-096c736c68c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:02.486473 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0e56d-45e4-4059-95e1-096c736c68c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:02.486992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0e56d-45e4-4059-95e1-096c736c68c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:02.498125 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e0e56d-45e4-4059-95e1-096c736c68c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:02.499779 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e0e56d-45e4-4059-95e1-096c736c68c4 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:02.515962 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1138/2281] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:28:02 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:28:02.726740 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae839e72-9b8b-4911-9ce8-b7641bf1ad24 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:02.727204 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae839e72-9b8b-4911-9ce8-b7641bf1ad24 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:02.727546 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae839e72-9b8b-4911-9ce8-b7641bf1ad24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:02.749074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-ae839e72-9b8b-4911-9ce8-b7641bf1ad24 None None] MFA Rules not processed for user `0c58a96bc78b4fa3a643125a6140bb00`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:02.759378 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ae839e72-9b8b-4911-9ce8-b7641bf1ad24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:02.873393 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1144/2282] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:03.063366 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0e56d-45e4-4059-95e1-096c736c68c4 service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:03.138057 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0e56d-45e4-4059-95e1-096c736c68c4 service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:03.143368 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad637760-aa78-46d8-a6f8-ab70fb52e9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:03.144389 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad637760-aa78-46d8-a6f8-ab70fb52e9ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:03.144663 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad637760-aa78-46d8-a6f8-ab70fb52e9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:03.144935 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad637760-aa78-46d8-a6f8-ab70fb52e9ef admin admin] PATH_INFO: `/v3/users/f80ecd8a258c4de6a1fc95762ad0b2fe` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:03.146200 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad637760-aa78-46d8-a6f8-ab70fb52e9ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=f80ecd8a258c4de6a1fc95762ad0b2fe)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:03.148178 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad637760-aa78-46d8-a6f8-ab70fb52e9ef admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:03.204653 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ad637760-aa78-46d8-a6f8-ab70fb52e9ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f80ecd8a258c4de6a1fc95762ad0b2fe'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:03.213488 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ad637760-aa78-46d8-a6f8-ab70fb52e9ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f80ecd8a258c4de6a1fc95762ad0b2fe'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:03.215141 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ad637760-aa78-46d8-a6f8-ab70fb52e9ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f80ecd8a258c4de6a1fc95762ad0b2fe'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:03.216121 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:03.233748 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ad637760-aa78-46d8-a6f8-ab70fb52e9ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f80ecd8a258c4de6a1fc95762ad0b2fe'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:03.235609 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ad637760-aa78-46d8-a6f8-ab70fb52e9ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f80ecd8a258c4de6a1fc95762ad0b2fe'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:03.256625 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1139/2283] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:28:03 2022] DELETE /identity/v3/users/f80ecd8a258c4de6a1fc95762ad0b2fe => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:03.260991 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb7dea-5448-4c93-8485-22f9bb20df1d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:03.261880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb7dea-5448-4c93-8485-22f9bb20df1d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:03.262636 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb7dea-5448-4c93-8485-22f9bb20df1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:03.280637 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-afeb7dea-5448-4c93-8485-22f9bb20df1d None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:03.281890 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-afeb7dea-5448-4c93-8485-22f9bb20df1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:03.336627 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:03.358649 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1145/2284] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:28:03.368532 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad637760-aa78-46d8-a6f8-ab70fb52e9ef admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:03.370522 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ad637760-aa78-46d8-a6f8-ab70fb52e9ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:03.447916 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad637760-aa78-46d8-a6f8-ab70fb52e9ef admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:03.454877 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1daad-841a-40cc-a467-df418a67ad75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:03.456037 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1daad-841a-40cc-a467-df418a67ad75 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:03.456551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1daad-841a-40cc-a467-df418a67ad75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:03.457082 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1daad-841a-40cc-a467-df418a67ad75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:03.475231 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1daad-841a-40cc-a467-df418a67ad75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:03.477963 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1daad-841a-40cc-a467-df418a67ad75 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:03.501971 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1140/2285] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:28:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:28:03.885946 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb7dea-5448-4c93-8485-22f9bb20df1d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:03.887623 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-afeb7dea-5448-4c93-8485-22f9bb20df1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:03.943069 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb7dea-5448-4c93-8485-22f9bb20df1d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:03.960315 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c590f4-5645-4ce0-957c-515812dfd34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:03.961206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c590f4-5645-4ce0-957c-515812dfd34f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:03.961488 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c590f4-5645-4ce0-957c-515812dfd34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:03.962025 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c590f4-5645-4ce0-957c-515812dfd34f admin admin] PATH_INFO: `/v3/projects/20b4f9729ecb4d588edbe1a6381dbdd1` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:03.966777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c590f4-5645-4ce0-957c-515812dfd34f admin admin] RBAC: Authorizing `identity:delete_project(project_id=20b4f9729ecb4d588edbe1a6381dbdd1)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:03.969243 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c590f4-5645-4ce0-957c-515812dfd34f admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:04.037186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-27c590f4-5645-4ce0-957c-515812dfd34f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20b4f9729ecb4d588edbe1a6381dbdd1', 'request_id': 'req-27c590f4-5645-4ce0-957c-515812dfd34f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:04.046233 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-27c590f4-5645-4ce0-957c-515812dfd34f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20b4f9729ecb4d588edbe1a6381dbdd1', 'request_id': 'req-27c590f4-5645-4ce0-957c-515812dfd34f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:04.060982 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-27c590f4-5645-4ce0-957c-515812dfd34f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20b4f9729ecb4d588edbe1a6381dbdd1', 'request_id': 'req-27c590f4-5645-4ce0-957c-515812dfd34f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:04.082099 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-27c590f4-5645-4ce0-957c-515812dfd34f admin admin] The token cache is being invalidate because project 20b4f9729ecb4d588edbe1a6381dbdd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:28:04.082539 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-27c590f4-5645-4ce0-957c-515812dfd34f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:04.083249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-27c590f4-5645-4ce0-957c-515812dfd34f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:04.084995 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1146/2286] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:28:03 2022] DELETE /identity/v3/projects/20b4f9729ecb4d588edbe1a6381dbdd1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:04.089141 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1daad-841a-40cc-a467-df418a67ad75 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:04.101045 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1daad-841a-40cc-a467-df418a67ad75 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:04.177467 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300f303-34da-4324-8a57-89975d4c7388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:04.178480 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300f303-34da-4324-8a57-89975d4c7388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:04.179389 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300f303-34da-4324-8a57-89975d4c7388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:04.179738 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300f303-34da-4324-8a57-89975d4c7388 admin admin] PATH_INFO: `/v3/users/9fe378b363314c1a987319ea9e0ef292` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:04.181476 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300f303-34da-4324-8a57-89975d4c7388 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fe378b363314c1a987319ea9e0ef292)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:04.184253 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300f303-34da-4324-8a57-89975d4c7388 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:04.288747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-8300f303-34da-4324-8a57-89975d4c7388 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fe378b363314c1a987319ea9e0ef292'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:04.299572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-8300f303-34da-4324-8a57-89975d4c7388 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fe378b363314c1a987319ea9e0ef292'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:04.300695 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-8300f303-34da-4324-8a57-89975d4c7388 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fe378b363314c1a987319ea9e0ef292'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:04.321204 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-8300f303-34da-4324-8a57-89975d4c7388 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fe378b363314c1a987319ea9e0ef292'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:04.322331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-8300f303-34da-4324-8a57-89975d4c7388 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fe378b363314c1a987319ea9e0ef292'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:04.327604 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:04.352743 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1141/2287] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:28:04 2022] DELETE /identity/v3/users/9fe378b363314c1a987319ea9e0ef292 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:04.352948 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c590f4-5645-4ce0-957c-515812dfd34f admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:04.358949 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-27c590f4-5645-4ce0-957c-515812dfd34f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:04.440247 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c590f4-5645-4ce0-957c-515812dfd34f admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:04.510025 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553b3ed-7362-446d-86bc-7779220810ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fb6720f0d0141fea795cecfbf6f2538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:04.510766 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553b3ed-7362-446d-86bc-7779220810ac service placement] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:04.511071 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553b3ed-7362-446d-86bc-7779220810ac service placement] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:04.511946 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553b3ed-7362-446d-86bc-7779220810ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:04.514008 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e553b3ed-7362-446d-86bc-7779220810ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:04.528070 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553b3ed-7362-446d-86bc-7779220810ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:04.530524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553b3ed-7362-446d-86bc-7779220810ac service placement] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:04.544631 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1147/2288] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:28:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:28:04.663574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300f303-34da-4324-8a57-89975d4c7388 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:04.664956 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8300f303-34da-4324-8a57-89975d4c7388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:04.761075 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300f303-34da-4324-8a57-89975d4c7388 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:04.766481 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7f426-0ba9-4968-9ae6-131e77f9055d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:04.767353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7f426-0ba9-4968-9ae6-131e77f9055d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:04.768519 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7f426-0ba9-4968-9ae6-131e77f9055d admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:04.768519 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7f426-0ba9-4968-9ae6-131e77f9055d admin admin] PATH_INFO: `/v3/projects/3c5346a2bf72444a86e0fb6488a5e402` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:04.769671 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7f426-0ba9-4968-9ae6-131e77f9055d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c5346a2bf72444a86e0fb6488a5e402)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:04.771977 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7f426-0ba9-4968-9ae6-131e77f9055d admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:04.841982 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-92e7f426-0ba9-4968-9ae6-131e77f9055d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c5346a2bf72444a86e0fb6488a5e402', 'request_id': 'req-92e7f426-0ba9-4968-9ae6-131e77f9055d'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:04.852094 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-92e7f426-0ba9-4968-9ae6-131e77f9055d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c5346a2bf72444a86e0fb6488a5e402', 'request_id': 'req-92e7f426-0ba9-4968-9ae6-131e77f9055d'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:04.858566 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-92e7f426-0ba9-4968-9ae6-131e77f9055d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c5346a2bf72444a86e0fb6488a5e402', 'request_id': 'req-92e7f426-0ba9-4968-9ae6-131e77f9055d'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:04.871400 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-92e7f426-0ba9-4968-9ae6-131e77f9055d admin admin] The token cache is being invalidate because project 3c5346a2bf72444a86e0fb6488a5e402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:28:04.871702 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-92e7f426-0ba9-4968-9ae6-131e77f9055d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:04.872385 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-92e7f426-0ba9-4968-9ae6-131e77f9055d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:04.874316 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1142/2289] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:28:04 2022] DELETE /identity/v3/projects/3c5346a2bf72444a86e0fb6488a5e402 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:04.878981 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6db303-cf46-4854-a0aa-e858a0599715 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:04.879275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6db303-cf46-4854-a0aa-e858a0599715 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:04.879564 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6db303-cf46-4854-a0aa-e858a0599715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:04.885939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:04.901041 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-3f6db303-cf46-4854-a0aa-e858a0599715 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:04.906356 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3f6db303-cf46-4854-a0aa-e858a0599715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:04.978012 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1148/2290] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:04.986432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c76b12-6241-4c60-b725-4e1e7d2de30b None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:04.987057 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c76b12-6241-4c60-b725-4e1e7d2de30b None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:04.987518 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c76b12-6241-4c60-b725-4e1e7d2de30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:05.012512 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-93c76b12-6241-4c60-b725-4e1e7d2de30b None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:05.014097 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-93c76b12-6241-4c60-b725-4e1e7d2de30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:05.024272 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1143/2291] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:05.028859 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6db303-cf46-4854-a0aa-e858a0599715 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:05.040968 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6db303-cf46-4854-a0aa-e858a0599715 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:05.046886 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e8452-1c22-4a21-91d5-35ba02110cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:05.047639 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e8452-1c22-4a21-91d5-35ba02110cca admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:05.048197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e8452-1c22-4a21-91d5-35ba02110cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:05.048587 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e8452-1c22-4a21-91d5-35ba02110cca admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:05.049416 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e8452-1c22-4a21-91d5-35ba02110cca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:28:05.049956 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e8452-1c22-4a21-91d5-35ba02110cca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:05.051823 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e8452-1c22-4a21-91d5-35ba02110cca admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:05.065748 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1149/2292] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:28:05.070441 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c76b12-6241-4c60-b725-4e1e7d2de30b None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:05.083114 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c76b12-6241-4c60-b725-4e1e7d2de30b None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:05.090769 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50accd04-801b-40fa-8745-f1fd1432d0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:05.092412 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50accd04-801b-40fa-8745-f1fd1432d0da admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:05.093052 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50accd04-801b-40fa-8745-f1fd1432d0da admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:05.093340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50accd04-801b-40fa-8745-f1fd1432d0da admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:05.094108 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50accd04-801b-40fa-8745-f1fd1432d0da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:05.096037 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50accd04-801b-40fa-8745-f1fd1432d0da admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:05.129853 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1144/2293] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:28:05 2022] POST /identity/v3/projects => generated 357 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:28:05.132694 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e8452-1c22-4a21-91d5-35ba02110cca admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:05.143674 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e8452-1c22-4a21-91d5-35ba02110cca admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:05.209328 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20f8fc-341a-48d0-8dc1-b2fa7c41cf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:05.210044 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20f8fc-341a-48d0-8dc1-b2fa7c41cf37 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:05.210643 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20f8fc-341a-48d0-8dc1-b2fa7c41cf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:05.210643 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20f8fc-341a-48d0-8dc1-b2fa7c41cf37 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:05.211457 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20f8fc-341a-48d0-8dc1-b2fa7c41cf37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:05.213621 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20f8fc-341a-48d0-8dc1-b2fa7c41cf37 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:05.239103 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1150/2294] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:28:05 2022] POST /identity/v3/users => generated 279 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:28:05.243266 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50accd04-801b-40fa-8745-f1fd1432d0da admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:05.255687 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50accd04-801b-40fa-8745-f1fd1432d0da admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:05.261108 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7596ac6-7be4-4a5c-8b90-dc392873495c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:05.261924 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7596ac6-7be4-4a5c-8b90-dc392873495c admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:05.262147 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7596ac6-7be4-4a5c-8b90-dc392873495c admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:05.262422 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7596ac6-7be4-4a5c-8b90-dc392873495c admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:05.263158 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7596ac6-7be4-4a5c-8b90-dc392873495c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:05.264769 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7596ac6-7be4-4a5c-8b90-dc392873495c admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:05.277466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1145/2295] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:28:05.281525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20f8fc-341a-48d0-8dc1-b2fa7c41cf37 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:05.295297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20f8fc-341a-48d0-8dc1-b2fa7c41cf37 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:05.301399 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10274efd-ed7a-422d-8e0d-f8f76aa3a5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:05.302172 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10274efd-ed7a-422d-8e0d-f8f76aa3a5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:05.302469 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10274efd-ed7a-422d-8e0d-f8f76aa3a5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:05.302757 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10274efd-ed7a-422d-8e0d-f8f76aa3a5c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:05.303479 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10274efd-ed7a-422d-8e0d-f8f76aa3a5c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:05.305132 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10274efd-ed7a-422d-8e0d-f8f76aa3a5c4 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:05.321182 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1151/2296] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:28:05.322251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7596ac6-7be4-4a5c-8b90-dc392873495c admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:05.336833 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7596ac6-7be4-4a5c-8b90-dc392873495c admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:05.345931 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f1445-abeb-404f-8c6a-9ef171448ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:05.346991 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f1445-abeb-404f-8c6a-9ef171448ff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:05.347321 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f1445-abeb-404f-8c6a-9ef171448ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:05.347601 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f1445-abeb-404f-8c6a-9ef171448ff6 admin admin] PATH_INFO: `/v3/projects/79b5923e16864ccca2ee41f537548738/users/095932642701440d873dddc7778e03fe/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:05.372764 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f1445-abeb-404f-8c6a-9ef171448ff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79b5923e16864ccca2ee41f537548738, user_id=095932642701440d873dddc7778e03fe, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:05.376294 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f1445-abeb-404f-8c6a-9ef171448ff6 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:05.396682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1146/2297] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:28:05 2022] PUT /identity/v3/projects/79b5923e16864ccca2ee41f537548738/users/095932642701440d873dddc7778e03fe/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:05.411376 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c46eb1-0485-4145-b89e-bf585f1d6443 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:05.412005 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c46eb1-0485-4145-b89e-bf585f1d6443 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:05.412823 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c46eb1-0485-4145-b89e-bf585f1d6443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:05.447495 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-95c46eb1-0485-4145-b89e-bf585f1d6443 None None] MFA Rules not processed for user `095932642701440d873dddc7778e03fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:05.449165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-95c46eb1-0485-4145-b89e-bf585f1d6443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:05.534187 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:05.569799 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f1445-abeb-404f-8c6a-9ef171448ff6 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:05.570349 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1152/2298] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:05 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:05.606862 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:05.628129 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c46eb1-0485-4145-b89e-bf585f1d6443 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:05.629735 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-95c46eb1-0485-4145-b89e-bf585f1d6443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:05.716336 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f1445-abeb-404f-8c6a-9ef171448ff6 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:05.728065 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ab3ed-df35-4939-bcae-2ec5e8652ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:05.728911 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ab3ed-df35-4939-bcae-2ec5e8652ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:05.732196 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ab3ed-df35-4939-bcae-2ec5e8652ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:05.732715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ab3ed-df35-4939-bcae-2ec5e8652ff7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:05.734672 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ab3ed-df35-4939-bcae-2ec5e8652ff7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:05.739828 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ab3ed-df35-4939-bcae-2ec5e8652ff7 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:05.747879 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c46eb1-0485-4145-b89e-bf585f1d6443 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:05.760191 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8eb6a2-67e8-4229-a389-4df489890476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:05.761108 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eb6a2-67e8-4229-a389-4df489890476 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:05.761392 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eb6a2-67e8-4229-a389-4df489890476 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:05.761669 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eb6a2-67e8-4229-a389-4df489890476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:05.764645 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-bf8eb6a2-67e8-4229-a389-4df489890476 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:05.778483 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8eb6a2-67e8-4229-a389-4df489890476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:05.780410 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8eb6a2-67e8-4229-a389-4df489890476 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:05.788805 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1147/2299] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:28:05 2022] POST /identity/v3/projects => generated 357 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:28:05.794040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ab3ed-df35-4939-bcae-2ec5e8652ff7 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:05.795644 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1153/2300] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:28:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:28:05.869580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ab3ed-df35-4939-bcae-2ec5e8652ff7 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:05.874440 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e00de7-f34f-4343-8d28-17a1d47e6cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:05.875128 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e00de7-f34f-4343-8d28-17a1d47e6cad admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:05.875776 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e00de7-f34f-4343-8d28-17a1d47e6cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:05.875776 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e00de7-f34f-4343-8d28-17a1d47e6cad admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:05.876397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e00de7-f34f-4343-8d28-17a1d47e6cad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:05.878399 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e00de7-f34f-4343-8d28-17a1d47e6cad admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:05.903438 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1148/2301] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:28:05 2022] POST /identity/v3/users => generated 285 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:28:05.905352 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8eb6a2-67e8-4229-a389-4df489890476 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:05.922087 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8eb6a2-67e8-4229-a389-4df489890476 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:05.928098 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c68aff-b68f-4670-9107-9c01aa2581c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:05.929008 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c68aff-b68f-4670-9107-9c01aa2581c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:05.929305 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c68aff-b68f-4670-9107-9c01aa2581c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:05.929584 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c68aff-b68f-4670-9107-9c01aa2581c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:05.930346 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c68aff-b68f-4670-9107-9c01aa2581c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:05.931974 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c68aff-b68f-4670-9107-9c01aa2581c7 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:05.942815 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1154/2302] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:28:05.946922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e00de7-f34f-4343-8d28-17a1d47e6cad admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:05.959951 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e00de7-f34f-4343-8d28-17a1d47e6cad admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:05.966491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd9de2-a8e6-4982-953e-d00ec9c1972c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:05.967448 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd9de2-a8e6-4982-953e-d00ec9c1972c admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:05.967732 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd9de2-a8e6-4982-953e-d00ec9c1972c admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:05.968015 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd9de2-a8e6-4982-953e-d00ec9c1972c admin admin] PATH_INFO: `/v3/projects/33d18448088d400496d840ff05333a28/users/1661c9926f834e3f96944f99ffba8a7b/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:05.985405 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd9de2-a8e6-4982-953e-d00ec9c1972c admin admin] RBAC: Authorizing `identity:create_grant(project_id=33d18448088d400496d840ff05333a28, user_id=1661c9926f834e3f96944f99ffba8a7b, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:05.988388 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd9de2-a8e6-4982-953e-d00ec9c1972c admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:06.001880 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1149/2303] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:28:05 2022] PUT /identity/v3/projects/33d18448088d400496d840ff05333a28/users/1661c9926f834e3f96944f99ffba8a7b/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:06.006053 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c68aff-b68f-4670-9107-9c01aa2581c7 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:06.016864 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c68aff-b68f-4670-9107-9c01aa2581c7 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:06.076487 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000e490-a121-45ce-b574-60502e249939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:06.077163 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000e490-a121-45ce-b574-60502e249939 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:06.077449 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000e490-a121-45ce-b574-60502e249939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:06.077721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000e490-a121-45ce-b574-60502e249939 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:06.078478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000e490-a121-45ce-b574-60502e249939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:06.080105 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000e490-a121-45ce-b574-60502e249939 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:06.091203 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1155/2304] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:28:06.095413 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd9de2-a8e6-4982-953e-d00ec9c1972c admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:06.105675 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd9de2-a8e6-4982-953e-d00ec9c1972c admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:06.110497 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f586a7-ff1f-4488-99e4-48621b962903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:06.111257 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f586a7-ff1f-4488-99e4-48621b962903 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:06.111537 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f586a7-ff1f-4488-99e4-48621b962903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:06.111811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f586a7-ff1f-4488-99e4-48621b962903 admin admin] PATH_INFO: `/v3/projects/33d18448088d400496d840ff05333a28/users/1661c9926f834e3f96944f99ffba8a7b/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:06.113768 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f586a7-ff1f-4488-99e4-48621b962903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33d18448088d400496d840ff05333a28, user_id=1661c9926f834e3f96944f99ffba8a7b, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:06.116416 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f586a7-ff1f-4488-99e4-48621b962903 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:06.126900 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1150/2305] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:28:06 2022] PUT /identity/v3/projects/33d18448088d400496d840ff05333a28/users/1661c9926f834e3f96944f99ffba8a7b/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:06.137916 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0833498-8e36-49b0-bbef-bd4aaac1e888 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:06.138209 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0833498-8e36-49b0-bbef-bd4aaac1e888 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:06.138487 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0833498-8e36-49b0-bbef-bd4aaac1e888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:06.166074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-d0833498-8e36-49b0-bbef-bd4aaac1e888 None None] MFA Rules not processed for user `1661c9926f834e3f96944f99ffba8a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:06.167289 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d0833498-8e36-49b0-bbef-bd4aaac1e888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:06.238018 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1156/2306] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:06 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:06.248999 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f586a7-ff1f-4488-99e4-48621b962903 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:06.250732 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-51f586a7-ff1f-4488-99e4-48621b962903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:06.315179 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f586a7-ff1f-4488-99e4-48621b962903 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:06.319119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e0ccc-5edf-40f8-9c01-bf68b0e1d38d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:06.319766 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e0ccc-5edf-40f8-9c01-bf68b0e1d38d service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:06.320045 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e0ccc-5edf-40f8-9c01-bf68b0e1d38d service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:06.320320 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e0ccc-5edf-40f8-9c01-bf68b0e1d38d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:06.330475 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e0ccc-5edf-40f8-9c01-bf68b0e1d38d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:06.331908 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e0ccc-5edf-40f8-9c01-bf68b0e1d38d service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:06.342101 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1151/2307] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:28:06 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:28:06.413812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0833498-8e36-49b0-bbef-bd4aaac1e888 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:06.423765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0833498-8e36-49b0-bbef-bd4aaac1e888 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:06.427598 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb31940-e6aa-4362-bc3f-99b02b18e5bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:06.428265 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb31940-e6aa-4362-bc3f-99b02b18e5bd service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:06.428544 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb31940-e6aa-4362-bc3f-99b02b18e5bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:06.428818 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb31940-e6aa-4362-bc3f-99b02b18e5bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:06.437977 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:06.488437 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb31940-e6aa-4362-bc3f-99b02b18e5bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:06.490042 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb31940-e6aa-4362-bc3f-99b02b18e5bd service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:06.499780 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1157/2308] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:28:06 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:28:13.315872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239d2a0-c78f-492f-a9c1-0508080b2736 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:13.316511 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239d2a0-c78f-492f-a9c1-0508080b2736 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:13.316626 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239d2a0-c78f-492f-a9c1-0508080b2736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:13.323135 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:13.339924 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-9239d2a0-c78f-492f-a9c1-0508080b2736 None None] MFA Rules not processed for user `93baaa9e849b40b199d567615f7e1c94`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:13.341145 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-9239d2a0-c78f-492f-a9c1-0508080b2736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:13.399310 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1152/2309] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:13.719050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb31940-e6aa-4362-bc3f-99b02b18e5bd service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:13.720512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0bb31940-e6aa-4362-bc3f-99b02b18e5bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:13.805459 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb31940-e6aa-4362-bc3f-99b02b18e5bd service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:13.810267 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51669d35-41d8-4258-a41b-f0042e6b3268 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:13.810957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51669d35-41d8-4258-a41b-f0042e6b3268 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:13.811286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51669d35-41d8-4258-a41b-f0042e6b3268 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:13.811562 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51669d35-41d8-4258-a41b-f0042e6b3268 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:13.813701 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-51669d35-41d8-4258-a41b-f0042e6b3268 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:13.827631 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51669d35-41d8-4258-a41b-f0042e6b3268 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:13.829388 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51669d35-41d8-4258-a41b-f0042e6b3268 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:13.839958 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1158/2310] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:28:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:28:16.669105 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239d2a0-c78f-492f-a9c1-0508080b2736 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:16.670748 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-9239d2a0-c78f-492f-a9c1-0508080b2736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:16.687858 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239d2a0-c78f-492f-a9c1-0508080b2736 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:16.693228 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da4c34-9bf8-439b-b73d-8e7012e64225 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:16.694057 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da4c34-9bf8-439b-b73d-8e7012e64225 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:16.694911 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da4c34-9bf8-439b-b73d-8e7012e64225 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:16.695463 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da4c34-9bf8-439b-b73d-8e7012e64225 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:16.699143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-93da4c34-9bf8-439b-b73d-8e7012e64225 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:16.826542 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da4c34-9bf8-439b-b73d-8e7012e64225 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:16.828173 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da4c34-9bf8-439b-b73d-8e7012e64225 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:16.839079 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1153/2311] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:28:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:28:22.712639 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51669d35-41d8-4258-a41b-f0042e6b3268 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:22.801189 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51669d35-41d8-4258-a41b-f0042e6b3268 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:22.807068 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba708a2c-916b-42df-a7e6-b049886595f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:22.808556 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba708a2c-916b-42df-a7e6-b049886595f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:22.810247 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba708a2c-916b-42df-a7e6-b049886595f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:22.810247 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba708a2c-916b-42df-a7e6-b049886595f9 admin admin] PATH_INFO: `/v3/users/095932642701440d873dddc7778e03fe` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:22.811399 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba708a2c-916b-42df-a7e6-b049886595f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=095932642701440d873dddc7778e03fe)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:22.813751 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba708a2c-916b-42df-a7e6-b049886595f9 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:22.872159 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-ba708a2c-916b-42df-a7e6-b049886595f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '095932642701440d873dddc7778e03fe'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:22.878064 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:22.880600 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-ba708a2c-916b-42df-a7e6-b049886595f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '095932642701440d873dddc7778e03fe'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:22.881731 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-ba708a2c-916b-42df-a7e6-b049886595f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '095932642701440d873dddc7778e03fe'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:22.882981 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-ba708a2c-916b-42df-a7e6-b049886595f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '095932642701440d873dddc7778e03fe'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:22.897963 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-ba708a2c-916b-42df-a7e6-b049886595f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '095932642701440d873dddc7778e03fe'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:22.924082 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1159/2312] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:28:22 2022] DELETE /identity/v3/users/095932642701440d873dddc7778e03fe => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:22.928052 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17c152-470f-482a-8685-511814230d0a None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:22.928538 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17c152-470f-482a-8685-511814230d0a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:22.928770 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17c152-470f-482a-8685-511814230d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:22.949602 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-bc17c152-470f-482a-8685-511814230d0a None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:22.951442 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-bc17c152-470f-482a-8685-511814230d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:23.028669 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1154/2313] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:23.038886 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba708a2c-916b-42df-a7e6-b049886595f9 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:23.040328 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ba708a2c-916b-42df-a7e6-b049886595f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:23.109223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba708a2c-916b-42df-a7e6-b049886595f9 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:23.119195 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1bd35-4252-4333-b78b-765a68eb721a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:23.120132 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1bd35-4252-4333-b78b-765a68eb721a service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:23.120569 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1bd35-4252-4333-b78b-765a68eb721a service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:23.121036 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1bd35-4252-4333-b78b-765a68eb721a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:23.141786 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1bd35-4252-4333-b78b-765a68eb721a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:23.143874 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1bd35-4252-4333-b78b-765a68eb721a service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:23.155474 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1160/2314] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:28:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:28:23.635985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17c152-470f-482a-8685-511814230d0a None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:23.638240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-bc17c152-470f-482a-8685-511814230d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:23.654914 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17c152-470f-482a-8685-511814230d0a None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:23.660298 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab3460-d4cb-421e-9790-7065af30d223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:23.661176 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab3460-d4cb-421e-9790-7065af30d223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:23.661459 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab3460-d4cb-421e-9790-7065af30d223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:23.661738 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab3460-d4cb-421e-9790-7065af30d223 admin admin] PATH_INFO: `/v3/projects/79b5923e16864ccca2ee41f537548738` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:23.663147 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab3460-d4cb-421e-9790-7065af30d223 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79b5923e16864ccca2ee41f537548738)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:23.665483 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab3460-d4cb-421e-9790-7065af30d223 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:23.716473 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:23.724579 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-fdab3460-d4cb-421e-9790-7065af30d223 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79b5923e16864ccca2ee41f537548738', 'request_id': 'req-fdab3460-d4cb-421e-9790-7065af30d223'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:23.732029 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-fdab3460-d4cb-421e-9790-7065af30d223 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79b5923e16864ccca2ee41f537548738', 'request_id': 'req-fdab3460-d4cb-421e-9790-7065af30d223'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:23.740460 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-fdab3460-d4cb-421e-9790-7065af30d223 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79b5923e16864ccca2ee41f537548738', 'request_id': 'req-fdab3460-d4cb-421e-9790-7065af30d223'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:23.753053 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-fdab3460-d4cb-421e-9790-7065af30d223 admin admin] The token cache is being invalidate because project 79b5923e16864ccca2ee41f537548738 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:28:23.753343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-fdab3460-d4cb-421e-9790-7065af30d223 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:23.754100 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-fdab3460-d4cb-421e-9790-7065af30d223 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:23.755729 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1155/2315] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:28:23 2022] DELETE /identity/v3/projects/79b5923e16864ccca2ee41f537548738 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:23.759808 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1bd35-4252-4333-b78b-765a68eb721a service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:23.771439 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1bd35-4252-4333-b78b-765a68eb721a service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:23.827908 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab3460-d4cb-421e-9790-7065af30d223 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:23.829450 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-fdab3460-d4cb-421e-9790-7065af30d223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:23.834589 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f30599-d028-4eae-ba9e-10a68f24690c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:23.835826 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f30599-d028-4eae-ba9e-10a68f24690c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:23.836646 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f30599-d028-4eae-ba9e-10a68f24690c admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:23.836646 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f30599-d028-4eae-ba9e-10a68f24690c admin admin] PATH_INFO: `/v3/users/1661c9926f834e3f96944f99ffba8a7b` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:23.838049 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f30599-d028-4eae-ba9e-10a68f24690c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1661c9926f834e3f96944f99ffba8a7b)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:23.840306 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f30599-d028-4eae-ba9e-10a68f24690c admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:23.897610 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-82f30599-d028-4eae-ba9e-10a68f24690c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1661c9926f834e3f96944f99ffba8a7b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:23.905263 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-82f30599-d028-4eae-ba9e-10a68f24690c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1661c9926f834e3f96944f99ffba8a7b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:23.905940 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-82f30599-d028-4eae-ba9e-10a68f24690c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1661c9926f834e3f96944f99ffba8a7b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:23.906566 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-82f30599-d028-4eae-ba9e-10a68f24690c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1661c9926f834e3f96944f99ffba8a7b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:23.908479 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab3460-d4cb-421e-9790-7065af30d223 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:23.921300 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb12d28-8cdb-4490-bbf3-44aa1dd49705 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:23.922048 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb12d28-8cdb-4490-bbf3-44aa1dd49705 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:23.922418 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb12d28-8cdb-4490-bbf3-44aa1dd49705 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:23.922637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb12d28-8cdb-4490-bbf3-44aa1dd49705 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:23.924807 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-6fb12d28-8cdb-4490-bbf3-44aa1dd49705 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:23.928296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-82f30599-d028-4eae-ba9e-10a68f24690c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1661c9926f834e3f96944f99ffba8a7b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:23.931170 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:23.946413 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1161/2316] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:28:23 2022] DELETE /identity/v3/users/1661c9926f834e3f96944f99ffba8a7b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:24.000533 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb12d28-8cdb-4490-bbf3-44aa1dd49705 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:24.002221 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb12d28-8cdb-4490-bbf3-44aa1dd49705 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:24.012165 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1156/2317] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:28:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:28:24.379154 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f30599-d028-4eae-ba9e-10a68f24690c admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:24.380978 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-82f30599-d028-4eae-ba9e-10a68f24690c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:24.472576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f30599-d028-4eae-ba9e-10a68f24690c admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:24.478139 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d7aa7-8948-479b-bb64-83007d163309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:24.479249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d7aa7-8948-479b-bb64-83007d163309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:24.479716 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d7aa7-8948-479b-bb64-83007d163309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:24.479989 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d7aa7-8948-479b-bb64-83007d163309 admin admin] PATH_INFO: `/v3/projects/33d18448088d400496d840ff05333a28` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:24.482174 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d7aa7-8948-479b-bb64-83007d163309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33d18448088d400496d840ff05333a28)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:24.484417 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d7aa7-8948-479b-bb64-83007d163309 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:24.554903 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-032d7aa7-8948-479b-bb64-83007d163309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33d18448088d400496d840ff05333a28', 'request_id': 'req-032d7aa7-8948-479b-bb64-83007d163309'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:24.563176 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-032d7aa7-8948-479b-bb64-83007d163309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33d18448088d400496d840ff05333a28', 'request_id': 'req-032d7aa7-8948-479b-bb64-83007d163309'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:24.573108 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-032d7aa7-8948-479b-bb64-83007d163309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33d18448088d400496d840ff05333a28', 'request_id': 'req-032d7aa7-8948-479b-bb64-83007d163309'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:24.592714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-032d7aa7-8948-479b-bb64-83007d163309 admin admin] The token cache is being invalidate because project 33d18448088d400496d840ff05333a28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:28:24.593019 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-032d7aa7-8948-479b-bb64-83007d163309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:24.598187 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-032d7aa7-8948-479b-bb64-83007d163309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:24.605109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1162/2318] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:28:24 2022] DELETE /identity/v3/projects/33d18448088d400496d840ff05333a28 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:28:24.610611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453932b4-37e7-48db-981e-75528e579a7f None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:24.611039 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453932b4-37e7-48db-981e-75528e579a7f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:24.611322 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453932b4-37e7-48db-981e-75528e579a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:24.635409 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-453932b4-37e7-48db-981e-75528e579a7f None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:24.637227 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-453932b4-37e7-48db-981e-75528e579a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:24.738958 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1157/2319] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:24.747861 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f488dfa-ab6b-437f-971a-0f232b37922d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:24.748228 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f488dfa-ab6b-437f-971a-0f232b37922d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:24.748602 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f488dfa-ab6b-437f-971a-0f232b37922d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:24.774419 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-2f488dfa-ab6b-437f-971a-0f232b37922d None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:24.775779 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2f488dfa-ab6b-437f-971a-0f232b37922d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:24.786081 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1163/2320] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:24.790117 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453932b4-37e7-48db-981e-75528e579a7f None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:24.811776 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453932b4-37e7-48db-981e-75528e579a7f None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:24.820834 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659a085-a293-44b2-900b-bf1a6027e850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:24.821521 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659a085-a293-44b2-900b-bf1a6027e850 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:24.821806 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659a085-a293-44b2-900b-bf1a6027e850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:24.822251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659a085-a293-44b2-900b-bf1a6027e850 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:24.822990 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659a085-a293-44b2-900b-bf1a6027e850 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:28:24.823298 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659a085-a293-44b2-900b-bf1a6027e850 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:24.825504 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659a085-a293-44b2-900b-bf1a6027e850 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:24.827530 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:24.841786 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1158/2321] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:28:24.846590 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f488dfa-ab6b-437f-971a-0f232b37922d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:24.856533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f488dfa-ab6b-437f-971a-0f232b37922d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:24.861511 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065a60b-5abf-4ee6-a709-fabca16406bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:24.862214 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065a60b-5abf-4ee6-a709-fabca16406bc admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:24.862501 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065a60b-5abf-4ee6-a709-fabca16406bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:24.862794 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065a60b-5abf-4ee6-a709-fabca16406bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:24.863494 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065a60b-5abf-4ee6-a709-fabca16406bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:24.865432 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065a60b-5abf-4ee6-a709-fabca16406bc admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:24.894182 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1164/2322] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:28:24 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:28:24.899205 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659a085-a293-44b2-900b-bf1a6027e850 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:24.916784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659a085-a293-44b2-900b-bf1a6027e850 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:24.988491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7303dc5-5f12-4110-a512-750c93a164d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:24.989203 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7303dc5-5f12-4110-a512-750c93a164d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:24.989479 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7303dc5-5f12-4110-a512-750c93a164d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:24.989758 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7303dc5-5f12-4110-a512-750c93a164d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:24.990545 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7303dc5-5f12-4110-a512-750c93a164d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:24.992524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7303dc5-5f12-4110-a512-750c93a164d6 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:25.021690 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1159/2323] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:28:24 2022] POST /identity/v3/users => generated 285 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:28:25.023123 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065a60b-5abf-4ee6-a709-fabca16406bc admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:25.036749 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065a60b-5abf-4ee6-a709-fabca16406bc admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:25.041726 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a5e56-1847-47ac-8d6d-f03e92b4328c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:25.042443 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a5e56-1847-47ac-8d6d-f03e92b4328c admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:25.042730 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a5e56-1847-47ac-8d6d-f03e92b4328c admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:25.043011 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a5e56-1847-47ac-8d6d-f03e92b4328c admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:25.043767 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a5e56-1847-47ac-8d6d-f03e92b4328c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:25.045402 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a5e56-1847-47ac-8d6d-f03e92b4328c admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:25.057902 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1165/2324] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:28:25.062408 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7303dc5-5f12-4110-a512-750c93a164d6 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:25.073229 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7303dc5-5f12-4110-a512-750c93a164d6 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:25.079474 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784dec2a-d006-4648-8484-733b5473f9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:25.080144 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784dec2a-d006-4648-8484-733b5473f9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:25.080425 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784dec2a-d006-4648-8484-733b5473f9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:25.080721 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784dec2a-d006-4648-8484-733b5473f9e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:25.081482 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784dec2a-d006-4648-8484-733b5473f9e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:25.083470 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784dec2a-d006-4648-8484-733b5473f9e9 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:25.095308 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1160/2325] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:28:25.100365 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a5e56-1847-47ac-8d6d-f03e92b4328c admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:25.110792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a5e56-1847-47ac-8d6d-f03e92b4328c admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:25.115613 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2bed92-b9f6-4b95-bc56-f06aed4c7c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:25.116518 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bed92-b9f6-4b95-bc56-f06aed4c7c75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:25.116801 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bed92-b9f6-4b95-bc56-f06aed4c7c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:25.117068 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bed92-b9f6-4b95-bc56-f06aed4c7c75 admin admin] PATH_INFO: `/v3/projects/7c96b2451ad64284a63d12149e94b15e/users/a338b03cd69d42b8a2b0dff3ead77d01/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:25.135550 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2bed92-b9f6-4b95-bc56-f06aed4c7c75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c96b2451ad64284a63d12149e94b15e, user_id=a338b03cd69d42b8a2b0dff3ead77d01, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:25.138883 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2bed92-b9f6-4b95-bc56-f06aed4c7c75 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:25.158775 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1166/2326] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:28:25 2022] PUT /identity/v3/projects/7c96b2451ad64284a63d12149e94b15e/users/a338b03cd69d42b8a2b0dff3ead77d01/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:25.169272 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1ff11-f5d4-42d1-8e17-569f4291648b None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:25.169574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1ff11-f5d4-42d1-8e17-569f4291648b None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:25.169888 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1ff11-f5d4-42d1-8e17-569f4291648b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:25.201499 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-b8d1ff11-f5d4-42d1-8e17-569f4291648b None None] MFA Rules not processed for user `a338b03cd69d42b8a2b0dff3ead77d01`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:25.203167 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-b8d1ff11-f5d4-42d1-8e17-569f4291648b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:25.321871 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1161/2327] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:25.328577 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2bed92-b9f6-4b95-bc56-f06aed4c7c75 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:25.355519 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:25.404240 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2bed92-b9f6-4b95-bc56-f06aed4c7c75 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:25.409297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfbd85-880e-41f3-b288-e74033ac5bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:25.410692 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfbd85-880e-41f3-b288-e74033ac5bf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:25.410919 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfbd85-880e-41f3-b288-e74033ac5bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:25.411258 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfbd85-880e-41f3-b288-e74033ac5bf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:25.411979 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abfbd85-880e-41f3-b288-e74033ac5bf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:25.414501 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abfbd85-880e-41f3-b288-e74033ac5bf3 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:25.449493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1167/2328] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:28:25 2022] POST /identity/v3/projects => generated 369 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:28:25.450866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1ff11-f5d4-42d1-8e17-569f4291648b None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:25.464855 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1ff11-f5d4-42d1-8e17-569f4291648b None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:25.546739 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1cc15-0c28-4bbf-99a6-8d59ffe4d616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:25.547511 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1cc15-0c28-4bbf-99a6-8d59ffe4d616 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:25.548161 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1cc15-0c28-4bbf-99a6-8d59ffe4d616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:25.548734 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1cc15-0c28-4bbf-99a6-8d59ffe4d616 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:25.549355 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1cc15-0c28-4bbf-99a6-8d59ffe4d616 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:25.552445 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1cc15-0c28-4bbf-99a6-8d59ffe4d616 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:25.569244 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:25.587720 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1162/2329] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:28:25 2022] POST /identity/v3/users => generated 291 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:28:25.588873 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfbd85-880e-41f3-b288-e74033ac5bf3 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:25.611347 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfbd85-880e-41f3-b288-e74033ac5bf3 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:25.637400 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18d983-c430-4d7f-9577-b4882d1c02f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:25.638955 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18d983-c430-4d7f-9577-b4882d1c02f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:25.639529 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18d983-c430-4d7f-9577-b4882d1c02f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:25.642551 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18d983-c430-4d7f-9577-b4882d1c02f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:25.643509 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df18d983-c430-4d7f-9577-b4882d1c02f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:25.645274 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df18d983-c430-4d7f-9577-b4882d1c02f1 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:25.661296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1168/2330] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:28:25.663014 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1cc15-0c28-4bbf-99a6-8d59ffe4d616 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:25.678250 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1cc15-0c28-4bbf-99a6-8d59ffe4d616 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:25.685060 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4a88b-8c76-45c9-b10f-890be6a434ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:25.686358 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4a88b-8c76-45c9-b10f-890be6a434ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:25.686709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4a88b-8c76-45c9-b10f-890be6a434ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:25.687081 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4a88b-8c76-45c9-b10f-890be6a434ac admin admin] PATH_INFO: `/v3/projects/345044a5ba004af285eb6678b95014f1/users/04d5c4b37a434a3eaaa24ad6d83ff1e6/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:25.719280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4a88b-8c76-45c9-b10f-890be6a434ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=345044a5ba004af285eb6678b95014f1, user_id=04d5c4b37a434a3eaaa24ad6d83ff1e6, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:25.724264 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4a88b-8c76-45c9-b10f-890be6a434ac admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:25.758202 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1163/2331] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:28:25 2022] PUT /identity/v3/projects/345044a5ba004af285eb6678b95014f1/users/04d5c4b37a434a3eaaa24ad6d83ff1e6/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:25.759149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18d983-c430-4d7f-9577-b4882d1c02f1 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:25.771459 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18d983-c430-4d7f-9577-b4882d1c02f1 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:25.847029 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba1d51-638d-4471-aa00-a2cf3cf293a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:25.848204 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba1d51-638d-4471-aa00-a2cf3cf293a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:25.848683 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba1d51-638d-4471-aa00-a2cf3cf293a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:25.849181 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba1d51-638d-4471-aa00-a2cf3cf293a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:25.851541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba1d51-638d-4471-aa00-a2cf3cf293a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:25.852840 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba1d51-638d-4471-aa00-a2cf3cf293a7 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:25.872951 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1169/2332] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:28:25.874169 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4a88b-8c76-45c9-b10f-890be6a434ac admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:25.885122 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4a88b-8c76-45c9-b10f-890be6a434ac admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:25.894157 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80c46c-fc4c-44b6-abb8-039c90ef9f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:25.895070 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80c46c-fc4c-44b6-abb8-039c90ef9f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:25.895357 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80c46c-fc4c-44b6-abb8-039c90ef9f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:25.895643 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80c46c-fc4c-44b6-abb8-039c90ef9f43 admin admin] PATH_INFO: `/v3/projects/345044a5ba004af285eb6678b95014f1/users/04d5c4b37a434a3eaaa24ad6d83ff1e6/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:25.897893 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80c46c-fc4c-44b6-abb8-039c90ef9f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=345044a5ba004af285eb6678b95014f1, user_id=04d5c4b37a434a3eaaa24ad6d83ff1e6, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:25.901641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80c46c-fc4c-44b6-abb8-039c90ef9f43 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:25.919121 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1164/2333] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:28:25 2022] PUT /identity/v3/projects/345044a5ba004af285eb6678b95014f1/users/04d5c4b37a434a3eaaa24ad6d83ff1e6/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:25.933545 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3424d-2d5f-4042-b234-339e449f463f None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:25.934627 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3424d-2d5f-4042-b234-339e449f463f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:25.934996 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3424d-2d5f-4042-b234-339e449f463f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:25.971847 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-d2c3424d-2d5f-4042-b234-339e449f463f None None] MFA Rules not processed for user `04d5c4b37a434a3eaaa24ad6d83ff1e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:25.973499 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d2c3424d-2d5f-4042-b234-339e449f463f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:26.084597 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1170/2334] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:25 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:26.098937 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80c46c-fc4c-44b6-abb8-039c90ef9f43 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:26.100804 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-df80c46c-fc4c-44b6-abb8-039c90ef9f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:26.167404 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80c46c-fc4c-44b6-abb8-039c90ef9f43 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:26.172100 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edfd582-aa82-4116-9adc-73e9325305fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:26.173053 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfd582-aa82-4116-9adc-73e9325305fc service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:26.173339 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfd582-aa82-4116-9adc-73e9325305fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:26.173617 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfd582-aa82-4116-9adc-73e9325305fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:26.186621 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edfd582-aa82-4116-9adc-73e9325305fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:26.188104 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edfd582-aa82-4116-9adc-73e9325305fc service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:26.203493 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1165/2335] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:28:26 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:28:27.896575 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3424d-2d5f-4042-b234-339e449f463f None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:27.898490 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d2c3424d-2d5f-4042-b234-339e449f463f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:27.937982 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:27.996841 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edfd582-aa82-4116-9adc-73e9325305fc service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:28.040557 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3424d-2d5f-4042-b234-339e449f463f None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:28.048318 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87304ac6-1e24-4bee-8c4e-e336711d78ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:28.049360 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87304ac6-1e24-4bee-8c4e-e336711d78ce service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:28.050193 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87304ac6-1e24-4bee-8c4e-e336711d78ce service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:28.050633 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87304ac6-1e24-4bee-8c4e-e336711d78ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:28.052730 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-87304ac6-1e24-4bee-8c4e-e336711d78ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:28.068825 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87304ac6-1e24-4bee-8c4e-e336711d78ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:28.070751 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87304ac6-1e24-4bee-8c4e-e336711d78ce service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:28.086877 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1171/2336] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:28:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:28:28.095313 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edfd582-aa82-4116-9adc-73e9325305fc service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:28.100323 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4b87b-157f-4c65-b233-c3e19b0e57f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:28.101212 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4b87b-157f-4c65-b233-c3e19b0e57f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:28.101498 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4b87b-157f-4c65-b233-c3e19b0e57f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:28.101777 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4b87b-157f-4c65-b233-c3e19b0e57f4 admin admin] PATH_INFO: `/v3/users/a338b03cd69d42b8a2b0dff3ead77d01` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:28.103616 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4b87b-157f-4c65-b233-c3e19b0e57f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a338b03cd69d42b8a2b0dff3ead77d01)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:28.106013 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4b87b-157f-4c65-b233-c3e19b0e57f4 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:28.195762 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e9d4b87b-157f-4c65-b233-c3e19b0e57f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a338b03cd69d42b8a2b0dff3ead77d01'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:28.205985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e9d4b87b-157f-4c65-b233-c3e19b0e57f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a338b03cd69d42b8a2b0dff3ead77d01'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:28.207001 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e9d4b87b-157f-4c65-b233-c3e19b0e57f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a338b03cd69d42b8a2b0dff3ead77d01'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:28.210528 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:28.227241 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e9d4b87b-157f-4c65-b233-c3e19b0e57f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a338b03cd69d42b8a2b0dff3ead77d01'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:28.228113 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e9d4b87b-157f-4c65-b233-c3e19b0e57f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a338b03cd69d42b8a2b0dff3ead77d01'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:28.247122 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1166/2337] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:28:27 2022] DELETE /identity/v3/users/a338b03cd69d42b8a2b0dff3ead77d01 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:28:28.251978 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a5b46-3fce-4ac3-ac12-d456064b755e None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:28.252432 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a5b46-3fce-4ac3-ac12-d456064b755e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:28.252719 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a5b46-3fce-4ac3-ac12-d456064b755e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:28.274589 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-601a5b46-3fce-4ac3-ac12-d456064b755e None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:28.276024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-601a5b46-3fce-4ac3-ac12-d456064b755e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:28.350482 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1172/2338] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:28:28.362432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4b87b-157f-4c65-b233-c3e19b0e57f4 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:28.364189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e9d4b87b-157f-4c65-b233-c3e19b0e57f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:28.453320 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4b87b-157f-4c65-b233-c3e19b0e57f4 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:28.468100 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370f911-bdbb-478e-a2b2-b0f093f106df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:28.468771 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370f911-bdbb-478e-a2b2-b0f093f106df service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:28.469060 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370f911-bdbb-478e-a2b2-b0f093f106df service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:28.469341 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370f911-bdbb-478e-a2b2-b0f093f106df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:28.498573 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a370f911-bdbb-478e-a2b2-b0f093f106df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:28.500219 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a370f911-bdbb-478e-a2b2-b0f093f106df service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:28.514132 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1167/2339] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:28:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:28:29.042995 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a5b46-3fce-4ac3-ac12-d456064b755e None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:29.045080 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-601a5b46-3fce-4ac3-ac12-d456064b755e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:29.059803 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a5b46-3fce-4ac3-ac12-d456064b755e None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:29.064725 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead308a-e5a8-4c16-a5bf-db4d79e4bab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:29.065595 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead308a-e5a8-4c16-a5bf-db4d79e4bab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:29.065909 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead308a-e5a8-4c16-a5bf-db4d79e4bab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:29.066190 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead308a-e5a8-4c16-a5bf-db4d79e4bab1 admin admin] PATH_INFO: `/v3/projects/7c96b2451ad64284a63d12149e94b15e` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:29.067673 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead308a-e5a8-4c16-a5bf-db4d79e4bab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c96b2451ad64284a63d12149e94b15e)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:29.070282 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead308a-e5a8-4c16-a5bf-db4d79e4bab1 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:29.140546 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-7ead308a-e5a8-4c16-a5bf-db4d79e4bab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c96b2451ad64284a63d12149e94b15e', 'request_id': 'req-7ead308a-e5a8-4c16-a5bf-db4d79e4bab1'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:29.149855 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-7ead308a-e5a8-4c16-a5bf-db4d79e4bab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c96b2451ad64284a63d12149e94b15e', 'request_id': 'req-7ead308a-e5a8-4c16-a5bf-db4d79e4bab1'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:29.162161 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-7ead308a-e5a8-4c16-a5bf-db4d79e4bab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c96b2451ad64284a63d12149e94b15e', 'request_id': 'req-7ead308a-e5a8-4c16-a5bf-db4d79e4bab1'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:29.178975 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-7ead308a-e5a8-4c16-a5bf-db4d79e4bab1 admin admin] The token cache is being invalidate because project 7c96b2451ad64284a63d12149e94b15e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:28:29.179258 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-7ead308a-e5a8-4c16-a5bf-db4d79e4bab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:29.180241 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-7ead308a-e5a8-4c16-a5bf-db4d79e4bab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:29.182828 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1173/2340] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:28:29 2022] DELETE /identity/v3/projects/7c96b2451ad64284a63d12149e94b15e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:29.188047 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370f911-bdbb-478e-a2b2-b0f093f106df service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:29.208027 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370f911-bdbb-478e-a2b2-b0f093f106df service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:29.274135 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434cedae-771e-4ac8-bebc-6aaa2f1ce336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:29.275018 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cedae-771e-4ac8-bebc-6aaa2f1ce336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:29.275304 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cedae-771e-4ac8-bebc-6aaa2f1ce336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:29.275711 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cedae-771e-4ac8-bebc-6aaa2f1ce336 admin admin] PATH_INFO: `/v3/users/04d5c4b37a434a3eaaa24ad6d83ff1e6` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:29.276914 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434cedae-771e-4ac8-bebc-6aaa2f1ce336 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04d5c4b37a434a3eaaa24ad6d83ff1e6)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:29.279444 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434cedae-771e-4ac8-bebc-6aaa2f1ce336 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:29.329511 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-434cedae-771e-4ac8-bebc-6aaa2f1ce336 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04d5c4b37a434a3eaaa24ad6d83ff1e6'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:29.337347 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-434cedae-771e-4ac8-bebc-6aaa2f1ce336 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04d5c4b37a434a3eaaa24ad6d83ff1e6'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:29.338005 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-434cedae-771e-4ac8-bebc-6aaa2f1ce336 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04d5c4b37a434a3eaaa24ad6d83ff1e6'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:29.351299 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-434cedae-771e-4ac8-bebc-6aaa2f1ce336 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04d5c4b37a434a3eaaa24ad6d83ff1e6'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:29.352263 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-434cedae-771e-4ac8-bebc-6aaa2f1ce336 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04d5c4b37a434a3eaaa24ad6d83ff1e6'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:29.361129 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:29.367146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1168/2341] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:28:29 2022] DELETE /identity/v3/users/04d5c4b37a434a3eaaa24ad6d83ff1e6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:29.664400 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead308a-e5a8-4c16-a5bf-db4d79e4bab1 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:29.665954 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-7ead308a-e5a8-4c16-a5bf-db4d79e4bab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:29.690565 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead308a-e5a8-4c16-a5bf-db4d79e4bab1 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:29.714125 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:29.755704 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458223b2-1f27-49f9-928c-ee83aa173226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:29.756587 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458223b2-1f27-49f9-928c-ee83aa173226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:29.756874 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458223b2-1f27-49f9-928c-ee83aa173226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:29.757276 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458223b2-1f27-49f9-928c-ee83aa173226 admin admin] PATH_INFO: `/v3/projects/345044a5ba004af285eb6678b95014f1` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:29.758512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458223b2-1f27-49f9-928c-ee83aa173226 admin admin] RBAC: Authorizing `identity:delete_project(project_id=345044a5ba004af285eb6678b95014f1)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:29.760502 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458223b2-1f27-49f9-928c-ee83aa173226 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:29.813260 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-458223b2-1f27-49f9-928c-ee83aa173226 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '345044a5ba004af285eb6678b95014f1', 'request_id': 'req-458223b2-1f27-49f9-928c-ee83aa173226'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:29.819613 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-458223b2-1f27-49f9-928c-ee83aa173226 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '345044a5ba004af285eb6678b95014f1', 'request_id': 'req-458223b2-1f27-49f9-928c-ee83aa173226'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:29.828186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-458223b2-1f27-49f9-928c-ee83aa173226 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '345044a5ba004af285eb6678b95014f1', 'request_id': 'req-458223b2-1f27-49f9-928c-ee83aa173226'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:29.839774 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-458223b2-1f27-49f9-928c-ee83aa173226 admin admin] The token cache is being invalidate because project 345044a5ba004af285eb6678b95014f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:28:29.840083 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-458223b2-1f27-49f9-928c-ee83aa173226 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:29.840746 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-458223b2-1f27-49f9-928c-ee83aa173226 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:29.842344 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1174/2342] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:28:29 2022] DELETE /identity/v3/projects/345044a5ba004af285eb6678b95014f1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:29.847543 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a05a17-3315-4342-ab0d-57eec7501b13 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:29.848160 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a05a17-3315-4342-ab0d-57eec7501b13 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:29.848509 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a05a17-3315-4342-ab0d-57eec7501b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:29.867288 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-33a05a17-3315-4342-ab0d-57eec7501b13 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:29.868491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-33a05a17-3315-4342-ab0d-57eec7501b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:29.937575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1169/2343] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:29.946510 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a51a75-031b-4981-87a4-50a50177226d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:29.946798 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a51a75-031b-4981-87a4-50a50177226d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:29.947082 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a51a75-031b-4981-87a4-50a50177226d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:29.965608 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-22a51a75-031b-4981-87a4-50a50177226d None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:29.966844 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-22a51a75-031b-4981-87a4-50a50177226d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:29.974986 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1175/2344] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:29.979296 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a05a17-3315-4342-ab0d-57eec7501b13 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:29.989795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a05a17-3315-4342-ab0d-57eec7501b13 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:29.994476 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a837a18-da24-4ac1-ac55-946ff7f2c8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:29.995133 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a837a18-da24-4ac1-ac55-946ff7f2c8cf admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:29.995421 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a837a18-da24-4ac1-ac55-946ff7f2c8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:29.995700 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a837a18-da24-4ac1-ac55-946ff7f2c8cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:29.997180 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a837a18-da24-4ac1-ac55-946ff7f2c8cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:28:29.997495 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a837a18-da24-4ac1-ac55-946ff7f2c8cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:29.999177 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a837a18-da24-4ac1-ac55-946ff7f2c8cf admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:30.011428 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1170/2345] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:28:30.016494 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a51a75-031b-4981-87a4-50a50177226d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:30.028074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a51a75-031b-4981-87a4-50a50177226d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:30.035128 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86f902-ed89-4eb5-aa1c-679607484502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:30.036230 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86f902-ed89-4eb5-aa1c-679607484502 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:30.036722 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86f902-ed89-4eb5-aa1c-679607484502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:30.037231 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86f902-ed89-4eb5-aa1c-679607484502 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:30.038200 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86f902-ed89-4eb5-aa1c-679607484502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:30.040593 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86f902-ed89-4eb5-aa1c-679607484502 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:30.071449 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1176/2346] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:28:30 2022] POST /identity/v3/projects => generated 407 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:28:30.076144 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a837a18-da24-4ac1-ac55-946ff7f2c8cf admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:30.086368 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a837a18-da24-4ac1-ac55-946ff7f2c8cf admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:30.143297 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f8b7b-fe9a-44ba-b430-45684dbe40a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:30.144003 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f8b7b-fe9a-44ba-b430-45684dbe40a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:30.144297 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f8b7b-fe9a-44ba-b430-45684dbe40a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:30.144529 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f8b7b-fe9a-44ba-b430-45684dbe40a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:30.145224 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f8b7b-fe9a-44ba-b430-45684dbe40a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:30.147182 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f8b7b-fe9a-44ba-b430-45684dbe40a9 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:30.168504 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1171/2347] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:28:30 2022] POST /identity/v3/users => generated 304 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:28:30.173246 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86f902-ed89-4eb5-aa1c-679607484502 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:30.186301 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86f902-ed89-4eb5-aa1c-679607484502 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:30.192410 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0b9b2-9ed0-4f73-a73f-c0a71d3fcd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:30.193193 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0b9b2-9ed0-4f73-a73f-c0a71d3fcd42 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:30.193531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0b9b2-9ed0-4f73-a73f-c0a71d3fcd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:30.193814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0b9b2-9ed0-4f73-a73f-c0a71d3fcd42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:30.194715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b0b9b2-9ed0-4f73-a73f-c0a71d3fcd42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:30.196604 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b0b9b2-9ed0-4f73-a73f-c0a71d3fcd42 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:30.208770 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1177/2348] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:28:30.212696 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f8b7b-fe9a-44ba-b430-45684dbe40a9 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:30.225203 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f8b7b-fe9a-44ba-b430-45684dbe40a9 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:30.230435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9f057-a547-4a48-b567-bcd3dd00d5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:30.231241 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9f057-a547-4a48-b567-bcd3dd00d5bd admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:30.231774 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9f057-a547-4a48-b567-bcd3dd00d5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:30.232155 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9f057-a547-4a48-b567-bcd3dd00d5bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:30.233003 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c9f057-a547-4a48-b567-bcd3dd00d5bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:30.234913 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c9f057-a547-4a48-b567-bcd3dd00d5bd admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:30.246409 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1172/2349] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:28:30.250570 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0b9b2-9ed0-4f73-a73f-c0a71d3fcd42 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:30.260629 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0b9b2-9ed0-4f73-a73f-c0a71d3fcd42 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:30.265868 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941a21b-4033-4035-bf82-7ef0c1d2606d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:30.266755 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941a21b-4033-4035-bf82-7ef0c1d2606d admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:30.267039 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941a21b-4033-4035-bf82-7ef0c1d2606d admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:30.267313 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941a21b-4033-4035-bf82-7ef0c1d2606d admin admin] PATH_INFO: `/v3/projects/ce9e9639dca94af39e91306118bf796d/users/53b649255402492db6cc5e1925e29351/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:30.284827 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941a21b-4033-4035-bf82-7ef0c1d2606d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce9e9639dca94af39e91306118bf796d, user_id=53b649255402492db6cc5e1925e29351, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:30.287620 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941a21b-4033-4035-bf82-7ef0c1d2606d admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:30.300751 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1178/2350] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:28:30 2022] PUT /identity/v3/projects/ce9e9639dca94af39e91306118bf796d/users/53b649255402492db6cc5e1925e29351/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:30.311515 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29821cb-a4e1-4cdc-a562-0edcf9270af6 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:30.311800 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29821cb-a4e1-4cdc-a562-0edcf9270af6 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:30.312083 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29821cb-a4e1-4cdc-a562-0edcf9270af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:30.341536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-e29821cb-a4e1-4cdc-a562-0edcf9270af6 None None] MFA Rules not processed for user `53b649255402492db6cc5e1925e29351`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:30.342852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e29821cb-a4e1-4cdc-a562-0edcf9270af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:30.408471 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:30.421585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1173/2351] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:30 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:30.427092 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941a21b-4033-4035-bf82-7ef0c1d2606d admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:30.483119 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:30.498672 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941a21b-4033-4035-bf82-7ef0c1d2606d admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:30.503856 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13131ebb-3954-4e04-baae-d7b21492ee26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:30.504624 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13131ebb-3954-4e04-baae-d7b21492ee26 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:30.504947 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13131ebb-3954-4e04-baae-d7b21492ee26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:30.505260 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13131ebb-3954-4e04-baae-d7b21492ee26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:30.506036 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13131ebb-3954-4e04-baae-d7b21492ee26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:30.508013 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13131ebb-3954-4e04-baae-d7b21492ee26 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:30.540647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1179/2352] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:28:30 2022] POST /identity/v3/projects => generated 407 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:28:30.544954 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29821cb-a4e1-4cdc-a562-0edcf9270af6 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:30.557184 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29821cb-a4e1-4cdc-a562-0edcf9270af6 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:30.624627 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ddb201-fd15-4c79-89c2-abc612ad7bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:30.625498 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddb201-fd15-4c79-89c2-abc612ad7bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:30.625903 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddb201-fd15-4c79-89c2-abc612ad7bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:30.626290 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddb201-fd15-4c79-89c2-abc612ad7bb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:30.627103 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ddb201-fd15-4c79-89c2-abc612ad7bb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:30.629528 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ddb201-fd15-4c79-89c2-abc612ad7bb7 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:30.655480 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1174/2353] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:28:30 2022] POST /identity/v3/users => generated 310 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:28:30.659578 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13131ebb-3954-4e04-baae-d7b21492ee26 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:30.671007 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13131ebb-3954-4e04-baae-d7b21492ee26 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:30.676112 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f80679-412b-44e0-a95d-468c18676690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:30.676786 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f80679-412b-44e0-a95d-468c18676690 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:30.677069 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f80679-412b-44e0-a95d-468c18676690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:30.677351 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f80679-412b-44e0-a95d-468c18676690 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:30.678111 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f80679-412b-44e0-a95d-468c18676690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:30.679732 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f80679-412b-44e0-a95d-468c18676690 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:30.691635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1180/2354] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:28:30.695883 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ddb201-fd15-4c79-89c2-abc612ad7bb7 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:30.706406 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ddb201-fd15-4c79-89c2-abc612ad7bb7 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:30.711191 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90abdb8-e5c4-47e6-8645-59c93a6604e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:30.712078 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90abdb8-e5c4-47e6-8645-59c93a6604e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:30.712363 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90abdb8-e5c4-47e6-8645-59c93a6604e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:30.712640 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90abdb8-e5c4-47e6-8645-59c93a6604e1 admin admin] PATH_INFO: `/v3/projects/7cee95dce2724481b7a6aae1d598a9e0/users/f0d85b78af5d4a9b899cb904c5e985f7/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:30.731054 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90abdb8-e5c4-47e6-8645-59c93a6604e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cee95dce2724481b7a6aae1d598a9e0, user_id=f0d85b78af5d4a9b899cb904c5e985f7, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:30.734632 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90abdb8-e5c4-47e6-8645-59c93a6604e1 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:30.754394 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1175/2355] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:28:30 2022] PUT /identity/v3/projects/7cee95dce2724481b7a6aae1d598a9e0/users/f0d85b78af5d4a9b899cb904c5e985f7/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:28:30.758835 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f80679-412b-44e0-a95d-468c18676690 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:30.768969 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f80679-412b-44e0-a95d-468c18676690 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:30.827967 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d605b27-de7b-44ee-89ed-c36ac41650c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:30.828635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d605b27-de7b-44ee-89ed-c36ac41650c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:30.828910 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d605b27-de7b-44ee-89ed-c36ac41650c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:30.829189 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d605b27-de7b-44ee-89ed-c36ac41650c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:30.830067 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d605b27-de7b-44ee-89ed-c36ac41650c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:30.831676 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d605b27-de7b-44ee-89ed-c36ac41650c6 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:30.844623 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1181/2356] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:28:30.848968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90abdb8-e5c4-47e6-8645-59c93a6604e1 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:30.859797 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90abdb8-e5c4-47e6-8645-59c93a6604e1 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:30.864649 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e2d8b-11dc-49aa-b00b-85f221fb9846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:30.865528 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e2d8b-11dc-49aa-b00b-85f221fb9846 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:30.865810 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e2d8b-11dc-49aa-b00b-85f221fb9846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:30.866158 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e2d8b-11dc-49aa-b00b-85f221fb9846 admin admin] PATH_INFO: `/v3/projects/7cee95dce2724481b7a6aae1d598a9e0/users/f0d85b78af5d4a9b899cb904c5e985f7/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:30.868153 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e2d8b-11dc-49aa-b00b-85f221fb9846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cee95dce2724481b7a6aae1d598a9e0, user_id=f0d85b78af5d4a9b899cb904c5e985f7, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:30.870961 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e2d8b-11dc-49aa-b00b-85f221fb9846 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:30.882120 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1176/2357] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:28:30 2022] PUT /identity/v3/projects/7cee95dce2724481b7a6aae1d598a9e0/users/f0d85b78af5d4a9b899cb904c5e985f7/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:30.893222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98c544-3c86-49fd-af49-f529f45eaca9 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:30.893533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98c544-3c86-49fd-af49-f529f45eaca9 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:30.894123 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98c544-3c86-49fd-af49-f529f45eaca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:30.922058 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-bd98c544-3c86-49fd-af49-f529f45eaca9 None None] MFA Rules not processed for user `f0d85b78af5d4a9b899cb904c5e985f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:30.923635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-bd98c544-3c86-49fd-af49-f529f45eaca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:30.998134 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1182/2358] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:30 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:31.009576 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e2d8b-11dc-49aa-b00b-85f221fb9846 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:31.011733 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e41e2d8b-11dc-49aa-b00b-85f221fb9846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:31.075925 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e2d8b-11dc-49aa-b00b-85f221fb9846 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:31.080483 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f31bc3-5bfa-40ce-b409-0ac1013b5438 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:31.081186 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f31bc3-5bfa-40ce-b409-0ac1013b5438 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:31.081524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f31bc3-5bfa-40ce-b409-0ac1013b5438 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:31.081884 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f31bc3-5bfa-40ce-b409-0ac1013b5438 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:31.093811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f31bc3-5bfa-40ce-b409-0ac1013b5438 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:31.095559 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f31bc3-5bfa-40ce-b409-0ac1013b5438 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:31.107950 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1177/2359] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:28:31 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:28:31.260049 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98c544-3c86-49fd-af49-f529f45eaca9 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:31.270507 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98c544-3c86-49fd-af49-f529f45eaca9 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:31.274942 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70533d0-e7b3-4383-b6ee-09ecbd39fe62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:31.275587 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70533d0-e7b3-4383-b6ee-09ecbd39fe62 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:31.275867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70533d0-e7b3-4383-b6ee-09ecbd39fe62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:31.276145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70533d0-e7b3-4383-b6ee-09ecbd39fe62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:31.321108 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:31.336758 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70533d0-e7b3-4383-b6ee-09ecbd39fe62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:31.338248 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70533d0-e7b3-4383-b6ee-09ecbd39fe62 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:31.348304 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1183/2360] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:28:31 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:28:39.080195 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006437c1-1bb5-4d80-a58c-34066281d3df None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:39.080716 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006437c1-1bb5-4d80-a58c-34066281d3df None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:39.080716 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006437c1-1bb5-4d80-a58c-34066281d3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:39.100907 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-006437c1-1bb5-4d80-a58c-34066281d3df None None] MFA Rules not processed for user `aff5d82384e84b669eeb00089ab8e09a`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:39.102163 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-006437c1-1bb5-4d80-a58c-34066281d3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:39.155436 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:39.170799 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1178/2361] 10.222.0.57 () {58 vars in 1009 bytes} [Sat Jun 4 08:28:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:28:39.215511 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70533d0-e7b3-4383-b6ee-09ecbd39fe62 service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:39.217579 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e70533d0-e7b3-4383-b6ee-09ecbd39fe62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:39.295592 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70533d0-e7b3-4383-b6ee-09ecbd39fe62 service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:39.300870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdc949-fa58-4a8f-b70a-38bd169858d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05ea412cab4244c58a2670c66f5a311c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:39.301555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdc949-fa58-4a8f-b70a-38bd169858d8 service swift] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:39.301858 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdc949-fa58-4a8f-b70a-38bd169858d8 service swift] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:39.302139 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdc949-fa58-4a8f-b70a-38bd169858d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:39.311201 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebdc949-fa58-4a8f-b70a-38bd169858d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:39.312799 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebdc949-fa58-4a8f-b70a-38bd169858d8 service swift] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:39.323307 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1184/2362] 10.222.0.57 () {60 vars in 1384 bytes} [Sat Jun 4 08:28:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 08:28:39.815745 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006437c1-1bb5-4d80-a58c-34066281d3df None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:39.910768 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006437c1-1bb5-4d80-a58c-34066281d3df None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:39.924619 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60791f-e6d1-4411-add2-810108ba8a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:39.925787 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60791f-e6d1-4411-add2-810108ba8a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:39.926105 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60791f-e6d1-4411-add2-810108ba8a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:39.926432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60791f-e6d1-4411-add2-810108ba8a8e admin admin] PATH_INFO: `/v3/users/53b649255402492db6cc5e1925e29351` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:39.927819 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60791f-e6d1-4411-add2-810108ba8a8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=53b649255402492db6cc5e1925e29351)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:39.930032 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60791f-e6d1-4411-add2-810108ba8a8e admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:40.008213 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-8a60791f-e6d1-4411-add2-810108ba8a8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53b649255402492db6cc5e1925e29351'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:40.034013 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-8a60791f-e6d1-4411-add2-810108ba8a8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53b649255402492db6cc5e1925e29351'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:40.034358 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-8a60791f-e6d1-4411-add2-810108ba8a8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53b649255402492db6cc5e1925e29351'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:40.051604 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-8a60791f-e6d1-4411-add2-810108ba8a8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53b649255402492db6cc5e1925e29351'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:40.052557 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-8a60791f-e6d1-4411-add2-810108ba8a8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53b649255402492db6cc5e1925e29351'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:40.072772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1179/2363] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:28:39 2022] DELETE /identity/v3/users/53b649255402492db6cc5e1925e29351 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:40.079297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c4a81-0d77-4a3e-988b-3ca1fd5b0f25 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:40.079627 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c4a81-0d77-4a3e-988b-3ca1fd5b0f25 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:40.079883 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c4a81-0d77-4a3e-988b-3ca1fd5b0f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:40.104944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-4a8c4a81-0d77-4a3e-988b-3ca1fd5b0f25 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:40.107563 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4a8c4a81-0d77-4a3e-988b-3ca1fd5b0f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:40.215097 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1185/2364] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:40.229633 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60791f-e6d1-4411-add2-810108ba8a8e admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:40.231773 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8a60791f-e6d1-4411-add2-810108ba8a8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:40.322039 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60791f-e6d1-4411-add2-810108ba8a8e admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:40.325795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7472821-77d2-4a21-b9af-4f697f56edfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:40.326408 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7472821-77d2-4a21-b9af-4f697f56edfc service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:40.326708 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7472821-77d2-4a21-b9af-4f697f56edfc service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:40.326964 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7472821-77d2-4a21-b9af-4f697f56edfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:40.345846 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7472821-77d2-4a21-b9af-4f697f56edfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:40.349972 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7472821-77d2-4a21-b9af-4f697f56edfc service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:40.362670 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1180/2365] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:28:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:28:40.835832 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c4a81-0d77-4a3e-988b-3ca1fd5b0f25 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:40.838773 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4a8c4a81-0d77-4a3e-988b-3ca1fd5b0f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:40.875603 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c4a81-0d77-4a3e-988b-3ca1fd5b0f25 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:40.881861 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684da17-0b5e-4642-8946-11a0ac862c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:40.893283 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684da17-0b5e-4642-8946-11a0ac862c9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:40.893656 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684da17-0b5e-4642-8946-11a0ac862c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:40.894048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684da17-0b5e-4642-8946-11a0ac862c9f admin admin] PATH_INFO: `/v3/projects/ce9e9639dca94af39e91306118bf796d` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:40.896644 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684da17-0b5e-4642-8946-11a0ac862c9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce9e9639dca94af39e91306118bf796d)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:40.902336 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684da17-0b5e-4642-8946-11a0ac862c9f admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:41.014403 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4684da17-0b5e-4642-8946-11a0ac862c9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce9e9639dca94af39e91306118bf796d', 'request_id': 'req-4684da17-0b5e-4642-8946-11a0ac862c9f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:41.023343 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4684da17-0b5e-4642-8946-11a0ac862c9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce9e9639dca94af39e91306118bf796d', 'request_id': 'req-4684da17-0b5e-4642-8946-11a0ac862c9f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:41.036732 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4684da17-0b5e-4642-8946-11a0ac862c9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce9e9639dca94af39e91306118bf796d', 'request_id': 'req-4684da17-0b5e-4642-8946-11a0ac862c9f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:41.046596 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:41.055867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4684da17-0b5e-4642-8946-11a0ac862c9f admin admin] The token cache is being invalidate because project ce9e9639dca94af39e91306118bf796d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:28:41.056339 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4684da17-0b5e-4642-8946-11a0ac862c9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:41.057226 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4684da17-0b5e-4642-8946-11a0ac862c9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:41.060679 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1186/2366] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:28:40 2022] DELETE /identity/v3/projects/ce9e9639dca94af39e91306118bf796d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:41.064879 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7472821-77d2-4a21-b9af-4f697f56edfc service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:41.080566 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7472821-77d2-4a21-b9af-4f697f56edfc service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:41.100635 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:41.127415 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684da17-0b5e-4642-8946-11a0ac862c9f admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:41.131741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4684da17-0b5e-4642-8946-11a0ac862c9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:41.212131 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7128d0-5da0-4569-b855-dcb5a8487d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:41.214574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7128d0-5da0-4569-b855-dcb5a8487d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:41.215266 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7128d0-5da0-4569-b855-dcb5a8487d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:41.215558 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7128d0-5da0-4569-b855-dcb5a8487d44 admin admin] PATH_INFO: `/v3/users/f0d85b78af5d4a9b899cb904c5e985f7` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:41.217476 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7128d0-5da0-4569-b855-dcb5a8487d44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0d85b78af5d4a9b899cb904c5e985f7)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:41.219483 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7128d0-5da0-4569-b855-dcb5a8487d44 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:41.268856 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684da17-0b5e-4642-8946-11a0ac862c9f admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:41.278602 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deba50c-cd55-4388-8a83-b9f796ab6ff3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:41.279388 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deba50c-cd55-4388-8a83-b9f796ab6ff3 service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:41.279714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deba50c-cd55-4388-8a83-b9f796ab6ff3 service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:41.280303 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deba50c-cd55-4388-8a83-b9f796ab6ff3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:41.284806 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-7deba50c-cd55-4388-8a83-b9f796ab6ff3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:41.312794 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deba50c-cd55-4388-8a83-b9f796ab6ff3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:41.313933 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-6c7128d0-5da0-4569-b855-dcb5a8487d44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0d85b78af5d4a9b899cb904c5e985f7'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:41.314666 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deba50c-cd55-4388-8a83-b9f796ab6ff3 service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:41.325175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-6c7128d0-5da0-4569-b855-dcb5a8487d44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0d85b78af5d4a9b899cb904c5e985f7'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:41.326730 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-6c7128d0-5da0-4569-b855-dcb5a8487d44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0d85b78af5d4a9b899cb904c5e985f7'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:41.331098 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1187/2367] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:28:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:28:41.346337 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-6c7128d0-5da0-4569-b855-dcb5a8487d44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0d85b78af5d4a9b899cb904c5e985f7'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:41.347744 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-6c7128d0-5da0-4569-b855-dcb5a8487d44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0d85b78af5d4a9b899cb904c5e985f7'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:41.385088 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1181/2368] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:28:41 2022] DELETE /identity/v3/users/f0d85b78af5d4a9b899cb904c5e985f7 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:41.751412 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deba50c-cd55-4388-8a83-b9f796ab6ff3 service nova] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:41.752938 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-7deba50c-cd55-4388-8a83-b9f796ab6ff3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:41.775057 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deba50c-cd55-4388-8a83-b9f796ab6ff3 service nova] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:41.871827 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1a08b-38f1-4e5e-b444-95308bff8749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:41.872659 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1a08b-38f1-4e5e-b444-95308bff8749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:41.872950 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1a08b-38f1-4e5e-b444-95308bff8749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:41.873378 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1a08b-38f1-4e5e-b444-95308bff8749 admin admin] PATH_INFO: `/v3/projects/7cee95dce2724481b7a6aae1d598a9e0` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:41.874658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1a08b-38f1-4e5e-b444-95308bff8749 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cee95dce2724481b7a6aae1d598a9e0)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:41.876604 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1a08b-38f1-4e5e-b444-95308bff8749 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:41.949474 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-73c1a08b-38f1-4e5e-b444-95308bff8749 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cee95dce2724481b7a6aae1d598a9e0', 'request_id': 'req-73c1a08b-38f1-4e5e-b444-95308bff8749'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:41.960305 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-73c1a08b-38f1-4e5e-b444-95308bff8749 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cee95dce2724481b7a6aae1d598a9e0', 'request_id': 'req-73c1a08b-38f1-4e5e-b444-95308bff8749'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:41.970201 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-73c1a08b-38f1-4e5e-b444-95308bff8749 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cee95dce2724481b7a6aae1d598a9e0', 'request_id': 'req-73c1a08b-38f1-4e5e-b444-95308bff8749'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:41.984984 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-73c1a08b-38f1-4e5e-b444-95308bff8749 admin admin] The token cache is being invalidate because project 7cee95dce2724481b7a6aae1d598a9e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:28:41.985393 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-73c1a08b-38f1-4e5e-b444-95308bff8749 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:41.989386 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-73c1a08b-38f1-4e5e-b444-95308bff8749 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:41.992330 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1188/2369] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:28:41 2022] DELETE /identity/v3/projects/7cee95dce2724481b7a6aae1d598a9e0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:41.993971 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51491c-24b0-4bd2-a97a-cebbcb75cde1 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:41.994646 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51491c-24b0-4bd2-a97a-cebbcb75cde1 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:41.994995 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51491c-24b0-4bd2-a97a-cebbcb75cde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:42.019427 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-5a51491c-24b0-4bd2-a97a-cebbcb75cde1 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:42.021359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-5a51491c-24b0-4bd2-a97a-cebbcb75cde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:42.113985 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1182/2370] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:42.122671 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12da813-c1a9-43bc-893e-1e69df4182de None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:42.122888 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12da813-c1a9-43bc-893e-1e69df4182de None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:42.123143 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12da813-c1a9-43bc-893e-1e69df4182de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:42.152748 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-c12da813-c1a9-43bc-893e-1e69df4182de None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:42.154149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c12da813-c1a9-43bc-893e-1e69df4182de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:42.192067 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1189/2371] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:42.192343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51491c-24b0-4bd2-a97a-cebbcb75cde1 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:42.200953 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51491c-24b0-4bd2-a97a-cebbcb75cde1 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:42.214936 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d4db4-d306-4b56-a016-108a3dccb796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:42.215750 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d4db4-d306-4b56-a016-108a3dccb796 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:42.216439 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d4db4-d306-4b56-a016-108a3dccb796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:42.216615 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d4db4-d306-4b56-a016-108a3dccb796 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:42.217979 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d4db4-d306-4b56-a016-108a3dccb796 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:28:42.218426 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d4db4-d306-4b56-a016-108a3dccb796 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:42.220189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d4db4-d306-4b56-a016-108a3dccb796 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:42.234795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1183/2372] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:28:42.240937 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12da813-c1a9-43bc-893e-1e69df4182de None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:42.255725 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12da813-c1a9-43bc-893e-1e69df4182de None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:42.263757 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962f05e-e1f7-49b3-922d-71524edab58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:42.264765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962f05e-e1f7-49b3-922d-71524edab58d admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:42.265201 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962f05e-e1f7-49b3-922d-71524edab58d admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:42.265619 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962f05e-e1f7-49b3-922d-71524edab58d admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:42.266775 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4962f05e-e1f7-49b3-922d-71524edab58d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:42.269912 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4962f05e-e1f7-49b3-922d-71524edab58d admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:42.274004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:42.308779 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1190/2373] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:28:42 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:28:42.313978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d4db4-d306-4b56-a016-108a3dccb796 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:42.324457 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d4db4-d306-4b56-a016-108a3dccb796 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:42.363376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:42.407168 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebbe6d-03bb-4487-a916-4ac01481db7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:42.407765 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebbe6d-03bb-4487-a916-4ac01481db7b admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:42.408046 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebbe6d-03bb-4487-a916-4ac01481db7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:42.408325 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebbe6d-03bb-4487-a916-4ac01481db7b admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:42.409919 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cebbe6d-03bb-4487-a916-4ac01481db7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:42.411472 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cebbe6d-03bb-4487-a916-4ac01481db7b admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:42.438524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1184/2374] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:28:42 2022] POST /identity/v3/users => generated 288 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:28:42.439301 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962f05e-e1f7-49b3-922d-71524edab58d admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:42.454561 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962f05e-e1f7-49b3-922d-71524edab58d admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:42.460387 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3c79e-236a-4004-b4c6-29b0b9ee50e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:42.461228 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3c79e-236a-4004-b4c6-29b0b9ee50e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:42.461643 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3c79e-236a-4004-b4c6-29b0b9ee50e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:42.462697 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3c79e-236a-4004-b4c6-29b0b9ee50e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:42.462919 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3c79e-236a-4004-b4c6-29b0b9ee50e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:42.464874 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3c79e-236a-4004-b4c6-29b0b9ee50e6 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:42.483801 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1191/2375] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:28:42.485762 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebbe6d-03bb-4487-a916-4ac01481db7b admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:42.498244 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebbe6d-03bb-4487-a916-4ac01481db7b admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:42.508592 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4d97d-beb9-45ee-a5fc-b8c11e27e06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:42.509680 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4d97d-beb9-45ee-a5fc-b8c11e27e06b admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:42.510100 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4d97d-beb9-45ee-a5fc-b8c11e27e06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:42.510491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4d97d-beb9-45ee-a5fc-b8c11e27e06b admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:42.511328 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4d97d-beb9-45ee-a5fc-b8c11e27e06b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:42.513734 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4d97d-beb9-45ee-a5fc-b8c11e27e06b admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:42.525425 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1185/2376] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:28:42.531053 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3c79e-236a-4004-b4c6-29b0b9ee50e6 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:42.546425 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3c79e-236a-4004-b4c6-29b0b9ee50e6 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:42.553743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544b354-ad13-4044-a11f-33f818b6cf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:42.555334 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544b354-ad13-4044-a11f-33f818b6cf8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:42.555865 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544b354-ad13-4044-a11f-33f818b6cf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:42.556349 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544b354-ad13-4044-a11f-33f818b6cf8f admin admin] PATH_INFO: `/v3/projects/d30877b08651423980d20570fca73d81/users/9133d331bda44abd85ebe6fa8492cc26/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:42.587776 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544b354-ad13-4044-a11f-33f818b6cf8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d30877b08651423980d20570fca73d81, user_id=9133d331bda44abd85ebe6fa8492cc26, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:42.590559 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544b354-ad13-4044-a11f-33f818b6cf8f admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:42.610060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1192/2377] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:28:42 2022] PUT /identity/v3/projects/d30877b08651423980d20570fca73d81/users/9133d331bda44abd85ebe6fa8492cc26/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:42.620372 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddc9a8-c8a0-4313-9ed9-9e4348f50a39 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:42.620666 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddc9a8-c8a0-4313-9ed9-9e4348f50a39 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:42.620952 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddc9a8-c8a0-4313-9ed9-9e4348f50a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:42.654228 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-41ddc9a8-c8a0-4313-9ed9-9e4348f50a39 None None] MFA Rules not processed for user `9133d331bda44abd85ebe6fa8492cc26`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:42.655564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-41ddc9a8-c8a0-4313-9ed9-9e4348f50a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:42.747400 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1186/2378] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:28:42.751792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544b354-ad13-4044-a11f-33f818b6cf8f admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:42.838770 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544b354-ad13-4044-a11f-33f818b6cf8f admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:42.850996 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210a64f-a034-4d7a-a026-64f801f8b521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:42.852776 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210a64f-a034-4d7a-a026-64f801f8b521 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:42.853291 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210a64f-a034-4d7a-a026-64f801f8b521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:42.853685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210a64f-a034-4d7a-a026-64f801f8b521 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:42.854933 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1210a64f-a034-4d7a-a026-64f801f8b521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:42.858628 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1210a64f-a034-4d7a-a026-64f801f8b521 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:42.908753 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1193/2379] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:28:42 2022] POST /identity/v3/projects => generated 379 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:28:42.916288 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddc9a8-c8a0-4313-9ed9-9e4348f50a39 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:42.926616 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddc9a8-c8a0-4313-9ed9-9e4348f50a39 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:42.998671 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d913e22-190a-4103-b76d-7e0e4909d651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:42.999297 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d913e22-190a-4103-b76d-7e0e4909d651 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:42.999588 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d913e22-190a-4103-b76d-7e0e4909d651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:42.999866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d913e22-190a-4103-b76d-7e0e4909d651 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:43.000607 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d913e22-190a-4103-b76d-7e0e4909d651 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:43.002705 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d913e22-190a-4103-b76d-7e0e4909d651 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:43.030954 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1187/2380] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:28:42 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:28:43.032279 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210a64f-a034-4d7a-a026-64f801f8b521 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:43.043732 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210a64f-a034-4d7a-a026-64f801f8b521 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:43.050165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac6c9c-92bc-48b1-8cf7-0400fff5ef8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:43.050888 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac6c9c-92bc-48b1-8cf7-0400fff5ef8a admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:43.051365 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac6c9c-92bc-48b1-8cf7-0400fff5ef8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:43.051646 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac6c9c-92bc-48b1-8cf7-0400fff5ef8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:43.052741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac6c9c-92bc-48b1-8cf7-0400fff5ef8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:43.054406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac6c9c-92bc-48b1-8cf7-0400fff5ef8a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:43.067119 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1194/2381] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:28:43.071773 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d913e22-190a-4103-b76d-7e0e4909d651 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:43.084256 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d913e22-190a-4103-b76d-7e0e4909d651 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:43.090625 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1e55b-6847-4d8a-8bc2-9f677914cd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:43.091981 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1e55b-6847-4d8a-8bc2-9f677914cd20 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:43.092369 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1e55b-6847-4d8a-8bc2-9f677914cd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:43.092750 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1e55b-6847-4d8a-8bc2-9f677914cd20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:43.093596 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e1e55b-6847-4d8a-8bc2-9f677914cd20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:43.095395 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e1e55b-6847-4d8a-8bc2-9f677914cd20 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:43.110564 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1188/2382] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:28:43.116496 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac6c9c-92bc-48b1-8cf7-0400fff5ef8a admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:43.127566 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac6c9c-92bc-48b1-8cf7-0400fff5ef8a admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:43.134902 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218545cb-891f-4bf1-851c-e5c8c01f9cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:43.134902 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218545cb-891f-4bf1-851c-e5c8c01f9cde admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:43.134902 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218545cb-891f-4bf1-851c-e5c8c01f9cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:43.134902 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218545cb-891f-4bf1-851c-e5c8c01f9cde admin admin] PATH_INFO: `/v3/projects/2f4d1f52a85341b9ab3c0cefea403e15/users/9cee5d072ee14e33866411c8812dbac2/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:43.152402 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218545cb-891f-4bf1-851c-e5c8c01f9cde admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f4d1f52a85341b9ab3c0cefea403e15, user_id=9cee5d072ee14e33866411c8812dbac2, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:43.156423 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218545cb-891f-4bf1-851c-e5c8c01f9cde admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:43.173858 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1195/2383] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:28:43 2022] PUT /identity/v3/projects/2f4d1f52a85341b9ab3c0cefea403e15/users/9cee5d072ee14e33866411c8812dbac2/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:28:43.256430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96924a37-3872-4642-9741-3f596f081da6 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:43.256653 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96924a37-3872-4642-9741-3f596f081da6 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:43.256898 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96924a37-3872-4642-9741-3f596f081da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:43.292250 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:43.306685 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-96924a37-3872-4642-9741-3f596f081da6 None None] MFA Rules not processed for user `9cee5d072ee14e33866411c8812dbac2`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:43.308427 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-96924a37-3872-4642-9741-3f596f081da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:43.433593 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1189/2384] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:43.439380 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218545cb-891f-4bf1-851c-e5c8c01f9cde admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:43.540321 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218545cb-891f-4bf1-851c-e5c8c01f9cde admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:43.548352 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900fa1a-0bf9-4b72-bb3d-92c90e9db3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:43.548352 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900fa1a-0bf9-4b72-bb3d-92c90e9db3ec admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:43.548352 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900fa1a-0bf9-4b72-bb3d-92c90e9db3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:43.548352 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900fa1a-0bf9-4b72-bb3d-92c90e9db3ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:43.548948 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7900fa1a-0bf9-4b72-bb3d-92c90e9db3ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:43.550815 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7900fa1a-0bf9-4b72-bb3d-92c90e9db3ec admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:43.554678 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:43.589863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1196/2385] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:28:43 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:28:43.592587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96924a37-3872-4642-9741-3f596f081da6 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:43.607879 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96924a37-3872-4642-9741-3f596f081da6 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:43.696459 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cacdcc-9991-482d-b06a-d409aef17d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:43.697301 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cacdcc-9991-482d-b06a-d409aef17d9b admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:43.697650 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cacdcc-9991-482d-b06a-d409aef17d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:43.698046 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cacdcc-9991-482d-b06a-d409aef17d9b admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:43.700989 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cacdcc-9991-482d-b06a-d409aef17d9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:43.701421 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cacdcc-9991-482d-b06a-d409aef17d9b admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:43.729856 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1190/2386] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:28:43 2022] POST /identity/v3/users => generated 295 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:28:43.733600 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900fa1a-0bf9-4b72-bb3d-92c90e9db3ec admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:43.746560 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900fa1a-0bf9-4b72-bb3d-92c90e9db3ec admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:43.751494 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab592e-db05-4cfc-8f71-e3a559a0f2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:43.752161 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab592e-db05-4cfc-8f71-e3a559a0f2eb admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:43.752510 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab592e-db05-4cfc-8f71-e3a559a0f2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:43.752976 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab592e-db05-4cfc-8f71-e3a559a0f2eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:43.754340 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab592e-db05-4cfc-8f71-e3a559a0f2eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:43.756009 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab592e-db05-4cfc-8f71-e3a559a0f2eb admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:43.771329 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1197/2387] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:28:43.776056 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cacdcc-9991-482d-b06a-d409aef17d9b admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:43.793029 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cacdcc-9991-482d-b06a-d409aef17d9b admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:43.802008 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfde108-5d83-4da6-9e52-7f567421312b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:43.803068 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfde108-5d83-4da6-9e52-7f567421312b admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:43.803351 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfde108-5d83-4da6-9e52-7f567421312b admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:43.803623 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfde108-5d83-4da6-9e52-7f567421312b admin admin] PATH_INFO: `/v3/projects/cc2c243d929846738b33f5452ce4fd38/users/84e15b2c0da7404988ffdfdca68cdaf2/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:43.823780 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfde108-5d83-4da6-9e52-7f567421312b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc2c243d929846738b33f5452ce4fd38, user_id=84e15b2c0da7404988ffdfdca68cdaf2, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:43.827816 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfde108-5d83-4da6-9e52-7f567421312b admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:43.843802 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1191/2388] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:28:43 2022] PUT /identity/v3/projects/cc2c243d929846738b33f5452ce4fd38/users/84e15b2c0da7404988ffdfdca68cdaf2/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:43.848649 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab592e-db05-4cfc-8f71-e3a559a0f2eb admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:43.862855 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab592e-db05-4cfc-8f71-e3a559a0f2eb admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:43.931888 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469439c-e6af-4610-a638-1ccf1b701a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:43.932626 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469439c-e6af-4610-a638-1ccf1b701a7d admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:43.932855 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469439c-e6af-4610-a638-1ccf1b701a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:43.933106 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469439c-e6af-4610-a638-1ccf1b701a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:43.933851 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469439c-e6af-4610-a638-1ccf1b701a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:43.935742 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469439c-e6af-4610-a638-1ccf1b701a7d admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:43.948862 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1198/2389] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:28:43.951505 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfde108-5d83-4da6-9e52-7f567421312b admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:43.962848 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfde108-5d83-4da6-9e52-7f567421312b admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:43.998601 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3b5c9-7dbd-443c-9d7a-83ca92f716fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:43.999522 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3b5c9-7dbd-443c-9d7a-83ca92f716fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:43.999783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3b5c9-7dbd-443c-9d7a-83ca92f716fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:44.000059 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3b5c9-7dbd-443c-9d7a-83ca92f716fe admin admin] PATH_INFO: `/v3/projects/cc2c243d929846738b33f5452ce4fd38/users/84e15b2c0da7404988ffdfdca68cdaf2/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:44.002203 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3b5c9-7dbd-443c-9d7a-83ca92f716fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc2c243d929846738b33f5452ce4fd38, user_id=84e15b2c0da7404988ffdfdca68cdaf2, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:44.005119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3b5c9-7dbd-443c-9d7a-83ca92f716fe admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:44.022149 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1192/2390] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:28:43 2022] PUT /identity/v3/projects/cc2c243d929846738b33f5452ce4fd38/users/84e15b2c0da7404988ffdfdca68cdaf2/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:28:44.032656 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e6d97-4886-47e0-9244-9648c15fb45c None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:44.032934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e6d97-4886-47e0-9244-9648c15fb45c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:44.033208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e6d97-4886-47e0-9244-9648c15fb45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:44.063414 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e86e6d97-4886-47e0-9244-9648c15fb45c None None] MFA Rules not processed for user `84e15b2c0da7404988ffdfdca68cdaf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:44.064540 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e86e6d97-4886-47e0-9244-9648c15fb45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:44.157090 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1199/2391] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:44 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:44.170482 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3b5c9-7dbd-443c-9d7a-83ca92f716fe admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:44.173949 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-51a3b5c9-7dbd-443c-9d7a-83ca92f716fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:44.251332 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3b5c9-7dbd-443c-9d7a-83ca92f716fe admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:44.261638 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2fcbc-ba36-4b98-867d-20b0781c1c80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:44.263270 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2fcbc-ba36-4b98-867d-20b0781c1c80 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:44.263736 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2fcbc-ba36-4b98-867d-20b0781c1c80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:44.264238 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2fcbc-ba36-4b98-867d-20b0781c1c80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:44.279402 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:44.284693 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2fcbc-ba36-4b98-867d-20b0781c1c80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:44.287786 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2fcbc-ba36-4b98-867d-20b0781c1c80 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:44.302394 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1193/2392] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:28:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:28:44.352366 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e6d97-4886-47e0-9244-9648c15fb45c None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:44.353785 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e86e6d97-4886-47e0-9244-9648c15fb45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:44.369478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e6d97-4886-47e0-9244-9648c15fb45c None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:44.373852 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec28d54-47ae-4c95-be53-371c8074a28a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:44.374525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec28d54-47ae-4c95-be53-371c8074a28a service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:44.374807 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec28d54-47ae-4c95-be53-371c8074a28a service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:44.375085 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec28d54-47ae-4c95-be53-371c8074a28a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:44.440800 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:44.445465 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec28d54-47ae-4c95-be53-371c8074a28a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:44.447437 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec28d54-47ae-4c95-be53-371c8074a28a service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:44.459634 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1200/2393] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:28:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:28:47.666151 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2fcbc-ba36-4b98-867d-20b0781c1c80 service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:47.783742 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2fcbc-ba36-4b98-867d-20b0781c1c80 service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:47.790969 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeedddb-d73b-4711-9ddf-745ab11c514e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:47.792139 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeedddb-d73b-4711-9ddf-745ab11c514e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:47.792428 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeedddb-d73b-4711-9ddf-745ab11c514e admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:47.792703 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeedddb-d73b-4711-9ddf-745ab11c514e admin admin] PATH_INFO: `/v3/users/9133d331bda44abd85ebe6fa8492cc26` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:47.797015 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeedddb-d73b-4711-9ddf-745ab11c514e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9133d331bda44abd85ebe6fa8492cc26)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:47.797015 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeedddb-d73b-4711-9ddf-745ab11c514e admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:47.888262 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-adeedddb-d73b-4711-9ddf-745ab11c514e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9133d331bda44abd85ebe6fa8492cc26'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:47.905777 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-adeedddb-d73b-4711-9ddf-745ab11c514e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9133d331bda44abd85ebe6fa8492cc26'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:47.907006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-adeedddb-d73b-4711-9ddf-745ab11c514e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9133d331bda44abd85ebe6fa8492cc26'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:47.932475 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-adeedddb-d73b-4711-9ddf-745ab11c514e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9133d331bda44abd85ebe6fa8492cc26'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:47.933270 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-adeedddb-d73b-4711-9ddf-745ab11c514e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9133d331bda44abd85ebe6fa8492cc26'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:47.954715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1194/2394] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:28:47 2022] DELETE /identity/v3/users/9133d331bda44abd85ebe6fa8492cc26 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:47.959887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014458d-5d2e-4d58-be5e-663d71628ebe None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:47.960446 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014458d-5d2e-4d58-be5e-663d71628ebe None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:47.960446 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014458d-5d2e-4d58-be5e-663d71628ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:47.980200 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f014458d-5d2e-4d58-be5e-663d71628ebe None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:47.981542 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f014458d-5d2e-4d58-be5e-663d71628ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:48.065304 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1201/2395] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:48.070941 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeedddb-d73b-4711-9ddf-745ab11c514e admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:48.072435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-adeedddb-d73b-4711-9ddf-745ab11c514e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:48.146323 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeedddb-d73b-4711-9ddf-745ab11c514e admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:48.151887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65a0ae-a2a8-4e71-bfcb-4b27767e8793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:48.152548 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65a0ae-a2a8-4e71-bfcb-4b27767e8793 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:48.152834 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65a0ae-a2a8-4e71-bfcb-4b27767e8793 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:48.153101 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65a0ae-a2a8-4e71-bfcb-4b27767e8793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:48.164329 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65a0ae-a2a8-4e71-bfcb-4b27767e8793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:48.166627 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65a0ae-a2a8-4e71-bfcb-4b27767e8793 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:48.185997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1195/2396] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:28:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:28:48.686323 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014458d-5d2e-4d58-be5e-663d71628ebe None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:48.688088 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f014458d-5d2e-4d58-be5e-663d71628ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:48.705317 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014458d-5d2e-4d58-be5e-663d71628ebe None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:48.710256 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f8930-f10f-4d61-9541-fe478d874365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:48.711251 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f8930-f10f-4d61-9541-fe478d874365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:48.711532 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f8930-f10f-4d61-9541-fe478d874365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:48.711971 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f8930-f10f-4d61-9541-fe478d874365 admin admin] PATH_INFO: `/v3/projects/d30877b08651423980d20570fca73d81` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:48.713195 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f8930-f10f-4d61-9541-fe478d874365 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d30877b08651423980d20570fca73d81)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:48.715163 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f8930-f10f-4d61-9541-fe478d874365 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:48.770601 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-633f8930-f10f-4d61-9541-fe478d874365 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd30877b08651423980d20570fca73d81', 'request_id': 'req-633f8930-f10f-4d61-9541-fe478d874365'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:48.777047 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-633f8930-f10f-4d61-9541-fe478d874365 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd30877b08651423980d20570fca73d81', 'request_id': 'req-633f8930-f10f-4d61-9541-fe478d874365'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:48.786479 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-633f8930-f10f-4d61-9541-fe478d874365 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd30877b08651423980d20570fca73d81', 'request_id': 'req-633f8930-f10f-4d61-9541-fe478d874365'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:48.801884 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-633f8930-f10f-4d61-9541-fe478d874365 admin admin] The token cache is being invalidate because project d30877b08651423980d20570fca73d81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:28:48.802285 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-633f8930-f10f-4d61-9541-fe478d874365 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:48.803004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-633f8930-f10f-4d61-9541-fe478d874365 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:48.804820 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1202/2397] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:28:48 2022] DELETE /identity/v3/projects/d30877b08651423980d20570fca73d81 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:48.809376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65a0ae-a2a8-4e71-bfcb-4b27767e8793 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:48.820208 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65a0ae-a2a8-4e71-bfcb-4b27767e8793 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:48.832639 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:48.889576 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d556e-011c-42a5-ba87-f6914ad55957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:48.890570 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d556e-011c-42a5-ba87-f6914ad55957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:48.891653 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d556e-011c-42a5-ba87-f6914ad55957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:48.891934 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d556e-011c-42a5-ba87-f6914ad55957 admin admin] PATH_INFO: `/v3/users/9cee5d072ee14e33866411c8812dbac2` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:48.893238 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d556e-011c-42a5-ba87-f6914ad55957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cee5d072ee14e33866411c8812dbac2)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:48.895250 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d556e-011c-42a5-ba87-f6914ad55957 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:48.953563 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d10d556e-011c-42a5-ba87-f6914ad55957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cee5d072ee14e33866411c8812dbac2'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:48.960966 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d10d556e-011c-42a5-ba87-f6914ad55957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cee5d072ee14e33866411c8812dbac2'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:48.961858 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d10d556e-011c-42a5-ba87-f6914ad55957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cee5d072ee14e33866411c8812dbac2'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:48.977893 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d10d556e-011c-42a5-ba87-f6914ad55957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cee5d072ee14e33866411c8812dbac2'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:48.982278 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d10d556e-011c-42a5-ba87-f6914ad55957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cee5d072ee14e33866411c8812dbac2'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:49.001920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1196/2398] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:28:48 2022] DELETE /identity/v3/users/9cee5d072ee14e33866411c8812dbac2 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:49.285742 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f8930-f10f-4d61-9541-fe478d874365 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:49.287303 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-633f8930-f10f-4d61-9541-fe478d874365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:49.303274 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f8930-f10f-4d61-9541-fe478d874365 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:49.360624 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bab769-9e27-4dc2-aedc-1fa992ac3783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:49.361487 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bab769-9e27-4dc2-aedc-1fa992ac3783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:49.361771 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bab769-9e27-4dc2-aedc-1fa992ac3783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:49.362078 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bab769-9e27-4dc2-aedc-1fa992ac3783 admin admin] PATH_INFO: `/v3/projects/2f4d1f52a85341b9ab3c0cefea403e15` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:49.363262 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bab769-9e27-4dc2-aedc-1fa992ac3783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f4d1f52a85341b9ab3c0cefea403e15)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:49.365194 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bab769-9e27-4dc2-aedc-1fa992ac3783 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:49.385977 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:49.412348 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c6bab769-9e27-4dc2-aedc-1fa992ac3783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f4d1f52a85341b9ab3c0cefea403e15', 'request_id': 'req-c6bab769-9e27-4dc2-aedc-1fa992ac3783'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:49.418543 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c6bab769-9e27-4dc2-aedc-1fa992ac3783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f4d1f52a85341b9ab3c0cefea403e15', 'request_id': 'req-c6bab769-9e27-4dc2-aedc-1fa992ac3783'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:49.426836 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c6bab769-9e27-4dc2-aedc-1fa992ac3783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f4d1f52a85341b9ab3c0cefea403e15', 'request_id': 'req-c6bab769-9e27-4dc2-aedc-1fa992ac3783'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:49.440364 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c6bab769-9e27-4dc2-aedc-1fa992ac3783 admin admin] The token cache is being invalidate because project 2f4d1f52a85341b9ab3c0cefea403e15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:28:49.440652 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c6bab769-9e27-4dc2-aedc-1fa992ac3783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:49.441292 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c6bab769-9e27-4dc2-aedc-1fa992ac3783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:49.442901 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1203/2399] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:28:49 2022] DELETE /identity/v3/projects/2f4d1f52a85341b9ab3c0cefea403e15 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:49.446909 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d556e-011c-42a5-ba87-f6914ad55957 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:49.448604 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d10d556e-011c-42a5-ba87-f6914ad55957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:49.463582 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d556e-011c-42a5-ba87-f6914ad55957 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:49.530402 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653437c6-aa58-48a8-931a-e17f4f90c4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:49.531377 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653437c6-aa58-48a8-931a-e17f4f90c4f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:49.531699 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653437c6-aa58-48a8-931a-e17f4f90c4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:49.531919 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653437c6-aa58-48a8-931a-e17f4f90c4f9 admin admin] PATH_INFO: `/v3/users/84e15b2c0da7404988ffdfdca68cdaf2` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:49.533280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653437c6-aa58-48a8-931a-e17f4f90c4f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84e15b2c0da7404988ffdfdca68cdaf2)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:49.535405 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653437c6-aa58-48a8-931a-e17f4f90c4f9 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:49.592610 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:49.603062 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-653437c6-aa58-48a8-931a-e17f4f90c4f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84e15b2c0da7404988ffdfdca68cdaf2'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:49.609681 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-653437c6-aa58-48a8-931a-e17f4f90c4f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84e15b2c0da7404988ffdfdca68cdaf2'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:49.610369 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-653437c6-aa58-48a8-931a-e17f4f90c4f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84e15b2c0da7404988ffdfdca68cdaf2'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:49.622156 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-653437c6-aa58-48a8-931a-e17f4f90c4f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84e15b2c0da7404988ffdfdca68cdaf2'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:49.623336 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-653437c6-aa58-48a8-931a-e17f4f90c4f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84e15b2c0da7404988ffdfdca68cdaf2'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:49.635791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1197/2400] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:28:49 2022] DELETE /identity/v3/users/84e15b2c0da7404988ffdfdca68cdaf2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:50.052539 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bab769-9e27-4dc2-aedc-1fa992ac3783 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:50.054068 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c6bab769-9e27-4dc2-aedc-1fa992ac3783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:50.068698 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bab769-9e27-4dc2-aedc-1fa992ac3783 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:50.145844 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ba213-fcbd-42e5-9996-490834423489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:50.146725 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ba213-fcbd-42e5-9996-490834423489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:50.147009 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ba213-fcbd-42e5-9996-490834423489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:50.147285 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ba213-fcbd-42e5-9996-490834423489 admin admin] PATH_INFO: `/v3/projects/cc2c243d929846738b33f5452ce4fd38` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:50.148512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ba213-fcbd-42e5-9996-490834423489 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc2c243d929846738b33f5452ce4fd38)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:50.150509 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ba213-fcbd-42e5-9996-490834423489 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:50.216715 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a37ba213-fcbd-42e5-9996-490834423489 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc2c243d929846738b33f5452ce4fd38', 'request_id': 'req-a37ba213-fcbd-42e5-9996-490834423489'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:50.223203 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a37ba213-fcbd-42e5-9996-490834423489 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc2c243d929846738b33f5452ce4fd38', 'request_id': 'req-a37ba213-fcbd-42e5-9996-490834423489'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:50.232609 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a37ba213-fcbd-42e5-9996-490834423489 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc2c243d929846738b33f5452ce4fd38', 'request_id': 'req-a37ba213-fcbd-42e5-9996-490834423489'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:50.250962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a37ba213-fcbd-42e5-9996-490834423489 admin admin] The token cache is being invalidate because project cc2c243d929846738b33f5452ce4fd38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:28:50.251254 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a37ba213-fcbd-42e5-9996-490834423489 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:50.251898 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a37ba213-fcbd-42e5-9996-490834423489 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:50.253491 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1204/2401] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:28:50 2022] DELETE /identity/v3/projects/cc2c243d929846738b33f5452ce4fd38 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:28:50.263290 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fec3f-8be4-4ca4-9bf1-719ba2d32770 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:50.263811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fec3f-8be4-4ca4-9bf1-719ba2d32770 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:50.263930 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fec3f-8be4-4ca4-9bf1-719ba2d32770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:50.282963 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-e98fec3f-8be4-4ca4-9bf1-719ba2d32770 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:50.284255 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e98fec3f-8be4-4ca4-9bf1-719ba2d32770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:50.348061 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1198/2402] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:28:50.356375 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec23e98-8101-4a15-9359-2c2033898c83 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:50.358128 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec23e98-8101-4a15-9359-2c2033898c83 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:50.358128 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec23e98-8101-4a15-9359-2c2033898c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:50.375394 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-dec23e98-8101-4a15-9359-2c2033898c83 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:50.376589 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-dec23e98-8101-4a15-9359-2c2033898c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:50.384464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1205/2403] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:50.389163 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fec3f-8be4-4ca4-9bf1-719ba2d32770 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:50.398723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fec3f-8be4-4ca4-9bf1-719ba2d32770 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:50.404062 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c706a25-f9c6-4e7e-b310-bb041db663a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:50.404721 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c706a25-f9c6-4e7e-b310-bb041db663a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:50.405028 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c706a25-f9c6-4e7e-b310-bb041db663a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:50.405309 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c706a25-f9c6-4e7e-b310-bb041db663a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:50.406104 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c706a25-f9c6-4e7e-b310-bb041db663a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:28:50.406511 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c706a25-f9c6-4e7e-b310-bb041db663a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:50.408155 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c706a25-f9c6-4e7e-b310-bb041db663a7 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:50.419879 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1199/2404] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:28:50.424444 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec23e98-8101-4a15-9359-2c2033898c83 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:50.433509 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec23e98-8101-4a15-9359-2c2033898c83 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:50.438184 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af307c4-1da5-4212-9831-d37ec7c97ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:50.438850 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af307c4-1da5-4212-9831-d37ec7c97ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:50.439127 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af307c4-1da5-4212-9831-d37ec7c97ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:50.439396 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af307c4-1da5-4212-9831-d37ec7c97ca8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:50.440067 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af307c4-1da5-4212-9831-d37ec7c97ca8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:50.442034 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af307c4-1da5-4212-9831-d37ec7c97ca8 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:50.470130 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1206/2405] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:28:50 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:28:50.474248 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c706a25-f9c6-4e7e-b310-bb041db663a7 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:50.484020 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c706a25-f9c6-4e7e-b310-bb041db663a7 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:50.539883 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0aedb-00f4-4386-a0bf-a977926e1909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:50.540476 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0aedb-00f4-4386-a0bf-a977926e1909 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:50.540764 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0aedb-00f4-4386-a0bf-a977926e1909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:50.541046 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0aedb-00f4-4386-a0bf-a977926e1909 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:50.541734 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0aedb-00f4-4386-a0bf-a977926e1909 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:50.543795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0aedb-00f4-4386-a0bf-a977926e1909 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:50.564126 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1200/2406] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:28:50 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:28:50.570534 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af307c4-1da5-4212-9831-d37ec7c97ca8 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:50.582767 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af307c4-1da5-4212-9831-d37ec7c97ca8 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:50.588048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68104151-6469-4624-a40d-7721b38c219c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:50.588805 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68104151-6469-4624-a40d-7721b38c219c admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:50.589132 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68104151-6469-4624-a40d-7721b38c219c admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:50.589454 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68104151-6469-4624-a40d-7721b38c219c admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:50.590339 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68104151-6469-4624-a40d-7721b38c219c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:50.592187 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68104151-6469-4624-a40d-7721b38c219c admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:50.595065 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:50.611074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1207/2407] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:28:50.612467 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0aedb-00f4-4386-a0bf-a977926e1909 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:50.623626 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0aedb-00f4-4386-a0bf-a977926e1909 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:50.628383 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14997766-99f4-49f3-8bbc-3964cf206f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:50.629050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14997766-99f4-49f3-8bbc-3964cf206f92 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:50.629338 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14997766-99f4-49f3-8bbc-3964cf206f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:50.629625 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14997766-99f4-49f3-8bbc-3964cf206f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:50.630386 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14997766-99f4-49f3-8bbc-3964cf206f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:50.631993 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14997766-99f4-49f3-8bbc-3964cf206f92 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:50.643372 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1201/2408] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:28:50.647785 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68104151-6469-4624-a40d-7721b38c219c admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:50.657762 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68104151-6469-4624-a40d-7721b38c219c admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:50.662355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6760d-c509-431f-b479-541656b69d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:50.663225 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6760d-c509-431f-b479-541656b69d01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:50.663502 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6760d-c509-431f-b479-541656b69d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:50.663769 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6760d-c509-431f-b479-541656b69d01 admin admin] PATH_INFO: `/v3/projects/a7cf1561436d46a7b6909ae24927cdae/users/eeba5e89c5674ff8ac23f89587d73458/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:50.678945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6760d-c509-431f-b479-541656b69d01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7cf1561436d46a7b6909ae24927cdae, user_id=eeba5e89c5674ff8ac23f89587d73458, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:50.681669 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6760d-c509-431f-b479-541656b69d01 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:50.695836 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1208/2409] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:28:50 2022] PUT /identity/v3/projects/a7cf1561436d46a7b6909ae24927cdae/users/eeba5e89c5674ff8ac23f89587d73458/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:50.707413 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26543b2d-8023-4942-9b24-60c965fdbcb7 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:50.707701 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26543b2d-8023-4942-9b24-60c965fdbcb7 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:50.707982 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26543b2d-8023-4942-9b24-60c965fdbcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:50.734179 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-26543b2d-8023-4942-9b24-60c965fdbcb7 None None] MFA Rules not processed for user `eeba5e89c5674ff8ac23f89587d73458`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:50.735394 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-26543b2d-8023-4942-9b24-60c965fdbcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:50.743852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:50.805107 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1202/2410] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:50.816731 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6760d-c509-431f-b479-541656b69d01 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:50.818462 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a0b6760d-c509-431f-b479-541656b69d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:50.874897 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6760d-c509-431f-b479-541656b69d01 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:50.878589 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3dec3-72d5-45bd-afcc-ea06fc8c52b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:50.879235 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3dec3-72d5-45bd-afcc-ea06fc8c52b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:50.879520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3dec3-72d5-45bd-afcc-ea06fc8c52b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:50.879797 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3dec3-72d5-45bd-afcc-ea06fc8c52b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:50.888622 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3dec3-72d5-45bd-afcc-ea06fc8c52b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:50.890075 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3dec3-72d5-45bd-afcc-ea06fc8c52b8 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:50.898925 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1209/2411] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:28:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:28:50.919444 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26543b2d-8023-4942-9b24-60c965fdbcb7 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:50.983396 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26543b2d-8023-4942-9b24-60c965fdbcb7 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:50.988006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b9852-9a8b-4dc4-b42a-ba7062a882a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:50.988871 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b9852-9a8b-4dc4-b42a-ba7062a882a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:50.989180 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b9852-9a8b-4dc4-b42a-ba7062a882a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:50.989453 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b9852-9a8b-4dc4-b42a-ba7062a882a1 admin admin] PATH_INFO: `/v3/users/eeba5e89c5674ff8ac23f89587d73458` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:50.990672 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b9852-9a8b-4dc4-b42a-ba7062a882a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeba5e89c5674ff8ac23f89587d73458)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:50.992592 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b9852-9a8b-4dc4-b42a-ba7062a882a1 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:51.038156 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-138b9852-9a8b-4dc4-b42a-ba7062a882a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeba5e89c5674ff8ac23f89587d73458'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:51.045461 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-138b9852-9a8b-4dc4-b42a-ba7062a882a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeba5e89c5674ff8ac23f89587d73458'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:51.046156 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-138b9852-9a8b-4dc4-b42a-ba7062a882a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeba5e89c5674ff8ac23f89587d73458'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:51.058869 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-138b9852-9a8b-4dc4-b42a-ba7062a882a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeba5e89c5674ff8ac23f89587d73458'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:51.060128 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-138b9852-9a8b-4dc4-b42a-ba7062a882a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeba5e89c5674ff8ac23f89587d73458'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:51.073054 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1203/2412] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:28:50 2022] DELETE /identity/v3/users/eeba5e89c5674ff8ac23f89587d73458 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:51.077848 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56826f03-fb09-4866-b891-a7c5fa56215d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:51.078156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56826f03-fb09-4866-b891-a7c5fa56215d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:51.078445 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56826f03-fb09-4866-b891-a7c5fa56215d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:51.096447 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-56826f03-fb09-4866-b891-a7c5fa56215d None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:51.097780 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-56826f03-fb09-4866-b891-a7c5fa56215d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:51.157228 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1210/2413] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:51.166826 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b9852-9a8b-4dc4-b42a-ba7062a882a1 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:51.168229 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-138b9852-9a8b-4dc4-b42a-ba7062a882a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:51.203075 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:51.233335 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b9852-9a8b-4dc4-b42a-ba7062a882a1 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:51.238174 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66511c64-cac1-4327-9d12-70a1ac94de44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:51.238826 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66511c64-cac1-4327-9d12-70a1ac94de44 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:51.239142 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66511c64-cac1-4327-9d12-70a1ac94de44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:51.239422 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66511c64-cac1-4327-9d12-70a1ac94de44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:51.251242 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66511c64-cac1-4327-9d12-70a1ac94de44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:51.252831 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66511c64-cac1-4327-9d12-70a1ac94de44 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:51.262587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1204/2414] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:28:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:28:51.538475 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56826f03-fb09-4866-b891-a7c5fa56215d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:51.540148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-56826f03-fb09-4866-b891-a7c5fa56215d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:51.555185 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56826f03-fb09-4866-b891-a7c5fa56215d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:51.559834 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800ef99-442e-4fb4-87de-4e3a6aa5d530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:51.560770 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800ef99-442e-4fb4-87de-4e3a6aa5d530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:51.560983 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800ef99-442e-4fb4-87de-4e3a6aa5d530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:51.561258 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800ef99-442e-4fb4-87de-4e3a6aa5d530 admin admin] PATH_INFO: `/v3/projects/a7cf1561436d46a7b6909ae24927cdae` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:51.562487 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800ef99-442e-4fb4-87de-4e3a6aa5d530 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7cf1561436d46a7b6909ae24927cdae)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:51.564401 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800ef99-442e-4fb4-87de-4e3a6aa5d530 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:51.612613 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a800ef99-442e-4fb4-87de-4e3a6aa5d530 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7cf1561436d46a7b6909ae24927cdae', 'request_id': 'req-a800ef99-442e-4fb4-87de-4e3a6aa5d530'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:51.619000 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a800ef99-442e-4fb4-87de-4e3a6aa5d530 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7cf1561436d46a7b6909ae24927cdae', 'request_id': 'req-a800ef99-442e-4fb4-87de-4e3a6aa5d530'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:51.626145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a800ef99-442e-4fb4-87de-4e3a6aa5d530 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7cf1561436d46a7b6909ae24927cdae', 'request_id': 'req-a800ef99-442e-4fb4-87de-4e3a6aa5d530'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:51.632971 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:51.638125 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a800ef99-442e-4fb4-87de-4e3a6aa5d530 admin admin] The token cache is being invalidate because project a7cf1561436d46a7b6909ae24927cdae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:28:51.638651 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a800ef99-442e-4fb4-87de-4e3a6aa5d530 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:51.639540 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a800ef99-442e-4fb4-87de-4e3a6aa5d530 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:28:51.641588 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1211/2415] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:28:51 2022] DELETE /identity/v3/projects/a7cf1561436d46a7b6909ae24927cdae => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:51.646661 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1915f-4684-4df4-8221-c1a75b98a63e None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:51.647122 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1915f-4684-4df4-8221-c1a75b98a63e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:51.647238 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1915f-4684-4df4-8221-c1a75b98a63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:51.667025 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-a8c1915f-4684-4df4-8221-c1a75b98a63e None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:51.668238 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a8c1915f-4684-4df4-8221-c1a75b98a63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:51.737224 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1205/2416] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:51.745090 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf2435-a22f-43c4-a721-3246554570f2 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:51.745375 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf2435-a22f-43c4-a721-3246554570f2 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:51.745672 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf2435-a22f-43c4-a721-3246554570f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:51.764878 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-0ebf2435-a22f-43c4-a721-3246554570f2 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:51.766106 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0ebf2435-a22f-43c4-a721-3246554570f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:51.774202 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1212/2417] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:51.779151 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1915f-4684-4df4-8221-c1a75b98a63e None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:51.788547 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1915f-4684-4df4-8221-c1a75b98a63e None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:51.793488 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843fde8-4cb5-4edd-9d39-391596b62e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:51.794750 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843fde8-4cb5-4edd-9d39-391596b62e5b admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:51.795038 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843fde8-4cb5-4edd-9d39-391596b62e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:51.795304 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843fde8-4cb5-4edd-9d39-391596b62e5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:51.796157 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843fde8-4cb5-4edd-9d39-391596b62e5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:28:51.796507 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843fde8-4cb5-4edd-9d39-391596b62e5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:51.798667 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843fde8-4cb5-4edd-9d39-391596b62e5b admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:51.811527 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1206/2418] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:28:51.815961 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf2435-a22f-43c4-a721-3246554570f2 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:51.825512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf2435-a22f-43c4-a721-3246554570f2 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:51.830675 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e91b2-7310-4792-93e0-ed6e87b82af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:51.831413 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e91b2-7310-4792-93e0-ed6e87b82af7 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:51.831781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e91b2-7310-4792-93e0-ed6e87b82af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:51.832125 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e91b2-7310-4792-93e0-ed6e87b82af7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:51.832887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e91b2-7310-4792-93e0-ed6e87b82af7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:51.834977 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e91b2-7310-4792-93e0-ed6e87b82af7 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:51.863305 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1213/2419] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:28:51 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:28:51.867624 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843fde8-4cb5-4edd-9d39-391596b62e5b admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:51.878722 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843fde8-4cb5-4edd-9d39-391596b62e5b admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:51.946180 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e04d6-8eba-4b13-bf10-810948b52325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:51.946862 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e04d6-8eba-4b13-bf10-810948b52325 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:51.947147 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e04d6-8eba-4b13-bf10-810948b52325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:51.947427 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e04d6-8eba-4b13-bf10-810948b52325 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:51.948134 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e04d6-8eba-4b13-bf10-810948b52325 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:51.950131 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e04d6-8eba-4b13-bf10-810948b52325 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:51.969979 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1207/2420] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:28:51 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:28:51.974056 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e91b2-7310-4792-93e0-ed6e87b82af7 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:51.985147 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e91b2-7310-4792-93e0-ed6e87b82af7 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:51.989915 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651206a3-b47c-421e-b1ce-0198328b097d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:51.990619 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651206a3-b47c-421e-b1ce-0198328b097d admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:51.990907 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651206a3-b47c-421e-b1ce-0198328b097d admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:51.991276 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651206a3-b47c-421e-b1ce-0198328b097d admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:51.992008 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651206a3-b47c-421e-b1ce-0198328b097d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:51.993616 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651206a3-b47c-421e-b1ce-0198328b097d admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:52.004857 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1214/2421] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:28:52.008706 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e04d6-8eba-4b13-bf10-810948b52325 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:52.018634 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e04d6-8eba-4b13-bf10-810948b52325 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:52.023295 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00ba61-ad8b-4813-8270-37baf5953ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:52.023965 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00ba61-ad8b-4813-8270-37baf5953ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:52.024246 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00ba61-ad8b-4813-8270-37baf5953ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:52.024521 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00ba61-ad8b-4813-8270-37baf5953ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:52.025235 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00ba61-ad8b-4813-8270-37baf5953ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:52.026859 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00ba61-ad8b-4813-8270-37baf5953ad6 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:52.037146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1208/2422] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:28:52.041385 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651206a3-b47c-421e-b1ce-0198328b097d admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:52.052880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651206a3-b47c-421e-b1ce-0198328b097d admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:52.057772 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57029988-30a3-4aa8-bf39-5b3d6c00e7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:52.058739 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57029988-30a3-4aa8-bf39-5b3d6c00e7c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:52.059077 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57029988-30a3-4aa8-bf39-5b3d6c00e7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:52.059366 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57029988-30a3-4aa8-bf39-5b3d6c00e7c2 admin admin] PATH_INFO: `/v3/projects/30e8bc0f40b0489fad61a4ad3fdf6d12/users/dd0240d77a8945a492ada611b616d594/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:52.075076 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57029988-30a3-4aa8-bf39-5b3d6c00e7c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30e8bc0f40b0489fad61a4ad3fdf6d12, user_id=dd0240d77a8945a492ada611b616d594, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:52.078205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57029988-30a3-4aa8-bf39-5b3d6c00e7c2 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:52.092414 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1215/2423] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:28:52 2022] PUT /identity/v3/projects/30e8bc0f40b0489fad61a4ad3fdf6d12/users/dd0240d77a8945a492ada611b616d594/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:28:52.103404 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d6f45-ee23-4ca9-93a1-8f44d70b6e26 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:52.103717 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d6f45-ee23-4ca9-93a1-8f44d70b6e26 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:52.103991 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d6f45-ee23-4ca9-93a1-8f44d70b6e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:52.131050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-887d6f45-ee23-4ca9-93a1-8f44d70b6e26 None None] MFA Rules not processed for user `dd0240d77a8945a492ada611b616d594`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:52.132191 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-887d6f45-ee23-4ca9-93a1-8f44d70b6e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:52.158873 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:52.200404 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1209/2424] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:28:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:52.211074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57029988-30a3-4aa8-bf39-5b3d6c00e7c2 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:52.212755 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-57029988-30a3-4aa8-bf39-5b3d6c00e7c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:52.268701 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57029988-30a3-4aa8-bf39-5b3d6c00e7c2 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:52.272484 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997bdba-43bb-4f91-979e-ef95d02a8ab3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:52.273121 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997bdba-43bb-4f91-979e-ef95d02a8ab3 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:52.273403 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997bdba-43bb-4f91-979e-ef95d02a8ab3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:52.273679 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997bdba-43bb-4f91-979e-ef95d02a8ab3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:52.282758 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997bdba-43bb-4f91-979e-ef95d02a8ab3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:52.284190 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997bdba-43bb-4f91-979e-ef95d02a8ab3 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:52.293041 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1216/2425] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:28:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:28:54.008603 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5c496-9560-4d0e-8ba2-9b404ebfa8ec None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:54.009175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5c496-9560-4d0e-8ba2-9b404ebfa8ec None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:54.009286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5c496-9560-4d0e-8ba2-9b404ebfa8ec None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:54.010712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1210/2426] 10.222.0.57 () {54 vars in 921 bytes} [Sat Jun 4 08:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:28:54.017039 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a13e8-b04e-4d6f-98f4-0c2df2305b8b None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:54.017488 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a13e8-b04e-4d6f-98f4-0c2df2305b8b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:54.017585 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a13e8-b04e-4d6f-98f4-0c2df2305b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:54.035979 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-235a13e8-b04e-4d6f-98f4-0c2df2305b8b None None] MFA Rules not processed for user `7e64d002241242928936dd0d991ecdc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:54.037309 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-235a13e8-b04e-4d6f-98f4-0c2df2305b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:54.106464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1217/2427] 10.222.0.57 () {58 vars in 1018 bytes} [Sat Jun 4 08:28:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:28:54.118201 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5c496-9560-4d0e-8ba2-9b404ebfa8ec None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:54.120038 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-17e5c496-9560-4d0e-8ba2-9b404ebfa8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:54.181216 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5c496-9560-4d0e-8ba2-9b404ebfa8ec None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:54.184999 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4604f83-8fe4-44f4-9f1e-57a2e545f950 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cd24a726e4e4ce687d150a3bdc5948f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:54.185667 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4604f83-8fe4-44f4-9f1e-57a2e545f950 service glance] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:54.185987 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4604f83-8fe4-44f4-9f1e-57a2e545f950 service glance] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:54.186267 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4604f83-8fe4-44f4-9f1e-57a2e545f950 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:54.197517 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4604f83-8fe4-44f4-9f1e-57a2e545f950 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:54.199040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4604f83-8fe4-44f4-9f1e-57a2e545f950 service glance] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:54.211481 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1211/2428] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:28:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:28:54.301988 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87132700-6936-46c8-8fb6-3f4010611556 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:54.302278 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87132700-6936-46c8-8fb6-3f4010611556 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:54.302558 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87132700-6936-46c8-8fb6-3f4010611556 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:54.303930 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1218/2429] 10.222.0.57 () {54 vars in 921 bytes} [Sat Jun 4 08:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:28:54.309698 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4c487-9745-4ad3-b355-122d8e172526 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:54.310256 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4c487-9745-4ad3-b355-122d8e172526 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:54.310730 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4c487-9745-4ad3-b355-122d8e172526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:54.331245 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-17a4c487-9745-4ad3-b355-122d8e172526 None None] MFA Rules not processed for user `5fd5768a512c4177abae05f4ccd5c59f`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:54.332460 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-17a4c487-9745-4ad3-b355-122d8e172526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:54.381761 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1212/2430] 10.222.0.57 () {58 vars in 1018 bytes} [Sat Jun 4 08:28:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:54.393881 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87132700-6936-46c8-8fb6-3f4010611556 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:54.395562 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-87132700-6936-46c8-8fb6-3f4010611556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:54.408443 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87132700-6936-46c8-8fb6-3f4010611556 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:54.411934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab183f-b510-457c-ad85-6a1716f57c66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:54.412561 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab183f-b510-457c-ad85-6a1716f57c66 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:54.412860 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab183f-b510-457c-ad85-6a1716f57c66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:54.413114 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab183f-b510-457c-ad85-6a1716f57c66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:54.419959 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab183f-b510-457c-ad85-6a1716f57c66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:54.421369 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab183f-b510-457c-ad85-6a1716f57c66 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:54.429124 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1219/2431] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:28:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:28:54.512127 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cebcc4-cac7-4c4b-b3c5-311e1980fe0a None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:54.513045 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cebcc4-cac7-4c4b-b3c5-311e1980fe0a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:54.513326 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cebcc4-cac7-4c4b-b3c5-311e1980fe0a None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:54.514735 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1213/2432] 10.222.0.57 () {54 vars in 921 bytes} [Sat Jun 4 08:28:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 08:28:54.519564 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b0175-39fb-4c75-b415-48ecd285d330 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:54.519879 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b0175-39fb-4c75-b415-48ecd285d330 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:54.520181 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b0175-39fb-4c75-b415-48ecd285d330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:54.538184 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e93b0175-39fb-4c75-b415-48ecd285d330 None None] MFA Rules not processed for user `7e64d002241242928936dd0d991ecdc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:54.539378 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e93b0175-39fb-4c75-b415-48ecd285d330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:54.548842 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1220/2433] 10.222.0.57 () {58 vars in 1018 bytes} [Sat Jun 4 08:28:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:54.558845 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cebcc4-cac7-4c4b-b3c5-311e1980fe0a None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:54.570352 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cebcc4-cac7-4c4b-b3c5-311e1980fe0a None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:54.574166 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7daa3f-31dd-4853-bd72-2aae36ffdfbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:54.574922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7daa3f-31dd-4853-bd72-2aae36ffdfbd service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:54.575718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7daa3f-31dd-4853-bd72-2aae36ffdfbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:54.575996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7daa3f-31dd-4853-bd72-2aae36ffdfbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:54.586136 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7daa3f-31dd-4853-bd72-2aae36ffdfbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:54.587567 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7daa3f-31dd-4853-bd72-2aae36ffdfbd service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:54.598220 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1214/2434] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:28:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:28:55.552691 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b0175-39fb-4c75-b415-48ecd285d330 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:55.554120 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e93b0175-39fb-4c75-b415-48ecd285d330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:55.567759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b0175-39fb-4c75-b415-48ecd285d330 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:55.579666 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b96a37-7581-4d87-85aa-8f17a51754d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:55.580497 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b96a37-7581-4d87-85aa-8f17a51754d6 service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:55.580966 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b96a37-7581-4d87-85aa-8f17a51754d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:55.581262 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b96a37-7581-4d87-85aa-8f17a51754d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:55.583363 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-10b96a37-7581-4d87-85aa-8f17a51754d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:55.599043 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:28:55.687535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b96a37-7581-4d87-85aa-8f17a51754d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:55.690379 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b96a37-7581-4d87-85aa-8f17a51754d6 service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:55.707231 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1221/2435] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:28:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:28:58.716534 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680b78f-16c8-4658-ba75-924ade217d7b None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:58.717610 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680b78f-16c8-4658-ba75-924ade217d7b None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:58.717725 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680b78f-16c8-4658-ba75-924ade217d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:58.739712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-1680b78f-16c8-4658-ba75-924ade217d7b None None] MFA Rules not processed for user `aff5d82384e84b669eeb00089ab8e09a`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:28:58.741021 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1680b78f-16c8-4658-ba75-924ade217d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:58.801706 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1215/2436] 10.222.0.57 () {58 vars in 1009 bytes} [Sat Jun 4 08:28:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:28:58.814117 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b96a37-7581-4d87-85aa-8f17a51754d6 service nova] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:28:58.815543 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-10b96a37-7581-4d87-85aa-8f17a51754d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:28:58.884688 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b96a37-7581-4d87-85aa-8f17a51754d6 service nova] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:28:58.890431 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2810012-ae8e-4283-8ba5-32c9dacd1607 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05ea412cab4244c58a2670c66f5a311c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:28:58.891083 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2810012-ae8e-4283-8ba5-32c9dacd1607 service swift] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:28:58.891392 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2810012-ae8e-4283-8ba5-32c9dacd1607 service swift] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:28:58.891668 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2810012-ae8e-4283-8ba5-32c9dacd1607 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:28:58.900048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2810012-ae8e-4283-8ba5-32c9dacd1607 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:28:58.901742 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2810012-ae8e-4283-8ba5-32c9dacd1607 service swift] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:28:58.910690 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1222/2437] 10.222.0.57 () {60 vars in 1384 bytes} [Sat Jun 4 08:28:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 08:29:00.908834 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680b78f-16c8-4658-ba75-924ade217d7b None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:00.925113 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:29:00.983754 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680b78f-16c8-4658-ba75-924ade217d7b None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:00.988631 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e9b4a-a618-4685-9240-2e6943c25fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:00.989626 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e9b4a-a618-4685-9240-2e6943c25fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:00.990034 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e9b4a-a618-4685-9240-2e6943c25fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:00.990419 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e9b4a-a618-4685-9240-2e6943c25fd9 admin admin] PATH_INFO: `/v3/users/dd0240d77a8945a492ada611b616d594` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:00.991881 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e9b4a-a618-4685-9240-2e6943c25fd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd0240d77a8945a492ada611b616d594)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:00.993965 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e9b4a-a618-4685-9240-2e6943c25fd9 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:01.059116 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-746e9b4a-a618-4685-9240-2e6943c25fd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd0240d77a8945a492ada611b616d594'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:01.068028 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-746e9b4a-a618-4685-9240-2e6943c25fd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd0240d77a8945a492ada611b616d594'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:01.068766 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-746e9b4a-a618-4685-9240-2e6943c25fd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd0240d77a8945a492ada611b616d594'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:01.082737 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-746e9b4a-a618-4685-9240-2e6943c25fd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd0240d77a8945a492ada611b616d594'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:01.083514 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-746e9b4a-a618-4685-9240-2e6943c25fd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd0240d77a8945a492ada611b616d594'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:01.097270 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1216/2438] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:29:00 2022] DELETE /identity/v3/users/dd0240d77a8945a492ada611b616d594 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:29:01.101979 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5203950-fe8c-4246-b060-3891447d377e None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:01.102461 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5203950-fe8c-4246-b060-3891447d377e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:01.102556 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5203950-fe8c-4246-b060-3891447d377e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:01.120849 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f5203950-fe8c-4246-b060-3891447d377e None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:29:01.122138 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f5203950-fe8c-4246-b060-3891447d377e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:01.195255 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1223/2439] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:29:01.205528 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e9b4a-a618-4685-9240-2e6943c25fd9 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:01.207497 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-746e9b4a-a618-4685-9240-2e6943c25fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:01.275447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e9b4a-a618-4685-9240-2e6943c25fd9 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:01.280198 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f8947-119d-4aac-8ebb-ebb5ca493d10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:01.280918 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f8947-119d-4aac-8ebb-ebb5ca493d10 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:01.281208 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f8947-119d-4aac-8ebb-ebb5ca493d10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:01.281480 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f8947-119d-4aac-8ebb-ebb5ca493d10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:01.291787 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f8947-119d-4aac-8ebb-ebb5ca493d10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:01.293233 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f8947-119d-4aac-8ebb-ebb5ca493d10 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:01.305413 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1217/2440] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:29:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:29:01.689306 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5203950-fe8c-4246-b060-3891447d377e None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:01.691888 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f5203950-fe8c-4246-b060-3891447d377e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:01.713249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5203950-fe8c-4246-b060-3891447d377e None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:01.726131 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e333a6a-497b-429e-9fee-e8a170d3d24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:01.727377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e333a6a-497b-429e-9fee-e8a170d3d24c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:01.727824 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e333a6a-497b-429e-9fee-e8a170d3d24c admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:01.728256 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e333a6a-497b-429e-9fee-e8a170d3d24c admin admin] PATH_INFO: `/v3/projects/30e8bc0f40b0489fad61a4ad3fdf6d12` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:01.730313 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e333a6a-497b-429e-9fee-e8a170d3d24c admin admin] RBAC: Authorizing `identity:delete_project(project_id=30e8bc0f40b0489fad61a4ad3fdf6d12)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:01.733984 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e333a6a-497b-429e-9fee-e8a170d3d24c admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:01.783005 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:29:01.800434 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2e333a6a-497b-429e-9fee-e8a170d3d24c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30e8bc0f40b0489fad61a4ad3fdf6d12', 'request_id': 'req-2e333a6a-497b-429e-9fee-e8a170d3d24c'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:01.809731 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2e333a6a-497b-429e-9fee-e8a170d3d24c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30e8bc0f40b0489fad61a4ad3fdf6d12', 'request_id': 'req-2e333a6a-497b-429e-9fee-e8a170d3d24c'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:01.827167 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2e333a6a-497b-429e-9fee-e8a170d3d24c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30e8bc0f40b0489fad61a4ad3fdf6d12', 'request_id': 'req-2e333a6a-497b-429e-9fee-e8a170d3d24c'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:01.840875 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2e333a6a-497b-429e-9fee-e8a170d3d24c admin admin] The token cache is being invalidate because project 30e8bc0f40b0489fad61a4ad3fdf6d12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:29:01.841313 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2e333a6a-497b-429e-9fee-e8a170d3d24c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:01.842662 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2e333a6a-497b-429e-9fee-e8a170d3d24c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:01.844481 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1224/2441] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:29:01 2022] DELETE /identity/v3/projects/30e8bc0f40b0489fad61a4ad3fdf6d12 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:29:01.849581 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd972899-7f36-4fe0-b565-84292a5926cf None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:01.850042 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd972899-7f36-4fe0-b565-84292a5926cf None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:01.850530 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd972899-7f36-4fe0-b565-84292a5926cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:01.899719 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-bd972899-7f36-4fe0-b565-84292a5926cf None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:29:01.901143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-bd972899-7f36-4fe0-b565-84292a5926cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:01.940816 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:29:01.979928 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1218/2442] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:29:01.988297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7710ad8-72ed-438b-95b1-3ba7d169542e None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:01.988592 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7710ad8-72ed-438b-95b1-3ba7d169542e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:01.988870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7710ad8-72ed-438b-95b1-3ba7d169542e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:02.015034 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-a7710ad8-72ed-438b-95b1-3ba7d169542e None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:29:02.016875 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a7710ad8-72ed-438b-95b1-3ba7d169542e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:02.025812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1225/2443] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:29:02.030918 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd972899-7f36-4fe0-b565-84292a5926cf None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:02.051315 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd972899-7f36-4fe0-b565-84292a5926cf None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:02.056175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206bb7b-4f13-48ef-baf1-3c7c57f0a56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:02.056865 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206bb7b-4f13-48ef-baf1-3c7c57f0a56c admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:02.057134 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206bb7b-4f13-48ef-baf1-3c7c57f0a56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:02.057415 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206bb7b-4f13-48ef-baf1-3c7c57f0a56c admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:02.058208 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206bb7b-4f13-48ef-baf1-3c7c57f0a56c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:29:02.058518 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206bb7b-4f13-48ef-baf1-3c7c57f0a56c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:02.060154 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206bb7b-4f13-48ef-baf1-3c7c57f0a56c admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:02.078908 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1219/2444] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:29:02.083194 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7710ad8-72ed-438b-95b1-3ba7d169542e None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:02.093817 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7710ad8-72ed-438b-95b1-3ba7d169542e None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:02.098902 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c2f7d-3ef3-4434-9908-8109fffabd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:02.099576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c2f7d-3ef3-4434-9908-8109fffabd8e admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:02.099862 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c2f7d-3ef3-4434-9908-8109fffabd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:02.100142 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c2f7d-3ef3-4434-9908-8109fffabd8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:02.100854 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c2f7d-3ef3-4434-9908-8109fffabd8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:02.102855 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c2f7d-3ef3-4434-9908-8109fffabd8e admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:02.133853 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1226/2445] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:29:02 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:29:02.137193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206bb7b-4f13-48ef-baf1-3c7c57f0a56c admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:02.148291 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206bb7b-4f13-48ef-baf1-3c7c57f0a56c admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:02.214118 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5169fc-798a-442c-b743-63d82a38f449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:02.214972 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5169fc-798a-442c-b743-63d82a38f449 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:02.215356 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5169fc-798a-442c-b743-63d82a38f449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:02.215787 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5169fc-798a-442c-b743-63d82a38f449 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:02.216524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5169fc-798a-442c-b743-63d82a38f449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:02.219138 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5169fc-798a-442c-b743-63d82a38f449 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:02.241751 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1220/2446] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:29:02 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:29:02.245941 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c2f7d-3ef3-4434-9908-8109fffabd8e admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:02.257501 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c2f7d-3ef3-4434-9908-8109fffabd8e admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:02.262472 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f239d1-6f56-4b94-ad70-7181ef8649fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:02.263152 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f239d1-6f56-4b94-ad70-7181ef8649fa admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:02.263442 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f239d1-6f56-4b94-ad70-7181ef8649fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:02.264293 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f239d1-6f56-4b94-ad70-7181ef8649fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:02.265058 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f239d1-6f56-4b94-ad70-7181ef8649fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:02.266717 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f239d1-6f56-4b94-ad70-7181ef8649fa admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:02.281667 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1227/2447] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:29:02.283053 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5169fc-798a-442c-b743-63d82a38f449 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:02.294605 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5169fc-798a-442c-b743-63d82a38f449 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:02.300942 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f5cd5-ee51-4f36-9b52-757f120d3f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:02.301649 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f5cd5-ee51-4f36-9b52-757f120d3f9b admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:02.301977 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f5cd5-ee51-4f36-9b52-757f120d3f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:02.302263 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f5cd5-ee51-4f36-9b52-757f120d3f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:02.303010 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f5cd5-ee51-4f36-9b52-757f120d3f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:02.304635 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f5cd5-ee51-4f36-9b52-757f120d3f9b admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:02.315709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1221/2448] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:29:02.319932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f239d1-6f56-4b94-ad70-7181ef8649fa admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:02.330439 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f239d1-6f56-4b94-ad70-7181ef8649fa admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:02.335139 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4072bb-5e38-4e01-bf83-8f810496dc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:02.336028 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4072bb-5e38-4e01-bf83-8f810496dc55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:02.336313 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4072bb-5e38-4e01-bf83-8f810496dc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:02.336593 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4072bb-5e38-4e01-bf83-8f810496dc55 admin admin] PATH_INFO: `/v3/projects/c6b59fc4a1894756bee6eb38155898c3/users/a48f1f427e3f48bd85e788a8fadd4480/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:02.352637 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4072bb-5e38-4e01-bf83-8f810496dc55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b59fc4a1894756bee6eb38155898c3, user_id=a48f1f427e3f48bd85e788a8fadd4480, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:02.355614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4072bb-5e38-4e01-bf83-8f810496dc55 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:02.370669 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1228/2449] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:29:02 2022] PUT /identity/v3/projects/c6b59fc4a1894756bee6eb38155898c3/users/a48f1f427e3f48bd85e788a8fadd4480/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:29:02.381381 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b095a-a8ca-4601-8ccb-3fe830f9ebe3 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:02.381690 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b095a-a8ca-4601-8ccb-3fe830f9ebe3 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:02.381986 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b095a-a8ca-4601-8ccb-3fe830f9ebe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:02.411541 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-650b095a-a8ca-4601-8ccb-3fe830f9ebe3 None None] MFA Rules not processed for user `a48f1f427e3f48bd85e788a8fadd4480`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:29:02.412769 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-650b095a-a8ca-4601-8ccb-3fe830f9ebe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:02.486462 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1222/2450] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:29:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:29:02.497858 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4072bb-5e38-4e01-bf83-8f810496dc55 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:02.499673 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ec4072bb-5e38-4e01-bf83-8f810496dc55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:02.561947 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4072bb-5e38-4e01-bf83-8f810496dc55 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:02.566727 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad630dd-3626-43e7-8cf6-6d0e71ec870b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:02.567630 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad630dd-3626-43e7-8cf6-6d0e71ec870b service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:02.568104 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad630dd-3626-43e7-8cf6-6d0e71ec870b service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:02.568450 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad630dd-3626-43e7-8cf6-6d0e71ec870b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:02.578551 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad630dd-3626-43e7-8cf6-6d0e71ec870b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:02.580018 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad630dd-3626-43e7-8cf6-6d0e71ec870b service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:02.590024 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1229/2451] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:29:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:29:12.482567 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:29:12.585525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:DELETE=5,keystone:SELECT=64,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:29:13.090204 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b095a-a8ca-4601-8ccb-3fe830f9ebe3 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:13.153026 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b095a-a8ca-4601-8ccb-3fe830f9ebe3 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:13.158180 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01858c0d-8eca-4f93-9960-3dd6303ffc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:13.159067 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01858c0d-8eca-4f93-9960-3dd6303ffc5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:13.159336 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01858c0d-8eca-4f93-9960-3dd6303ffc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:13.159612 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01858c0d-8eca-4f93-9960-3dd6303ffc5d admin admin] PATH_INFO: `/v3/users/a48f1f427e3f48bd85e788a8fadd4480` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:13.160819 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01858c0d-8eca-4f93-9960-3dd6303ffc5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a48f1f427e3f48bd85e788a8fadd4480)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:13.162832 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01858c0d-8eca-4f93-9960-3dd6303ffc5d admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:13.209106 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-01858c0d-8eca-4f93-9960-3dd6303ffc5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a48f1f427e3f48bd85e788a8fadd4480'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:13.216052 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-01858c0d-8eca-4f93-9960-3dd6303ffc5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a48f1f427e3f48bd85e788a8fadd4480'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:13.217295 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-01858c0d-8eca-4f93-9960-3dd6303ffc5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a48f1f427e3f48bd85e788a8fadd4480'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:13.229202 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-01858c0d-8eca-4f93-9960-3dd6303ffc5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a48f1f427e3f48bd85e788a8fadd4480'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:13.229871 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-01858c0d-8eca-4f93-9960-3dd6303ffc5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a48f1f427e3f48bd85e788a8fadd4480'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:13.242594 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1223/2452] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:29:13 2022] DELETE /identity/v3/users/a48f1f427e3f48bd85e788a8fadd4480 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:29:13.247098 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872e039-f958-4b5a-836a-76bac3c2b966 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:13.247435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872e039-f958-4b5a-836a-76bac3c2b966 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:13.247719 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872e039-f958-4b5a-836a-76bac3c2b966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:13.265223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-9872e039-f958-4b5a-836a-76bac3c2b966 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:29:13.266462 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9872e039-f958-4b5a-836a-76bac3c2b966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:13.325766 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1230/2453] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:29:13.335365 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01858c0d-8eca-4f93-9960-3dd6303ffc5d admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:13.336776 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-01858c0d-8eca-4f93-9960-3dd6303ffc5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:13.397132 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01858c0d-8eca-4f93-9960-3dd6303ffc5d admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:13.399280 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08dabd-6edc-47df-b037-b521bae4bbca None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:13.399575 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08dabd-6edc-47df-b037-b521bae4bbca None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:13.399857 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08dabd-6edc-47df-b037-b521bae4bbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:13.401085 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab70cbe-0375-4884-a15b-46349973759c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:13.401731 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab70cbe-0375-4884-a15b-46349973759c service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:13.402053 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab70cbe-0375-4884-a15b-46349973759c service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:13.402329 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab70cbe-0375-4884-a15b-46349973759c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:13.412756 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab70cbe-0375-4884-a15b-46349973759c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:13.414143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab70cbe-0375-4884-a15b-46349973759c service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:13.418490 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-8f08dabd-6edc-47df-b037-b521bae4bbca None None] MFA Rules not processed for user `aff5d82384e84b669eeb00089ab8e09a`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:29:13.420273 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8f08dabd-6edc-47df-b037-b521bae4bbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:13.424995 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1224/2454] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:29:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:29:13.478660 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1231/2455] 10.222.0.57 () {58 vars in 967 bytes} [Sat Jun 4 08:29:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:29:13.492427 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab70cbe-0375-4884-a15b-46349973759c service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:13.494036 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-cab70cbe-0375-4884-a15b-46349973759c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:13.525501 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:29:13.578094 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab70cbe-0375-4884-a15b-46349973759c service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:13.594687 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46776ac1-e235-4cbe-a4e0-b9cc9553304c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05ea412cab4244c58a2670c66f5a311c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:13.595776 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46776ac1-e235-4cbe-a4e0-b9cc9553304c service swift] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:13.595776 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46776ac1-e235-4cbe-a4e0-b9cc9553304c service swift] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:13.596118 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46776ac1-e235-4cbe-a4e0-b9cc9553304c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:13.605274 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46776ac1-e235-4cbe-a4e0-b9cc9553304c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:13.607492 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46776ac1-e235-4cbe-a4e0-b9cc9553304c service swift] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:13.619303 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1225/2456] 10.222.0.57 () {60 vars in 1384 bytes} [Sat Jun 4 08:29:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 04 08:29:13.793751 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08dabd-6edc-47df-b037-b521bae4bbca None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:13.796481 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8f08dabd-6edc-47df-b037-b521bae4bbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:13.832457 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08dabd-6edc-47df-b037-b521bae4bbca None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:13.845082 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7187ac-4361-4319-8e4b-d4acd04bd94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:13.846106 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7187ac-4361-4319-8e4b-d4acd04bd94f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:13.846386 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7187ac-4361-4319-8e4b-d4acd04bd94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:13.846659 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7187ac-4361-4319-8e4b-d4acd04bd94f admin admin] PATH_INFO: `/v3/projects/c6b59fc4a1894756bee6eb38155898c3` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:13.853910 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7187ac-4361-4319-8e4b-d4acd04bd94f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6b59fc4a1894756bee6eb38155898c3)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:13.856173 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7187ac-4361-4319-8e4b-d4acd04bd94f admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:13.908043 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1e7187ac-4361-4319-8e4b-d4acd04bd94f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6b59fc4a1894756bee6eb38155898c3', 'request_id': 'req-1e7187ac-4361-4319-8e4b-d4acd04bd94f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:13.924276 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1e7187ac-4361-4319-8e4b-d4acd04bd94f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6b59fc4a1894756bee6eb38155898c3', 'request_id': 'req-1e7187ac-4361-4319-8e4b-d4acd04bd94f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:13.932344 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1e7187ac-4361-4319-8e4b-d4acd04bd94f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6b59fc4a1894756bee6eb38155898c3', 'request_id': 'req-1e7187ac-4361-4319-8e4b-d4acd04bd94f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:13.950252 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1e7187ac-4361-4319-8e4b-d4acd04bd94f admin admin] The token cache is being invalidate because project c6b59fc4a1894756bee6eb38155898c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:29:13.950823 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1e7187ac-4361-4319-8e4b-d4acd04bd94f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:13.951486 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1e7187ac-4361-4319-8e4b-d4acd04bd94f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:13.953254 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1232/2457] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:29:13 2022] DELETE /identity/v3/projects/c6b59fc4a1894756bee6eb38155898c3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:29:22.287694 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46776ac1-e235-4cbe-a4e0-b9cc9553304c service swift] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:22.291366 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-46776ac1-e235-4cbe-a4e0-b9cc9553304c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:22.436551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46776ac1-e235-4cbe-a4e0-b9cc9553304c service swift] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:22.577343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb30864-69a7-4752-aa39-1e90c5d78fad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:22.578069 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb30864-69a7-4752-aa39-1e90c5d78fad service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:22.578351 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb30864-69a7-4752-aa39-1e90c5d78fad service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:22.578625 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb30864-69a7-4752-aa39-1e90c5d78fad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:22.580741 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-edb30864-69a7-4752-aa39-1e90c5d78fad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:22.596200 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb30864-69a7-4752-aa39-1e90c5d78fad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:22.598621 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb30864-69a7-4752-aa39-1e90c5d78fad service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:22.624509 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1226/2458] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:29:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:29:23.945115 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:29:32.606539 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=84 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:29:33.333261 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d710267-8ef7-4b4a-84a4-8d62590779c0 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:33.333849 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d710267-8ef7-4b4a-84a4-8d62590779c0 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:33.333959 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d710267-8ef7-4b4a-84a4-8d62590779c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:33.356730 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-9d710267-8ef7-4b4a-84a4-8d62590779c0 None None] MFA Rules not processed for user `aff5d82384e84b669eeb00089ab8e09a`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:29:33.358120 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9d710267-8ef7-4b4a-84a4-8d62590779c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:33.435007 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1233/2459] 10.222.0.57 () {58 vars in 967 bytes} [Sat Jun 4 08:29:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:29:33.449203 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb30864-69a7-4752-aa39-1e90c5d78fad service nova] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:33.452433 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-edb30864-69a7-4752-aa39-1e90c5d78fad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:33.552459 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb30864-69a7-4752-aa39-1e90c5d78fad service nova] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:33.558125 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271bdb7-10f6-4a22-8a70-17f9321cd51e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05ea412cab4244c58a2670c66f5a311c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:33.558800 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271bdb7-10f6-4a22-8a70-17f9321cd51e service swift] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:33.559087 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271bdb7-10f6-4a22-8a70-17f9321cd51e service swift] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:33.559382 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271bdb7-10f6-4a22-8a70-17f9321cd51e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:33.569039 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5271bdb7-10f6-4a22-8a70-17f9321cd51e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:33.570714 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5271bdb7-10f6-4a22-8a70-17f9321cd51e service swift] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:33.580323 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1227/2460] 10.222.0.57 () {60 vars in 1384 bytes} [Sat Jun 4 08:29:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 04 08:29:37.961483 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d710267-8ef7-4b4a-84a4-8d62590779c0 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:37.964825 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9d710267-8ef7-4b4a-84a4-8d62590779c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:38.067200 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d710267-8ef7-4b4a-84a4-8d62590779c0 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:38.072407 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b09999-6e39-48ff-bffd-da49289e26d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fb6720f0d0141fea795cecfbf6f2538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:38.073100 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b09999-6e39-48ff-bffd-da49289e26d8 service placement] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:38.073390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b09999-6e39-48ff-bffd-da49289e26d8 service placement] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:38.073668 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b09999-6e39-48ff-bffd-da49289e26d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:38.075555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b2b09999-6e39-48ff-bffd-da49289e26d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:38.088463 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b09999-6e39-48ff-bffd-da49289e26d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:38.090093 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b09999-6e39-48ff-bffd-da49289e26d8 service placement] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:38.101645 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1234/2461] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:29:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:29:40.238412 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271bdb7-10f6-4a22-8a70-17f9321cd51e service swift] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:40.241510 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-5271bdb7-10f6-4a22-8a70-17f9321cd51e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:40.341247 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271bdb7-10f6-4a22-8a70-17f9321cd51e service swift] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:40.348006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab9482-eb32-492f-a693-5a3039c77fc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:40.349122 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab9482-eb32-492f-a693-5a3039c77fc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:40.349654 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab9482-eb32-492f-a693-5a3039c77fc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:40.350205 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab9482-eb32-492f-a693-5a3039c77fc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:40.352737 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-dbab9482-eb32-492f-a693-5a3039c77fc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:40.456393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab9482-eb32-492f-a693-5a3039c77fc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:40.458148 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab9482-eb32-492f-a693-5a3039c77fc2 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:40.480455 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1228/2462] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:29:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:29:42.933415 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b09999-6e39-48ff-bffd-da49289e26d8 service placement] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:42.936784 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b2b09999-6e39-48ff-bffd-da49289e26d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:42.967407 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b09999-6e39-48ff-bffd-da49289e26d8 service placement] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:42.980614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1d69f-1c9a-407a-a08d-e8f4c661236f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:42.983441 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1d69f-1c9a-407a-a08d-e8f4c661236f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:42.983755 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1d69f-1c9a-407a-a08d-e8f4c661236f admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:42.984128 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1d69f-1c9a-407a-a08d-e8f4c661236f admin admin] PATH_INFO: `/v3/users/a0fd7c1e6662495a98d502415eef3089` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:42.987275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1d69f-1c9a-407a-a08d-e8f4c661236f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0fd7c1e6662495a98d502415eef3089)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:42.993797 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1d69f-1c9a-407a-a08d-e8f4c661236f admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:43.087048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-aaa1d69f-1c9a-407a-a08d-e8f4c661236f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0fd7c1e6662495a98d502415eef3089'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:43.098730 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-aaa1d69f-1c9a-407a-a08d-e8f4c661236f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0fd7c1e6662495a98d502415eef3089'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:43.099771 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-aaa1d69f-1c9a-407a-a08d-e8f4c661236f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0fd7c1e6662495a98d502415eef3089'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:43.100410 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-aaa1d69f-1c9a-407a-a08d-e8f4c661236f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0fd7c1e6662495a98d502415eef3089'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:43.125642 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-aaa1d69f-1c9a-407a-a08d-e8f4c661236f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0fd7c1e6662495a98d502415eef3089'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:43.146405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1235/2463] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:29:42 2022] DELETE /identity/v3/users/a0fd7c1e6662495a98d502415eef3089 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:29:43.432494 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab9482-eb32-492f-a693-5a3039c77fc2 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:43.443676 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab9482-eb32-492f-a693-5a3039c77fc2 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:43.510920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:29:43.540165 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19cf39-c674-4ddc-a80a-a38e35bdca58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:43.541181 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19cf39-c674-4ddc-a80a-a38e35bdca58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:43.541547 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19cf39-c674-4ddc-a80a-a38e35bdca58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:43.541958 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19cf39-c674-4ddc-a80a-a38e35bdca58 admin admin] PATH_INFO: `/v3/projects/950149f4530b41eea35bc273803918a9` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:43.543691 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19cf39-c674-4ddc-a80a-a38e35bdca58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=950149f4530b41eea35bc273803918a9)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:43.546142 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19cf39-c674-4ddc-a80a-a38e35bdca58 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:43.710288 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-be19cf39-c674-4ddc-a80a-a38e35bdca58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '950149f4530b41eea35bc273803918a9', 'request_id': 'req-be19cf39-c674-4ddc-a80a-a38e35bdca58'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:43.735622 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-be19cf39-c674-4ddc-a80a-a38e35bdca58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '950149f4530b41eea35bc273803918a9', 'request_id': 'req-be19cf39-c674-4ddc-a80a-a38e35bdca58'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:43.753878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-be19cf39-c674-4ddc-a80a-a38e35bdca58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '950149f4530b41eea35bc273803918a9', 'request_id': 'req-be19cf39-c674-4ddc-a80a-a38e35bdca58'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:43.780359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-be19cf39-c674-4ddc-a80a-a38e35bdca58 admin admin] The token cache is being invalidate because project 950149f4530b41eea35bc273803918a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:29:43.783735 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-be19cf39-c674-4ddc-a80a-a38e35bdca58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:43.786638 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-be19cf39-c674-4ddc-a80a-a38e35bdca58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:43.793166 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1229/2464] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:29:43 2022] DELETE /identity/v3/projects/950149f4530b41eea35bc273803918a9 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:29:43.794900 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1d69f-1c9a-407a-a08d-e8f4c661236f admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:43.797411 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-aaa1d69f-1c9a-407a-a08d-e8f4c661236f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:43.848748 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1d69f-1c9a-407a-a08d-e8f4c661236f admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:43.860926 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:29:44.001368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef3e92-94ea-4127-a7fa-f9512d591eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:44.003566 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef3e92-94ea-4127-a7fa-f9512d591eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:44.004056 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef3e92-94ea-4127-a7fa-f9512d591eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:44.004516 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef3e92-94ea-4127-a7fa-f9512d591eee admin admin] PATH_INFO: `/v3/users/805ae3defe0d4a0e82daba63888612cd` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:44.006199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef3e92-94ea-4127-a7fa-f9512d591eee admin admin] RBAC: Authorizing `identity:delete_user(user_id=805ae3defe0d4a0e82daba63888612cd)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:44.008381 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef3e92-94ea-4127-a7fa-f9512d591eee admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:44.092735 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-02ef3e92-94ea-4127-a7fa-f9512d591eee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '805ae3defe0d4a0e82daba63888612cd'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:44.103569 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-02ef3e92-94ea-4127-a7fa-f9512d591eee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '805ae3defe0d4a0e82daba63888612cd'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:44.104487 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-02ef3e92-94ea-4127-a7fa-f9512d591eee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '805ae3defe0d4a0e82daba63888612cd'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:44.105131 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-02ef3e92-94ea-4127-a7fa-f9512d591eee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '805ae3defe0d4a0e82daba63888612cd'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:44.124243 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-02ef3e92-94ea-4127-a7fa-f9512d591eee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '805ae3defe0d4a0e82daba63888612cd'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:44.146002 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1236/2465] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:29:43 2022] DELETE /identity/v3/users/805ae3defe0d4a0e82daba63888612cd => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:29:44.628302 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19cf39-c674-4ddc-a80a-a38e35bdca58 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:44.631836 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-be19cf39-c674-4ddc-a80a-a38e35bdca58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:44.659186 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19cf39-c674-4ddc-a80a-a38e35bdca58 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:44.792417 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497feda3-2ec8-48cf-ad41-979628deb628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:44.794014 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497feda3-2ec8-48cf-ad41-979628deb628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:44.794533 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497feda3-2ec8-48cf-ad41-979628deb628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:44.795545 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497feda3-2ec8-48cf-ad41-979628deb628 admin admin] PATH_INFO: `/v3/projects/bc232df684c24fa5a33de80838db1572` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:44.798729 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497feda3-2ec8-48cf-ad41-979628deb628 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc232df684c24fa5a33de80838db1572)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:44.802155 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497feda3-2ec8-48cf-ad41-979628deb628 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:44.886943 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-497feda3-2ec8-48cf-ad41-979628deb628 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc232df684c24fa5a33de80838db1572', 'request_id': 'req-497feda3-2ec8-48cf-ad41-979628deb628'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:44.898896 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-497feda3-2ec8-48cf-ad41-979628deb628 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc232df684c24fa5a33de80838db1572', 'request_id': 'req-497feda3-2ec8-48cf-ad41-979628deb628'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:44.911256 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-497feda3-2ec8-48cf-ad41-979628deb628 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc232df684c24fa5a33de80838db1572', 'request_id': 'req-497feda3-2ec8-48cf-ad41-979628deb628'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:44.923483 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:29:44.939820 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-497feda3-2ec8-48cf-ad41-979628deb628 admin admin] The token cache is being invalidate because project bc232df684c24fa5a33de80838db1572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:29:44.940747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-497feda3-2ec8-48cf-ad41-979628deb628 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:44.941962 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-497feda3-2ec8-48cf-ad41-979628deb628 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:44.944418 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1230/2466] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:29:44 2022] DELETE /identity/v3/projects/bc232df684c24fa5a33de80838db1572 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:29:45.706468 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef3e92-94ea-4127-a7fa-f9512d591eee admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:45.708147 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-02ef3e92-94ea-4127-a7fa-f9512d591eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:45.791866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497feda3-2ec8-48cf-ad41-979628deb628 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:45.793431 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-497feda3-2ec8-48cf-ad41-979628deb628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:45.855296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef3e92-94ea-4127-a7fa-f9512d591eee admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:45.887575 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:29:45.888873 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497feda3-2ec8-48cf-ad41-979628deb628 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:45.894476 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34ad1a-31a1-47ef-8b82-7b563c7af1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:45.895561 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34ad1a-31a1-47ef-8b82-7b563c7af1b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:45.895851 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34ad1a-31a1-47ef-8b82-7b563c7af1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:45.896130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34ad1a-31a1-47ef-8b82-7b563c7af1b5 admin admin] PATH_INFO: `/v3/users/45692f4ec1254103a5b0132b3b42b60b` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:45.897430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34ad1a-31a1-47ef-8b82-7b563c7af1b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45692f4ec1254103a5b0132b3b42b60b)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:45.899885 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34ad1a-31a1-47ef-8b82-7b563c7af1b5 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:45.945853 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598ea37-a0f5-4925-8c08-c1307c634d96 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fb6720f0d0141fea795cecfbf6f2538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:45.946871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598ea37-a0f5-4925-8c08-c1307c634d96 service placement] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:45.947223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598ea37-a0f5-4925-8c08-c1307c634d96 service placement] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:45.947502 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598ea37-a0f5-4925-8c08-c1307c634d96 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:45.949849 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c598ea37-a0f5-4925-8c08-c1307c634d96 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:45.963747 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598ea37-a0f5-4925-8c08-c1307c634d96 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:45.965653 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598ea37-a0f5-4925-8c08-c1307c634d96 service placement] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:45.968432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5f34ad1a-31a1-47ef-8b82-7b563c7af1b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45692f4ec1254103a5b0132b3b42b60b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:45.978759 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5f34ad1a-31a1-47ef-8b82-7b563c7af1b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45692f4ec1254103a5b0132b3b42b60b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:45.979057 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1237/2467] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:29:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:29:45.979631 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5f34ad1a-31a1-47ef-8b82-7b563c7af1b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45692f4ec1254103a5b0132b3b42b60b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:45.997322 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5f34ad1a-31a1-47ef-8b82-7b563c7af1b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45692f4ec1254103a5b0132b3b42b60b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:45.998530 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5f34ad1a-31a1-47ef-8b82-7b563c7af1b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45692f4ec1254103a5b0132b3b42b60b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:46.020520 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1231/2468] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:29:45 2022] DELETE /identity/v3/users/45692f4ec1254103a5b0132b3b42b60b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:29:46.216140 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598ea37-a0f5-4925-8c08-c1307c634d96 service placement] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:46.231842 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598ea37-a0f5-4925-8c08-c1307c634d96 service placement] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:46.303537 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c828f57-391d-477d-a3bb-f8b0edabcf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:46.304421 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c828f57-391d-477d-a3bb-f8b0edabcf06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:46.304702 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c828f57-391d-477d-a3bb-f8b0edabcf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:46.304975 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c828f57-391d-477d-a3bb-f8b0edabcf06 admin admin] PATH_INFO: `/v3/projects/880551882c5748278978d5a7586d1f30` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:46.306250 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c828f57-391d-477d-a3bb-f8b0edabcf06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=880551882c5748278978d5a7586d1f30)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:46.308224 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c828f57-391d-477d-a3bb-f8b0edabcf06 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:46.357083 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0c828f57-391d-477d-a3bb-f8b0edabcf06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '880551882c5748278978d5a7586d1f30', 'request_id': 'req-0c828f57-391d-477d-a3bb-f8b0edabcf06'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:46.363705 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0c828f57-391d-477d-a3bb-f8b0edabcf06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '880551882c5748278978d5a7586d1f30', 'request_id': 'req-0c828f57-391d-477d-a3bb-f8b0edabcf06'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:46.371126 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0c828f57-391d-477d-a3bb-f8b0edabcf06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '880551882c5748278978d5a7586d1f30', 'request_id': 'req-0c828f57-391d-477d-a3bb-f8b0edabcf06'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:46.382987 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0c828f57-391d-477d-a3bb-f8b0edabcf06 admin admin] The token cache is being invalidate because project 880551882c5748278978d5a7586d1f30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:29:46.383190 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0c828f57-391d-477d-a3bb-f8b0edabcf06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:46.383834 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0c828f57-391d-477d-a3bb-f8b0edabcf06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:46.385377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1238/2469] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:29:46 2022] DELETE /identity/v3/projects/880551882c5748278978d5a7586d1f30 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:29:46.391040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95699740-dd99-48ad-8000-912f26107cdf None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:46.391321 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95699740-dd99-48ad-8000-912f26107cdf None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:46.391594 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95699740-dd99-48ad-8000-912f26107cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:46.410851 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-95699740-dd99-48ad-8000-912f26107cdf None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:29:46.412090 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-95699740-dd99-48ad-8000-912f26107cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:46.477975 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1232/2470] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:29:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:29:46.486894 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d53f23-4ee4-48ee-b199-9ba3e736af7c None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:46.487184 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d53f23-4ee4-48ee-b199-9ba3e736af7c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:46.487466 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d53f23-4ee4-48ee-b199-9ba3e736af7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:46.508851 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-62d53f23-4ee4-48ee-b199-9ba3e736af7c None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:29:46.510091 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-62d53f23-4ee4-48ee-b199-9ba3e736af7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:46.518984 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1239/2471] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:29:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:29:46.523519 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95699740-dd99-48ad-8000-912f26107cdf None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:46.533446 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95699740-dd99-48ad-8000-912f26107cdf None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:46.538191 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fda31a-c849-4a26-aa78-3c264bb9afbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:46.538851 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fda31a-c849-4a26-aa78-3c264bb9afbc admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:46.539136 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fda31a-c849-4a26-aa78-3c264bb9afbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:46.539412 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fda31a-c849-4a26-aa78-3c264bb9afbc admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:46.540138 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fda31a-c849-4a26-aa78-3c264bb9afbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:29:46.540444 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fda31a-c849-4a26-aa78-3c264bb9afbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:46.542086 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fda31a-c849-4a26-aa78-3c264bb9afbc admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:46.556354 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1233/2472] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:29:46.561579 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d53f23-4ee4-48ee-b199-9ba3e736af7c None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:46.571382 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d53f23-4ee4-48ee-b199-9ba3e736af7c None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:46.576904 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb789e-06b0-4dcb-81f1-64b7b5726e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:46.577553 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb789e-06b0-4dcb-81f1-64b7b5726e84 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:46.577868 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb789e-06b0-4dcb-81f1-64b7b5726e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:46.578272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb789e-06b0-4dcb-81f1-64b7b5726e84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:46.578971 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb789e-06b0-4dcb-81f1-64b7b5726e84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:46.580900 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb789e-06b0-4dcb-81f1-64b7b5726e84 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:46.618612 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1240/2473] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:29:46 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:29:46.624242 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fda31a-c849-4a26-aa78-3c264bb9afbc admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:46.639718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fda31a-c849-4a26-aa78-3c264bb9afbc admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:46.645436 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:29:46.704776 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b74acb-5abe-4bf5-9b54-5cc9c637e2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:46.705679 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b74acb-5abe-4bf5-9b54-5cc9c637e2fe admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:46.706216 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b74acb-5abe-4bf5-9b54-5cc9c637e2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:46.706511 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b74acb-5abe-4bf5-9b54-5cc9c637e2fe admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:46.707260 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b74acb-5abe-4bf5-9b54-5cc9c637e2fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:46.709323 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b74acb-5abe-4bf5-9b54-5cc9c637e2fe admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:46.730526 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1234/2474] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:29:46 2022] POST /identity/v3/users => generated 283 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:29:46.735370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb789e-06b0-4dcb-81f1-64b7b5726e84 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:46.746174 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb789e-06b0-4dcb-81f1-64b7b5726e84 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:46.751868 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9745964-b9e3-47ec-982e-a96745e5ca6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:46.752631 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9745964-b9e3-47ec-982e-a96745e5ca6d admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:46.752830 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9745964-b9e3-47ec-982e-a96745e5ca6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:46.753123 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9745964-b9e3-47ec-982e-a96745e5ca6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:46.753865 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9745964-b9e3-47ec-982e-a96745e5ca6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:46.755483 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9745964-b9e3-47ec-982e-a96745e5ca6d admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:46.761364 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:29:46.767371 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1241/2475] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:29:46.771718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b74acb-5abe-4bf5-9b54-5cc9c637e2fe admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:46.787839 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b74acb-5abe-4bf5-9b54-5cc9c637e2fe admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:46.796117 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6971c-46d3-41e1-8e90-68fdbed6c521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:46.797669 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6971c-46d3-41e1-8e90-68fdbed6c521 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:46.798175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6971c-46d3-41e1-8e90-68fdbed6c521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:46.798605 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6971c-46d3-41e1-8e90-68fdbed6c521 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:46.799860 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6971c-46d3-41e1-8e90-68fdbed6c521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:46.802618 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6971c-46d3-41e1-8e90-68fdbed6c521 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:46.816436 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1235/2476] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:29:46.822106 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9745964-b9e3-47ec-982e-a96745e5ca6d admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:46.832930 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9745964-b9e3-47ec-982e-a96745e5ca6d admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:46.837898 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c1f2f-e79a-4be6-904d-5741537d0f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:46.838853 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c1f2f-e79a-4be6-904d-5741537d0f01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:46.839199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c1f2f-e79a-4be6-904d-5741537d0f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:46.839540 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c1f2f-e79a-4be6-904d-5741537d0f01 admin admin] PATH_INFO: `/v3/projects/e375fd852daf4f33bab2fc475809f7be/users/8c0918b021374866b7519684711b0c9e/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:46.858880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c1f2f-e79a-4be6-904d-5741537d0f01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e375fd852daf4f33bab2fc475809f7be, user_id=8c0918b021374866b7519684711b0c9e, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:46.861610 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c1f2f-e79a-4be6-904d-5741537d0f01 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:46.898713 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1242/2477] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:29:46 2022] PUT /identity/v3/projects/e375fd852daf4f33bab2fc475809f7be/users/8c0918b021374866b7519684711b0c9e/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:29:46.900269 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151c31a-a709-4ebc-934e-3c2aad34cbb2 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:46.900692 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151c31a-a709-4ebc-934e-3c2aad34cbb2 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:46.901045 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151c31a-a709-4ebc-934e-3c2aad34cbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:46.936712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-9151c31a-a709-4ebc-934e-3c2aad34cbb2 None None] MFA Rules not processed for user `8c0918b021374866b7519684711b0c9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:29:46.937945 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-9151c31a-a709-4ebc-934e-3c2aad34cbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:47.025356 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1236/2478] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:29:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:29:47.037431 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c1f2f-e79a-4be6-904d-5741537d0f01 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:47.041096 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-328c1f2f-e79a-4be6-904d-5741537d0f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:47.115204 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c1f2f-e79a-4be6-904d-5741537d0f01 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:47.118963 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ba460-1c0b-404e-9f15-0ddc8515fe11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:47.119636 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ba460-1c0b-404e-9f15-0ddc8515fe11 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:47.119919 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ba460-1c0b-404e-9f15-0ddc8515fe11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:47.120203 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ba460-1c0b-404e-9f15-0ddc8515fe11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:47.131023 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ba460-1c0b-404e-9f15-0ddc8515fe11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:47.132584 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ba460-1c0b-404e-9f15-0ddc8515fe11 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:47.143269 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1243/2479] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:29:47 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:29:48.259926 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151c31a-a709-4ebc-934e-3c2aad34cbb2 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:48.261386 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-9151c31a-a709-4ebc-934e-3c2aad34cbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:48.326759 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151c31a-a709-4ebc-934e-3c2aad34cbb2 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:48.330829 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e1ddd-f71b-4fbd-a214-b2991d3338c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:48.331501 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e1ddd-f71b-4fbd-a214-b2991d3338c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:48.331785 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e1ddd-f71b-4fbd-a214-b2991d3338c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:48.332062 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e1ddd-f71b-4fbd-a214-b2991d3338c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:48.334039 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-374e1ddd-f71b-4fbd-a214-b2991d3338c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:48.368455 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:29:48.407306 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e1ddd-f71b-4fbd-a214-b2991d3338c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:48.409040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e1ddd-f71b-4fbd-a214-b2991d3338c2 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:48.420996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1237/2480] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:29:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:29:51.888784 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ba460-1c0b-404e-9f15-0ddc8515fe11 service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:51.890739 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f17ba460-1c0b-404e-9f15-0ddc8515fe11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:51.906149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ba460-1c0b-404e-9f15-0ddc8515fe11 service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:51.910865 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2a4ed-323b-4990-a942-ddb637082f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:51.911762 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2a4ed-323b-4990-a942-ddb637082f2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:51.912048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2a4ed-323b-4990-a942-ddb637082f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:51.912325 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2a4ed-323b-4990-a942-ddb637082f2c admin admin] PATH_INFO: `/v3/users/93baaa9e849b40b199d567615f7e1c94` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:51.913555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2a4ed-323b-4990-a942-ddb637082f2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=93baaa9e849b40b199d567615f7e1c94)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:51.915587 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2a4ed-323b-4990-a942-ddb637082f2c admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:51.983599 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-baf2a4ed-323b-4990-a942-ddb637082f2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93baaa9e849b40b199d567615f7e1c94'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:51.992752 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-baf2a4ed-323b-4990-a942-ddb637082f2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93baaa9e849b40b199d567615f7e1c94'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:51.993378 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-baf2a4ed-323b-4990-a942-ddb637082f2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93baaa9e849b40b199d567615f7e1c94'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:51.994055 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-baf2a4ed-323b-4990-a942-ddb637082f2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93baaa9e849b40b199d567615f7e1c94'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:52.011829 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-baf2a4ed-323b-4990-a942-ddb637082f2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93baaa9e849b40b199d567615f7e1c94'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:52.025810 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1244/2481] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:29:51 2022] DELETE /identity/v3/users/93baaa9e849b40b199d567615f7e1c94 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:29:52.259996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e1ddd-f71b-4fbd-a214-b2991d3338c2 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:52.272142 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e1ddd-f71b-4fbd-a214-b2991d3338c2 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:52.343326 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a40b1d-c421-4a19-85cf-bde8b89ce278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:52.344878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a40b1d-c421-4a19-85cf-bde8b89ce278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:52.345163 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a40b1d-c421-4a19-85cf-bde8b89ce278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:52.345437 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a40b1d-c421-4a19-85cf-bde8b89ce278 admin admin] PATH_INFO: `/v3/projects/bada48f0853f4642b538bab7eae486e6` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:52.346749 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a40b1d-c421-4a19-85cf-bde8b89ce278 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bada48f0853f4642b538bab7eae486e6)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:52.348682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a40b1d-c421-4a19-85cf-bde8b89ce278 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:52.401349 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e5a40b1d-c421-4a19-85cf-bde8b89ce278 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bada48f0853f4642b538bab7eae486e6', 'request_id': 'req-e5a40b1d-c421-4a19-85cf-bde8b89ce278'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:52.408922 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e5a40b1d-c421-4a19-85cf-bde8b89ce278 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bada48f0853f4642b538bab7eae486e6', 'request_id': 'req-e5a40b1d-c421-4a19-85cf-bde8b89ce278'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:52.417668 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e5a40b1d-c421-4a19-85cf-bde8b89ce278 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bada48f0853f4642b538bab7eae486e6', 'request_id': 'req-e5a40b1d-c421-4a19-85cf-bde8b89ce278'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:52.429553 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e5a40b1d-c421-4a19-85cf-bde8b89ce278 admin admin] The token cache is being invalidate because project bada48f0853f4642b538bab7eae486e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:29:52.429902 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e5a40b1d-c421-4a19-85cf-bde8b89ce278 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:52.430508 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e5a40b1d-c421-4a19-85cf-bde8b89ce278 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:52.432086 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1238/2482] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:29:52 2022] DELETE /identity/v3/projects/bada48f0853f4642b538bab7eae486e6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:29:52.437733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d04d2-cc67-467d-a551-b0137ab458bb None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:52.438389 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d04d2-cc67-467d-a551-b0137ab458bb None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:52.438884 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d04d2-cc67-467d-a551-b0137ab458bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:52.459570 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-784d04d2-cc67-467d-a551-b0137ab458bb None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:29:52.460883 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-784d04d2-cc67-467d-a551-b0137ab458bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:52.517442 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:29:52.533036 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1245/2483] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:29:52.540705 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b92c7-ffbc-488d-8570-97b63c831add None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:52.540997 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b92c7-ffbc-488d-8570-97b63c831add None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:52.541299 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b92c7-ffbc-488d-8570-97b63c831add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:52.560777 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-b58b92c7-ffbc-488d-8570-97b63c831add None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:29:52.562035 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-b58b92c7-ffbc-488d-8570-97b63c831add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:52.570120 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1239/2484] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:29:52.574492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d04d2-cc67-467d-a551-b0137ab458bb None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:52.586182 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d04d2-cc67-467d-a551-b0137ab458bb None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:52.590987 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461613c-8018-417c-98b4-b627bdb921d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:52.591685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461613c-8018-417c-98b4-b627bdb921d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:52.592007 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461613c-8018-417c-98b4-b627bdb921d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:52.592287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461613c-8018-417c-98b4-b627bdb921d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:52.593025 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461613c-8018-417c-98b4-b627bdb921d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:29:52.593332 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461613c-8018-417c-98b4-b627bdb921d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:52.595050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461613c-8018-417c-98b4-b627bdb921d0 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:52.607525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1246/2485] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:29:52.613125 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b92c7-ffbc-488d-8570-97b63c831add None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:52.623320 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b92c7-ffbc-488d-8570-97b63c831add None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:52.629329 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd728a-c2a0-4e04-a66c-ac22b8d46b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:52.630032 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd728a-c2a0-4e04-a66c-ac22b8d46b5c admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:52.630319 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd728a-c2a0-4e04-a66c-ac22b8d46b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:52.630597 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd728a-c2a0-4e04-a66c-ac22b8d46b5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:52.631291 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd728a-c2a0-4e04-a66c-ac22b8d46b5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:52.633270 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd728a-c2a0-4e04-a66c-ac22b8d46b5c admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:52.662474 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1240/2486] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:29:52 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:29:52.666858 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461613c-8018-417c-98b4-b627bdb921d0 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:52.678302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461613c-8018-417c-98b4-b627bdb921d0 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:52.737477 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17b699-1209-43cc-ba0f-e9de732d379d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:52.738187 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17b699-1209-43cc-ba0f-e9de732d379d admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:52.738470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17b699-1209-43cc-ba0f-e9de732d379d admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:52.738743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17b699-1209-43cc-ba0f-e9de732d379d admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:52.739443 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17b699-1209-43cc-ba0f-e9de732d379d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:52.741374 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17b699-1209-43cc-ba0f-e9de732d379d admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:52.761385 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1247/2487] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:29:52 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:29:52.766269 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd728a-c2a0-4e04-a66c-ac22b8d46b5c admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:52.777014 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd728a-c2a0-4e04-a66c-ac22b8d46b5c admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:52.782498 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20b095-bbee-497c-9894-6f17d4fb9b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:52.783164 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20b095-bbee-497c-9894-6f17d4fb9b1e admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:52.783452 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20b095-bbee-497c-9894-6f17d4fb9b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:52.783730 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20b095-bbee-497c-9894-6f17d4fb9b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:52.784458 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20b095-bbee-497c-9894-6f17d4fb9b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:52.786100 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20b095-bbee-497c-9894-6f17d4fb9b1e admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:52.798738 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1241/2488] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:29:52.803225 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17b699-1209-43cc-ba0f-e9de732d379d admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:52.815355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17b699-1209-43cc-ba0f-e9de732d379d admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:52.820523 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8ef30-86ee-4ba6-a7bc-ebd472e9865e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:52.821208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8ef30-86ee-4ba6-a7bc-ebd472e9865e admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:52.821497 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8ef30-86ee-4ba6-a7bc-ebd472e9865e admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:52.821779 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8ef30-86ee-4ba6-a7bc-ebd472e9865e admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:52.822694 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8ef30-86ee-4ba6-a7bc-ebd472e9865e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:52.824318 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8ef30-86ee-4ba6-a7bc-ebd472e9865e admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:52.844156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1248/2489] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:29:52.845425 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20b095-bbee-497c-9894-6f17d4fb9b1e admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:52.857938 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20b095-bbee-497c-9894-6f17d4fb9b1e admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:52.862643 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfbcbe5-a489-4592-b622-813d815fb3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:52.863567 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbcbe5-a489-4592-b622-813d815fb3c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:52.863853 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbcbe5-a489-4592-b622-813d815fb3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:52.864130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbcbe5-a489-4592-b622-813d815fb3c8 admin admin] PATH_INFO: `/v3/projects/1c5594eb3c42475a8cb6da9f5ca5f373/users/274d4a3254b745cbbed6a78a8f8bc91a/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:52.877052 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:29:52.881283 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfbcbe5-a489-4592-b622-813d815fb3c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c5594eb3c42475a8cb6da9f5ca5f373, user_id=274d4a3254b745cbbed6a78a8f8bc91a, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:52.884839 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfbcbe5-a489-4592-b622-813d815fb3c8 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:52.908589 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1242/2490] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:29:52 2022] PUT /identity/v3/projects/1c5594eb3c42475a8cb6da9f5ca5f373/users/274d4a3254b745cbbed6a78a8f8bc91a/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:29:52.912056 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bf7b9-3c0c-4ddc-93f4-7c39ad1fd03b None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:52.912562 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bf7b9-3c0c-4ddc-93f4-7c39ad1fd03b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:52.912645 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bf7b9-3c0c-4ddc-93f4-7c39ad1fd03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:52.949961 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e35bf7b9-3c0c-4ddc-93f4-7c39ad1fd03b None None] MFA Rules not processed for user `274d4a3254b745cbbed6a78a8f8bc91a`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:29:52.951845 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e35bf7b9-3c0c-4ddc-93f4-7c39ad1fd03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:53.020540 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1249/2491] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:29:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:29:53.024983 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfbcbe5-a489-4592-b622-813d815fb3c8 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:53.089097 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfbcbe5-a489-4592-b622-813d815fb3c8 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:53.094127 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00d413-ae1a-4147-9567-0a43c2410025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:53.094860 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00d413-ae1a-4147-9567-0a43c2410025 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:53.095189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00d413-ae1a-4147-9567-0a43c2410025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:53.095506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00d413-ae1a-4147-9567-0a43c2410025 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:53.096217 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00d413-ae1a-4147-9567-0a43c2410025 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:53.098224 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00d413-ae1a-4147-9567-0a43c2410025 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:53.130501 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1243/2492] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:29:53 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:29:53.131814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bf7b9-3c0c-4ddc-93f4-7c39ad1fd03b None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:53.143939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bf7b9-3c0c-4ddc-93f4-7c39ad1fd03b None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:53.194843 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:29:53.210352 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5092d-458f-47e2-8783-42b4cb3a3def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:53.211025 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5092d-458f-47e2-8783-42b4cb3a3def admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:53.211306 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5092d-458f-47e2-8783-42b4cb3a3def admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:53.211607 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5092d-458f-47e2-8783-42b4cb3a3def admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:53.212290 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a5092d-458f-47e2-8783-42b4cb3a3def admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:53.214318 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a5092d-458f-47e2-8783-42b4cb3a3def admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:53.236722 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1250/2493] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:29:53 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:29:53.240692 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00d413-ae1a-4147-9567-0a43c2410025 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:53.253845 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00d413-ae1a-4147-9567-0a43c2410025 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:53.259736 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6e5ca-11ba-4061-bfbd-26dfd130fec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:53.260412 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6e5ca-11ba-4061-bfbd-26dfd130fec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:53.261000 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6e5ca-11ba-4061-bfbd-26dfd130fec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:53.261000 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6e5ca-11ba-4061-bfbd-26dfd130fec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:53.261783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6e5ca-11ba-4061-bfbd-26dfd130fec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:53.264109 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6e5ca-11ba-4061-bfbd-26dfd130fec4 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:53.275288 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1244/2494] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:29:53.279561 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5092d-458f-47e2-8783-42b4cb3a3def admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:53.290129 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5092d-458f-47e2-8783-42b4cb3a3def admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:53.295314 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d9820-9f64-4fc0-abbb-07849c1e2e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:53.296238 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d9820-9f64-4fc0-abbb-07849c1e2e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:53.296519 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d9820-9f64-4fc0-abbb-07849c1e2e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:53.297061 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d9820-9f64-4fc0-abbb-07849c1e2e19 admin admin] PATH_INFO: `/v3/projects/dcab245d33094420ba7badbc55980811/users/ea9eb022975c4e38ab0c5f878af745d7/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:53.313414 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d9820-9f64-4fc0-abbb-07849c1e2e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcab245d33094420ba7badbc55980811, user_id=ea9eb022975c4e38ab0c5f878af745d7, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:53.316097 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d9820-9f64-4fc0-abbb-07849c1e2e19 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:53.330483 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1251/2495] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:29:53 2022] PUT /identity/v3/projects/dcab245d33094420ba7badbc55980811/users/ea9eb022975c4e38ab0c5f878af745d7/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:29:53.334793 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6e5ca-11ba-4061-bfbd-26dfd130fec4 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:53.345239 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6e5ca-11ba-4061-bfbd-26dfd130fec4 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:53.411921 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8250ca3-5864-4198-8fc8-01a01cab4bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:53.412597 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8250ca3-5864-4198-8fc8-01a01cab4bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:53.412884 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8250ca3-5864-4198-8fc8-01a01cab4bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:53.413193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8250ca3-5864-4198-8fc8-01a01cab4bf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:53.413955 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8250ca3-5864-4198-8fc8-01a01cab4bf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:53.415586 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8250ca3-5864-4198-8fc8-01a01cab4bf6 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:53.426591 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1245/2496] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:29:53.430691 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d9820-9f64-4fc0-abbb-07849c1e2e19 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:53.441773 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d9820-9f64-4fc0-abbb-07849c1e2e19 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:53.446485 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d6b7e-36f4-4631-ab2e-59a1c46696e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:53.447371 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d6b7e-36f4-4631-ab2e-59a1c46696e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:53.447653 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d6b7e-36f4-4631-ab2e-59a1c46696e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:53.447927 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d6b7e-36f4-4631-ab2e-59a1c46696e3 admin admin] PATH_INFO: `/v3/projects/dcab245d33094420ba7badbc55980811/users/ea9eb022975c4e38ab0c5f878af745d7/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:53.449964 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d6b7e-36f4-4631-ab2e-59a1c46696e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcab245d33094420ba7badbc55980811, user_id=ea9eb022975c4e38ab0c5f878af745d7, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:53.453247 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d6b7e-36f4-4631-ab2e-59a1c46696e3 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:53.464612 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1252/2497] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:29:53 2022] PUT /identity/v3/projects/dcab245d33094420ba7badbc55980811/users/ea9eb022975c4e38ab0c5f878af745d7/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:29:53.474948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd47e0f-8929-46b5-a610-32a1dd21fcb6 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:53.475236 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd47e0f-8929-46b5-a610-32a1dd21fcb6 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:53.475516 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd47e0f-8929-46b5-a610-32a1dd21fcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:53.504042 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-7fd47e0f-8929-46b5-a610-32a1dd21fcb6 None None] MFA Rules not processed for user `ea9eb022975c4e38ab0c5f878af745d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:29:53.505252 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-7fd47e0f-8929-46b5-a610-32a1dd21fcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:53.557747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:29:53.583166 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1246/2498] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:29:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:29:53.595796 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d6b7e-36f4-4631-ab2e-59a1c46696e3 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:53.597542 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-379d6b7e-36f4-4631-ab2e-59a1c46696e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:53.663486 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d6b7e-36f4-4631-ab2e-59a1c46696e3 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:53.668340 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7055bee-4382-454f-9b20-ef740dc718a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:53.669005 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7055bee-4382-454f-9b20-ef740dc718a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:53.669291 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7055bee-4382-454f-9b20-ef740dc718a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:53.670125 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7055bee-4382-454f-9b20-ef740dc718a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:53.680158 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7055bee-4382-454f-9b20-ef740dc718a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:53.681626 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7055bee-4382-454f-9b20-ef740dc718a8 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:53.692740 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1253/2499] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:29:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:29:53.779255 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd47e0f-8929-46b5-a610-32a1dd21fcb6 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:53.789512 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd47e0f-8929-46b5-a610-32a1dd21fcb6 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:53.793655 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e01b6-67c8-4d1f-8053-9020678f1817 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:53.794981 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e01b6-67c8-4d1f-8053-9020678f1817 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:53.795316 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e01b6-67c8-4d1f-8053-9020678f1817 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:53.795709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e01b6-67c8-4d1f-8053-9020678f1817 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:53.861082 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e01b6-67c8-4d1f-8053-9020678f1817 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:53.862495 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e01b6-67c8-4d1f-8053-9020678f1817 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:53.871844 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1247/2500] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:29:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:29:55.810099 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7055bee-4382-454f-9b20-ef740dc718a8 service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:55.811636 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d7055bee-4382-454f-9b20-ef740dc718a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:55.877945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7055bee-4382-454f-9b20-ef740dc718a8 service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:55.882647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c456f20-e672-43d4-bd54-495fb7b4fb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:55.883543 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c456f20-e672-43d4-bd54-495fb7b4fb6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:55.883832 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c456f20-e672-43d4-bd54-495fb7b4fb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:55.884106 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c456f20-e672-43d4-bd54-495fb7b4fb6a admin admin] PATH_INFO: `/v3/users/8c0918b021374866b7519684711b0c9e` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:55.885283 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c456f20-e672-43d4-bd54-495fb7b4fb6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c0918b021374866b7519684711b0c9e)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:55.887255 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c456f20-e672-43d4-bd54-495fb7b4fb6a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:55.934466 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:29:55.937886 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-5c456f20-e672-43d4-bd54-495fb7b4fb6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c0918b021374866b7519684711b0c9e'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:55.947187 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-5c456f20-e672-43d4-bd54-495fb7b4fb6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c0918b021374866b7519684711b0c9e'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:55.947896 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-5c456f20-e672-43d4-bd54-495fb7b4fb6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c0918b021374866b7519684711b0c9e'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:55.948534 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-5c456f20-e672-43d4-bd54-495fb7b4fb6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c0918b021374866b7519684711b0c9e'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:55.961601 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-5c456f20-e672-43d4-bd54-495fb7b4fb6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c0918b021374866b7519684711b0c9e'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:55.975138 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1254/2501] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:29:55 2022] DELETE /identity/v3/users/8c0918b021374866b7519684711b0c9e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:29:55.979797 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca750e-bfb4-4678-9b6b-070fa9c49dc5 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:55.980296 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca750e-bfb4-4678-9b6b-070fa9c49dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:55.980418 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca750e-bfb4-4678-9b6b-070fa9c49dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:55.997909 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-ddca750e-bfb4-4678-9b6b-070fa9c49dc5 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:29:55.999279 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ddca750e-bfb4-4678-9b6b-070fa9c49dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:56.062146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1248/2502] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:29:56.072000 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c456f20-e672-43d4-bd54-495fb7b4fb6a admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:56.073412 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-5c456f20-e672-43d4-bd54-495fb7b4fb6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:56.131839 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c456f20-e672-43d4-bd54-495fb7b4fb6a admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:56.135613 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f435a05-5175-4179-aa00-9930e4e384a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:56.136266 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f435a05-5175-4179-aa00-9930e4e384a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:56.136552 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f435a05-5175-4179-aa00-9930e4e384a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:56.136832 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f435a05-5175-4179-aa00-9930e4e384a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:56.147268 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f435a05-5175-4179-aa00-9930e4e384a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:56.148710 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f435a05-5175-4179-aa00-9930e4e384a6 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:56.158692 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1255/2503] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:29:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:29:56.432033 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca750e-bfb4-4678-9b6b-070fa9c49dc5 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:56.433534 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ddca750e-bfb4-4678-9b6b-070fa9c49dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:56.446682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca750e-bfb4-4678-9b6b-070fa9c49dc5 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:56.463888 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc654e-5e5c-4b10-a731-15aea6068b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:56.464782 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc654e-5e5c-4b10-a731-15aea6068b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:56.465055 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc654e-5e5c-4b10-a731-15aea6068b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:56.465325 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc654e-5e5c-4b10-a731-15aea6068b35 admin admin] PATH_INFO: `/v3/projects/e375fd852daf4f33bab2fc475809f7be` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:56.466783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc654e-5e5c-4b10-a731-15aea6068b35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e375fd852daf4f33bab2fc475809f7be)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:56.468703 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc654e-5e5c-4b10-a731-15aea6068b35 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:56.528183 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-61dc654e-5e5c-4b10-a731-15aea6068b35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e375fd852daf4f33bab2fc475809f7be', 'request_id': 'req-61dc654e-5e5c-4b10-a731-15aea6068b35'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:56.534584 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-61dc654e-5e5c-4b10-a731-15aea6068b35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e375fd852daf4f33bab2fc475809f7be', 'request_id': 'req-61dc654e-5e5c-4b10-a731-15aea6068b35'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:56.543125 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-61dc654e-5e5c-4b10-a731-15aea6068b35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e375fd852daf4f33bab2fc475809f7be', 'request_id': 'req-61dc654e-5e5c-4b10-a731-15aea6068b35'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:56.558260 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-61dc654e-5e5c-4b10-a731-15aea6068b35 admin admin] The token cache is being invalidate because project e375fd852daf4f33bab2fc475809f7be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:29:56.560574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-61dc654e-5e5c-4b10-a731-15aea6068b35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:56.560574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-61dc654e-5e5c-4b10-a731-15aea6068b35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:29:56.561589 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1249/2504] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:29:56 2022] DELETE /identity/v3/projects/e375fd852daf4f33bab2fc475809f7be => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:29:56.566449 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb051921-410a-4f16-a048-cbf49bea304f None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:56.566746 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb051921-410a-4f16-a048-cbf49bea304f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:56.567028 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb051921-410a-4f16-a048-cbf49bea304f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:56.585094 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-cb051921-410a-4f16-a048-cbf49bea304f None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:29:56.587057 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-cb051921-410a-4f16-a048-cbf49bea304f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:56.673878 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1256/2505] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:29:56.681489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cf4d8-50dc-4fc5-b1b7-19a9268e60df None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:56.681886 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cf4d8-50dc-4fc5-b1b7-19a9268e60df None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:56.682179 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cf4d8-50dc-4fc5-b1b7-19a9268e60df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:56.704680 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-fd7cf4d8-50dc-4fc5-b1b7-19a9268e60df None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:29:56.706453 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-fd7cf4d8-50dc-4fc5-b1b7-19a9268e60df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:56.721874 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1250/2506] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:29:56.725569 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb051921-410a-4f16-a048-cbf49bea304f None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:56.737096 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb051921-410a-4f16-a048-cbf49bea304f None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:56.742758 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c64942-79dc-4103-bb89-434b13019e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:56.743470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c64942-79dc-4103-bb89-434b13019e1a admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:56.743759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c64942-79dc-4103-bb89-434b13019e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:56.744039 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c64942-79dc-4103-bb89-434b13019e1a admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:56.744950 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c64942-79dc-4103-bb89-434b13019e1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:29:56.745343 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c64942-79dc-4103-bb89-434b13019e1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:56.747285 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c64942-79dc-4103-bb89-434b13019e1a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:56.762001 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1257/2507] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:29:56.766626 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7cf4d8-50dc-4fc5-b1b7-19a9268e60df None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:56.771611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:29:56.777451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7cf4d8-50dc-4fc5-b1b7-19a9268e60df None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:56.783682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fa8a9-cb5f-46a8-a469-c5a5f0f68220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:56.784548 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fa8a9-cb5f-46a8-a469-c5a5f0f68220 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:56.784826 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fa8a9-cb5f-46a8-a469-c5a5f0f68220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:56.785099 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fa8a9-cb5f-46a8-a469-c5a5f0f68220 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:56.785852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4fa8a9-cb5f-46a8-a469-c5a5f0f68220 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:56.787923 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4fa8a9-cb5f-46a8-a469-c5a5f0f68220 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:56.821235 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1251/2508] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:29:56 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:29:56.822270 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c64942-79dc-4103-bb89-434b13019e1a admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:56.834696 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c64942-79dc-4103-bb89-434b13019e1a admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:56.896428 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:29:56.909506 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b41a01-a91c-429d-8ca9-f36c658154e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:56.910238 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b41a01-a91c-429d-8ca9-f36c658154e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:56.910522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b41a01-a91c-429d-8ca9-f36c658154e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:56.910813 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b41a01-a91c-429d-8ca9-f36c658154e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:56.911957 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b41a01-a91c-429d-8ca9-f36c658154e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:56.914012 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b41a01-a91c-429d-8ca9-f36c658154e0 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:56.938726 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1258/2509] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:29:56 2022] POST /identity/v3/users => generated 286 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:29:56.943009 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fa8a9-cb5f-46a8-a469-c5a5f0f68220 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:56.954695 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fa8a9-cb5f-46a8-a469-c5a5f0f68220 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:56.960480 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08962212-b8bf-4fbd-8019-572258643ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:56.961159 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08962212-b8bf-4fbd-8019-572258643ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:56.961436 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08962212-b8bf-4fbd-8019-572258643ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:56.961709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08962212-b8bf-4fbd-8019-572258643ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:56.962503 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08962212-b8bf-4fbd-8019-572258643ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:56.964130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08962212-b8bf-4fbd-8019-572258643ab8 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:56.977548 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1252/2510] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:29:56.981341 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b41a01-a91c-429d-8ca9-f36c658154e0 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:56.995581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b41a01-a91c-429d-8ca9-f36c658154e0 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:57.001609 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36b40a-f352-4d4a-8e8e-4421dd319b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:57.002342 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36b40a-f352-4d4a-8e8e-4421dd319b03 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:57.002823 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36b40a-f352-4d4a-8e8e-4421dd319b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:57.003012 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36b40a-f352-4d4a-8e8e-4421dd319b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:57.003757 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36b40a-f352-4d4a-8e8e-4421dd319b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:57.005363 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36b40a-f352-4d4a-8e8e-4421dd319b03 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:57.016593 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1259/2511] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:29:57.021222 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08962212-b8bf-4fbd-8019-572258643ab8 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:57.031903 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08962212-b8bf-4fbd-8019-572258643ab8 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:57.036694 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6223775-e580-4267-9379-3b0bff4c8a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:57.037616 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6223775-e580-4267-9379-3b0bff4c8a2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:57.037918 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6223775-e580-4267-9379-3b0bff4c8a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:57.038195 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6223775-e580-4267-9379-3b0bff4c8a2a admin admin] PATH_INFO: `/v3/projects/0cef3d09e53b43f889ff7446e69f7477/users/98afac2fef274f40997b1535d113d9b1/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:57.054454 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6223775-e580-4267-9379-3b0bff4c8a2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cef3d09e53b43f889ff7446e69f7477, user_id=98afac2fef274f40997b1535d113d9b1, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:57.057234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6223775-e580-4267-9379-3b0bff4c8a2a admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:57.071783 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1253/2512] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:29:57 2022] PUT /identity/v3/projects/0cef3d09e53b43f889ff7446e69f7477/users/98afac2fef274f40997b1535d113d9b1/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:29:57.081092 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17b70e-7dac-4e3d-abc4-966c5c4e2633 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:57.081380 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17b70e-7dac-4e3d-abc4-966c5c4e2633 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:57.081684 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17b70e-7dac-4e3d-abc4-966c5c4e2633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:57.110978 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6b17b70e-7dac-4e3d-abc4-966c5c4e2633 None None] MFA Rules not processed for user `98afac2fef274f40997b1535d113d9b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:29:57.112232 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6b17b70e-7dac-4e3d-abc4-966c5c4e2633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:57.178751 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1260/2513] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:29:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:29:57.183382 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6223775-e580-4267-9379-3b0bff4c8a2a admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:57.246111 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6223775-e580-4267-9379-3b0bff4c8a2a admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:57.251205 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ad111-9a58-4ee9-9adf-b6ab64bc15ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:57.251872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ad111-9a58-4ee9-9adf-b6ab64bc15ec admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:57.252156 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ad111-9a58-4ee9-9adf-b6ab64bc15ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:57.252432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ad111-9a58-4ee9-9adf-b6ab64bc15ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:57.253119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ad111-9a58-4ee9-9adf-b6ab64bc15ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:57.255061 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ad111-9a58-4ee9-9adf-b6ab64bc15ec admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:57.281790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1254/2514] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:29:57 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:29:57.286053 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17b70e-7dac-4e3d-abc4-966c5c4e2633 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:57.298842 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17b70e-7dac-4e3d-abc4-966c5c4e2633 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:57.362702 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46d5a8-ab6d-4ff8-9094-dea409a25de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:57.363281 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46d5a8-ab6d-4ff8-9094-dea409a25de2 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:57.363569 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46d5a8-ab6d-4ff8-9094-dea409a25de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:57.363841 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46d5a8-ab6d-4ff8-9094-dea409a25de2 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:57.364548 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46d5a8-ab6d-4ff8-9094-dea409a25de2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:57.366532 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46d5a8-ab6d-4ff8-9094-dea409a25de2 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:57.387770 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1261/2515] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:29:57 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:29:57.391990 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ad111-9a58-4ee9-9adf-b6ab64bc15ec admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:57.402590 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ad111-9a58-4ee9-9adf-b6ab64bc15ec admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:57.407406 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f1f7e-8931-4c04-97cd-cfc0bdcaec1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:57.408078 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f1f7e-8931-4c04-97cd-cfc0bdcaec1d admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:57.408365 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f1f7e-8931-4c04-97cd-cfc0bdcaec1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:57.408645 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f1f7e-8931-4c04-97cd-cfc0bdcaec1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:57.409467 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f1f7e-8931-4c04-97cd-cfc0bdcaec1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:57.411144 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f1f7e-8931-4c04-97cd-cfc0bdcaec1d admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:57.423239 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1255/2516] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:29:57.427614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46d5a8-ab6d-4ff8-9094-dea409a25de2 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:57.438605 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46d5a8-ab6d-4ff8-9094-dea409a25de2 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:57.443260 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d18a05-94a8-4050-9c9a-95176de95984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:57.444173 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d18a05-94a8-4050-9c9a-95176de95984 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:57.444483 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d18a05-94a8-4050-9c9a-95176de95984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:57.444754 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d18a05-94a8-4050-9c9a-95176de95984 admin admin] PATH_INFO: `/v3/projects/d7b5ce251a3a46eca7f951387ea0a036/users/07db345d411d4bcba760a7f7960092e7/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:57.459845 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d18a05-94a8-4050-9c9a-95176de95984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7b5ce251a3a46eca7f951387ea0a036, user_id=07db345d411d4bcba760a7f7960092e7, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:57.462552 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d18a05-94a8-4050-9c9a-95176de95984 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:57.475904 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1262/2517] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:29:57 2022] PUT /identity/v3/projects/d7b5ce251a3a46eca7f951387ea0a036/users/07db345d411d4bcba760a7f7960092e7/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:29:57.481235 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f1f7e-8931-4c04-97cd-cfc0bdcaec1d admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:57.492146 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f1f7e-8931-4c04-97cd-cfc0bdcaec1d admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:57.549684 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297d263-07a3-486b-9ca4-8078fc6aa8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:57.550393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297d263-07a3-486b-9ca4-8078fc6aa8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:57.550705 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297d263-07a3-486b-9ca4-8078fc6aa8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:57.550983 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297d263-07a3-486b-9ca4-8078fc6aa8d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:57.551732 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297d263-07a3-486b-9ca4-8078fc6aa8d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:57.553398 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297d263-07a3-486b-9ca4-8078fc6aa8d8 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:57.564393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1256/2518] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:29:57.568723 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d18a05-94a8-4050-9c9a-95176de95984 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:57.579079 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d18a05-94a8-4050-9c9a-95176de95984 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:57.584194 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56499e5-0f53-4c3b-baee-b5ecbfb74497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:57.585078 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56499e5-0f53-4c3b-baee-b5ecbfb74497 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:57.585363 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56499e5-0f53-4c3b-baee-b5ecbfb74497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:57.585641 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56499e5-0f53-4c3b-baee-b5ecbfb74497 admin admin] PATH_INFO: `/v3/projects/d7b5ce251a3a46eca7f951387ea0a036/users/07db345d411d4bcba760a7f7960092e7/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:57.587725 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56499e5-0f53-4c3b-baee-b5ecbfb74497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7b5ce251a3a46eca7f951387ea0a036, user_id=07db345d411d4bcba760a7f7960092e7, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:57.590503 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56499e5-0f53-4c3b-baee-b5ecbfb74497 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:57.601879 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1263/2519] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:29:57 2022] PUT /identity/v3/projects/d7b5ce251a3a46eca7f951387ea0a036/users/07db345d411d4bcba760a7f7960092e7/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:29:57.613010 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bfd3a-a081-4e57-8074-e8c3b1d56128 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:57.613223 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bfd3a-a081-4e57-8074-e8c3b1d56128 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:57.613507 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bfd3a-a081-4e57-8074-e8c3b1d56128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:57.640287 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-db6bfd3a-a081-4e57-8074-e8c3b1d56128 None None] MFA Rules not processed for user `07db345d411d4bcba760a7f7960092e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:29:57.641517 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-db6bfd3a-a081-4e57-8074-e8c3b1d56128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:57.645539 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:29:57.713664 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1257/2520] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:29:57 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:29:57.726963 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56499e5-0f53-4c3b-baee-b5ecbfb74497 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:57.729406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f56499e5-0f53-4c3b-baee-b5ecbfb74497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:29:57.745230 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:29:57.796850 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56499e5-0f53-4c3b-baee-b5ecbfb74497 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:57.800524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03778eee-3525-4139-862f-fb392d506cea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:57.801177 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03778eee-3525-4139-862f-fb392d506cea service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:57.801462 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03778eee-3525-4139-862f-fb392d506cea service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:57.801737 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03778eee-3525-4139-862f-fb392d506cea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:57.812722 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03778eee-3525-4139-862f-fb392d506cea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:57.814212 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03778eee-3525-4139-862f-fb392d506cea service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:57.824045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1264/2521] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:29:57 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:29:57.897964 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bfd3a-a081-4e57-8074-e8c3b1d56128 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:29:57.908848 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bfd3a-a081-4e57-8074-e8c3b1d56128 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:29:57.914289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b7338-b624-40dc-8294-643a1318f5ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:29:57.915288 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b7338-b624-40dc-8294-643a1318f5ac service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:29:57.915710 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b7338-b624-40dc-8294-643a1318f5ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:29:57.916120 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b7338-b624-40dc-8294-643a1318f5ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:29:57.981019 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b7338-b624-40dc-8294-643a1318f5ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:29:57.983027 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b7338-b624-40dc-8294-643a1318f5ac service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:29:57.993161 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1258/2522] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:29:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:30:06.158157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03778eee-3525-4139-862f-fb392d506cea service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:06.160248 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-03778eee-3525-4139-862f-fb392d506cea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:06.230154 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03778eee-3525-4139-862f-fb392d506cea service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:06.235333 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a079f3-6cca-416f-837f-7bb72ab64437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:06.236208 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a079f3-6cca-416f-837f-7bb72ab64437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:06.236487 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a079f3-6cca-416f-837f-7bb72ab64437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:06.236758 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a079f3-6cca-416f-837f-7bb72ab64437 admin admin] PATH_INFO: `/v3/users/274d4a3254b745cbbed6a78a8f8bc91a` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:06.237996 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a079f3-6cca-416f-837f-7bb72ab64437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=274d4a3254b745cbbed6a78a8f8bc91a)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:06.239945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a079f3-6cca-416f-837f-7bb72ab64437 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:06.289306 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a5a079f3-6cca-416f-837f-7bb72ab64437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '274d4a3254b745cbbed6a78a8f8bc91a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:06.297087 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a5a079f3-6cca-416f-837f-7bb72ab64437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '274d4a3254b745cbbed6a78a8f8bc91a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:06.297803 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a5a079f3-6cca-416f-837f-7bb72ab64437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '274d4a3254b745cbbed6a78a8f8bc91a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:06.298447 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a5a079f3-6cca-416f-837f-7bb72ab64437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '274d4a3254b745cbbed6a78a8f8bc91a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:06.311406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a5a079f3-6cca-416f-837f-7bb72ab64437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '274d4a3254b745cbbed6a78a8f8bc91a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:06.324327 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1265/2523] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:30:06 2022] DELETE /identity/v3/users/274d4a3254b745cbbed6a78a8f8bc91a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:30:06.329085 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f9ee7-09e9-416a-87ee-8280fc6476e9 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:06.329619 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f9ee7-09e9-416a-87ee-8280fc6476e9 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:06.329619 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f9ee7-09e9-416a-87ee-8280fc6476e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:06.347482 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-5d6f9ee7-09e9-416a-87ee-8280fc6476e9 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:30:06.348631 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-5d6f9ee7-09e9-416a-87ee-8280fc6476e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:06.411282 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1259/2524] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:30:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:30:06.422352 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a079f3-6cca-416f-837f-7bb72ab64437 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:06.423793 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a5a079f3-6cca-416f-837f-7bb72ab64437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:06.459657 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:06.485094 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a079f3-6cca-416f-837f-7bb72ab64437 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:06.488796 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f29249-e667-46a1-8004-c51c471670a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:06.489451 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f29249-e667-46a1-8004-c51c471670a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:06.489736 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f29249-e667-46a1-8004-c51c471670a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:06.490045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f29249-e667-46a1-8004-c51c471670a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:06.500448 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f29249-e667-46a1-8004-c51c471670a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:06.502057 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f29249-e667-46a1-8004-c51c471670a3 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:06.511998 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1266/2525] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:30:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:30:06.835614 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f9ee7-09e9-416a-87ee-8280fc6476e9 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:06.837252 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-5d6f9ee7-09e9-416a-87ee-8280fc6476e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:06.857493 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f9ee7-09e9-416a-87ee-8280fc6476e9 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:06.872441 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d16b73-c879-421a-9c2f-dc2ed5492915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:06.874139 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d16b73-c879-421a-9c2f-dc2ed5492915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:06.874505 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d16b73-c879-421a-9c2f-dc2ed5492915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:06.874926 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d16b73-c879-421a-9c2f-dc2ed5492915 admin admin] PATH_INFO: `/v3/projects/1c5594eb3c42475a8cb6da9f5ca5f373` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:06.876303 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d16b73-c879-421a-9c2f-dc2ed5492915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c5594eb3c42475a8cb6da9f5ca5f373)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:06.878414 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d16b73-c879-421a-9c2f-dc2ed5492915 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:06.935311 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:06.947418 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-33d16b73-c879-421a-9c2f-dc2ed5492915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c5594eb3c42475a8cb6da9f5ca5f373', 'request_id': 'req-33d16b73-c879-421a-9c2f-dc2ed5492915'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:06.954674 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-33d16b73-c879-421a-9c2f-dc2ed5492915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c5594eb3c42475a8cb6da9f5ca5f373', 'request_id': 'req-33d16b73-c879-421a-9c2f-dc2ed5492915'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:06.962673 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-33d16b73-c879-421a-9c2f-dc2ed5492915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c5594eb3c42475a8cb6da9f5ca5f373', 'request_id': 'req-33d16b73-c879-421a-9c2f-dc2ed5492915'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:06.975553 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-33d16b73-c879-421a-9c2f-dc2ed5492915 admin admin] The token cache is being invalidate because project 1c5594eb3c42475a8cb6da9f5ca5f373 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:30:06.976126 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-33d16b73-c879-421a-9c2f-dc2ed5492915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:06.976809 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-33d16b73-c879-421a-9c2f-dc2ed5492915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:06.978427 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1260/2526] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:30:06 2022] DELETE /identity/v3/projects/1c5594eb3c42475a8cb6da9f5ca5f373 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:30:06.982912 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f29249-e667-46a1-8004-c51c471670a3 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:06.996157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f29249-e667-46a1-8004-c51c471670a3 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:07.063184 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6d457-c0dd-4abc-8733-dd782769edd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:07.064095 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6d457-c0dd-4abc-8733-dd782769edd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:07.064376 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6d457-c0dd-4abc-8733-dd782769edd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:07.064846 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6d457-c0dd-4abc-8733-dd782769edd7 admin admin] PATH_INFO: `/v3/users/ea9eb022975c4e38ab0c5f878af745d7` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:07.066518 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6d457-c0dd-4abc-8733-dd782769edd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea9eb022975c4e38ab0c5f878af745d7)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:07.068502 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6d457-c0dd-4abc-8733-dd782769edd7 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:07.180730 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-87d6d457-c0dd-4abc-8733-dd782769edd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea9eb022975c4e38ab0c5f878af745d7'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:07.192549 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-87d6d457-c0dd-4abc-8733-dd782769edd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea9eb022975c4e38ab0c5f878af745d7'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:07.193452 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-87d6d457-c0dd-4abc-8733-dd782769edd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea9eb022975c4e38ab0c5f878af745d7'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:07.196056 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-87d6d457-c0dd-4abc-8733-dd782769edd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea9eb022975c4e38ab0c5f878af745d7'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:07.217814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-87d6d457-c0dd-4abc-8733-dd782769edd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea9eb022975c4e38ab0c5f878af745d7'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:07.250181 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1267/2527] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:30:06 2022] DELETE /identity/v3/users/ea9eb022975c4e38ab0c5f878af745d7 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:30:07.594745 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d16b73-c879-421a-9c2f-dc2ed5492915 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:07.597466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-33d16b73-c879-421a-9c2f-dc2ed5492915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:07.616472 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d16b73-c879-421a-9c2f-dc2ed5492915 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:07.705071 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cb858-4ebb-4468-8720-55005b18ccb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:07.706301 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cb858-4ebb-4468-8720-55005b18ccb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:07.706808 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cb858-4ebb-4468-8720-55005b18ccb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:07.707280 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cb858-4ebb-4468-8720-55005b18ccb4 admin admin] PATH_INFO: `/v3/projects/dcab245d33094420ba7badbc55980811` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:07.708757 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0cb858-4ebb-4468-8720-55005b18ccb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcab245d33094420ba7badbc55980811)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:07.711837 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0cb858-4ebb-4468-8720-55005b18ccb4 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:07.768658 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-cf0cb858-4ebb-4468-8720-55005b18ccb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcab245d33094420ba7badbc55980811', 'request_id': 'req-cf0cb858-4ebb-4468-8720-55005b18ccb4'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:07.775575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-cf0cb858-4ebb-4468-8720-55005b18ccb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcab245d33094420ba7badbc55980811', 'request_id': 'req-cf0cb858-4ebb-4468-8720-55005b18ccb4'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:07.788176 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-cf0cb858-4ebb-4468-8720-55005b18ccb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcab245d33094420ba7badbc55980811', 'request_id': 'req-cf0cb858-4ebb-4468-8720-55005b18ccb4'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:07.800458 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-cf0cb858-4ebb-4468-8720-55005b18ccb4 admin admin] The token cache is being invalidate because project dcab245d33094420ba7badbc55980811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:30:07.800772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-cf0cb858-4ebb-4468-8720-55005b18ccb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:07.801444 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-cf0cb858-4ebb-4468-8720-55005b18ccb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:07.803055 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1261/2528] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:30:07 2022] DELETE /identity/v3/projects/dcab245d33094420ba7badbc55980811 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:30:07.808608 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298eb47-fc70-48e1-96bd-e2171d24303e None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:07.808814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298eb47-fc70-48e1-96bd-e2171d24303e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:07.809114 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298eb47-fc70-48e1-96bd-e2171d24303e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:07.831605 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-4298eb47-fc70-48e1-96bd-e2171d24303e None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:30:07.832836 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4298eb47-fc70-48e1-96bd-e2171d24303e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:07.884967 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:07.898702 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1268/2529] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:30:07.907289 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2af391-fd90-4dc0-8ed8-b3f09e7a4728 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:07.907601 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2af391-fd90-4dc0-8ed8-b3f09e7a4728 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:07.907877 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2af391-fd90-4dc0-8ed8-b3f09e7a4728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:07.928014 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-0c2af391-fd90-4dc0-8ed8-b3f09e7a4728 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:30:07.929240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0c2af391-fd90-4dc0-8ed8-b3f09e7a4728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:07.937546 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1262/2530] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:30:07.941954 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298eb47-fc70-48e1-96bd-e2171d24303e None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:07.957538 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298eb47-fc70-48e1-96bd-e2171d24303e None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:07.962675 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df2fd3-98f3-4df0-a2df-85ff01a86dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:07.963344 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df2fd3-98f3-4df0-a2df-85ff01a86dcd admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:07.963630 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df2fd3-98f3-4df0-a2df-85ff01a86dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:07.963908 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df2fd3-98f3-4df0-a2df-85ff01a86dcd admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:07.964634 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df2fd3-98f3-4df0-a2df-85ff01a86dcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:30:07.964945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df2fd3-98f3-4df0-a2df-85ff01a86dcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:07.967434 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df2fd3-98f3-4df0-a2df-85ff01a86dcd admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:07.979631 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1269/2531] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:30:07.984480 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2af391-fd90-4dc0-8ed8-b3f09e7a4728 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:07.994027 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2af391-fd90-4dc0-8ed8-b3f09e7a4728 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:07.998915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8170b8-2809-497e-a6c9-c80487f6df5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:07.999573 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8170b8-2809-497e-a6c9-c80487f6df5b admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:07.999859 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8170b8-2809-497e-a6c9-c80487f6df5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:08.000138 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8170b8-2809-497e-a6c9-c80487f6df5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:08.000832 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8170b8-2809-497e-a6c9-c80487f6df5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:08.002828 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8170b8-2809-497e-a6c9-c80487f6df5b admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:08.030001 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1263/2532] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:30:07 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:30:08.034747 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df2fd3-98f3-4df0-a2df-85ff01a86dcd admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:08.045022 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df2fd3-98f3-4df0-a2df-85ff01a86dcd admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:08.107050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca2756-53e7-4a9c-bb27-006b3678f198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:08.107731 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca2756-53e7-4a9c-bb27-006b3678f198 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:08.108014 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca2756-53e7-4a9c-bb27-006b3678f198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:08.108289 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca2756-53e7-4a9c-bb27-006b3678f198 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:08.108997 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca2756-53e7-4a9c-bb27-006b3678f198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:08.111177 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca2756-53e7-4a9c-bb27-006b3678f198 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:08.133136 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1270/2533] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:30:08 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:30:08.137324 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8170b8-2809-497e-a6c9-c80487f6df5b admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:08.148471 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8170b8-2809-497e-a6c9-c80487f6df5b admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:08.153327 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646afcda-b022-421f-84ae-bc04aca5ac26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:08.154050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646afcda-b022-421f-84ae-bc04aca5ac26 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:08.154337 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646afcda-b022-421f-84ae-bc04aca5ac26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:08.154614 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646afcda-b022-421f-84ae-bc04aca5ac26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:08.155437 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646afcda-b022-421f-84ae-bc04aca5ac26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:08.157330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646afcda-b022-421f-84ae-bc04aca5ac26 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:08.168339 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1264/2534] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:30:08.172642 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca2756-53e7-4a9c-bb27-006b3678f198 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:08.182937 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca2756-53e7-4a9c-bb27-006b3678f198 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:08.188435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e95b68-ca77-49e9-945f-b129e2a1839c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:08.189103 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e95b68-ca77-49e9-945f-b129e2a1839c admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:08.189393 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e95b68-ca77-49e9-945f-b129e2a1839c admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:08.189705 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e95b68-ca77-49e9-945f-b129e2a1839c admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:08.190484 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e95b68-ca77-49e9-945f-b129e2a1839c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:08.192092 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e95b68-ca77-49e9-945f-b129e2a1839c admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:08.203154 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1271/2535] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:30:08.207361 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646afcda-b022-421f-84ae-bc04aca5ac26 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:08.217581 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646afcda-b022-421f-84ae-bc04aca5ac26 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:08.222383 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aeb455-d59c-4bd8-b6d0-2f52b2df6d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:08.223370 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aeb455-d59c-4bd8-b6d0-2f52b2df6d46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:08.223634 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aeb455-d59c-4bd8-b6d0-2f52b2df6d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:08.223912 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aeb455-d59c-4bd8-b6d0-2f52b2df6d46 admin admin] PATH_INFO: `/v3/projects/9a12f06abf3543f9b74d323553f9e880/users/4325382e40f6458194532175dd146523/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:08.235467 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:08.240826 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aeb455-d59c-4bd8-b6d0-2f52b2df6d46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a12f06abf3543f9b74d323553f9e880, user_id=4325382e40f6458194532175dd146523, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:08.244152 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aeb455-d59c-4bd8-b6d0-2f52b2df6d46 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:08.260285 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1265/2536] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:30:08 2022] PUT /identity/v3/projects/9a12f06abf3543f9b74d323553f9e880/users/4325382e40f6458194532175dd146523/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:30:08.271850 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9013fd8-4bf2-4da6-952c-8b8c3f3ce58d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:08.272146 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9013fd8-4bf2-4da6-952c-8b8c3f3ce58d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:08.272427 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9013fd8-4bf2-4da6-952c-8b8c3f3ce58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:08.300031 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-a9013fd8-4bf2-4da6-952c-8b8c3f3ce58d None None] MFA Rules not processed for user `4325382e40f6458194532175dd146523`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:30:08.301259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a9013fd8-4bf2-4da6-952c-8b8c3f3ce58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:08.384859 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1272/2537] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:30:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:30:08.389784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aeb455-d59c-4bd8-b6d0-2f52b2df6d46 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:08.429182 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9013fd8-4bf2-4da6-952c-8b8c3f3ce58d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:08.430729 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a9013fd8-4bf2-4da6-952c-8b8c3f3ce58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:08.466097 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aeb455-d59c-4bd8-b6d0-2f52b2df6d46 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:08.472473 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d735c6a-9f8f-4719-bedb-e44b096e78fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:08.473576 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d735c6a-9f8f-4719-bedb-e44b096e78fb admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:08.474163 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d735c6a-9f8f-4719-bedb-e44b096e78fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:08.474310 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d735c6a-9f8f-4719-bedb-e44b096e78fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:08.475286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d735c6a-9f8f-4719-bedb-e44b096e78fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:08.478891 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d735c6a-9f8f-4719-bedb-e44b096e78fb admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:08.507513 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9013fd8-4bf2-4da6-952c-8b8c3f3ce58d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:08.513135 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26b5ba-02e9-4693-98d4-088c602ac2ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:08.514161 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26b5ba-02e9-4693-98d4-088c602ac2ad service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:08.515195 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26b5ba-02e9-4693-98d4-088c602ac2ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:08.515644 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26b5ba-02e9-4693-98d4-088c602ac2ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:08.518297 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-7a26b5ba-02e9-4693-98d4-088c602ac2ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:08.526100 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1266/2538] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:30:08 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:30:08.528598 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:08.533731 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d735c6a-9f8f-4719-bedb-e44b096e78fb admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:08.535682 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26b5ba-02e9-4693-98d4-088c602ac2ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:08.538056 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26b5ba-02e9-4693-98d4-088c602ac2ad service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:08.553594 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1273/2539] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:30:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:30:08.633233 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d735c6a-9f8f-4719-bedb-e44b096e78fb admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:08.640942 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e3c8e-8f20-428c-be0e-9e4055a6d499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:08.643407 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e3c8e-8f20-428c-be0e-9e4055a6d499 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:08.644068 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e3c8e-8f20-428c-be0e-9e4055a6d499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:08.644559 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e3c8e-8f20-428c-be0e-9e4055a6d499 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:08.645775 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e3c8e-8f20-428c-be0e-9e4055a6d499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:08.650716 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e3c8e-8f20-428c-be0e-9e4055a6d499 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:08.690393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1267/2540] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:30:08 2022] POST /identity/v3/users => generated 295 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:30:08.691635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26b5ba-02e9-4693-98d4-088c602ac2ad service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:08.707125 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26b5ba-02e9-4693-98d4-088c602ac2ad service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:08.713672 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abad868-acb6-4232-9d03-688ff2684f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:08.714703 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abad868-acb6-4232-9d03-688ff2684f98 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:08.714987 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abad868-acb6-4232-9d03-688ff2684f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:08.715350 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abad868-acb6-4232-9d03-688ff2684f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:08.716284 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abad868-acb6-4232-9d03-688ff2684f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:08.718382 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abad868-acb6-4232-9d03-688ff2684f98 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:08.729176 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1274/2541] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:30:08.735586 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e3c8e-8f20-428c-be0e-9e4055a6d499 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:08.749027 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e3c8e-8f20-428c-be0e-9e4055a6d499 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:08.752773 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcacab6-7b3b-4f52-a8c5-a98c92a0afd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:08.753683 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcacab6-7b3b-4f52-a8c5-a98c92a0afd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:08.754005 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcacab6-7b3b-4f52-a8c5-a98c92a0afd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:08.754287 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcacab6-7b3b-4f52-a8c5-a98c92a0afd6 admin admin] PATH_INFO: `/v3/projects/cd6fc6fb26cb46b1a2e713cf46c7be96/users/51b3231ce66c46cd98994a215eba8791/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:08.771992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcacab6-7b3b-4f52-a8c5-a98c92a0afd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd6fc6fb26cb46b1a2e713cf46c7be96, user_id=51b3231ce66c46cd98994a215eba8791, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:08.774738 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcacab6-7b3b-4f52-a8c5-a98c92a0afd6 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:08.790028 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1268/2542] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:30:08 2022] PUT /identity/v3/projects/cd6fc6fb26cb46b1a2e713cf46c7be96/users/51b3231ce66c46cd98994a215eba8791/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:30:08.794679 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abad868-acb6-4232-9d03-688ff2684f98 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:08.806960 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abad868-acb6-4232-9d03-688ff2684f98 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:08.882485 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e180141-fb2c-4d3c-8e6d-29f18b13aa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:08.883279 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e180141-fb2c-4d3c-8e6d-29f18b13aa88 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:08.883887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e180141-fb2c-4d3c-8e6d-29f18b13aa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:08.883887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e180141-fb2c-4d3c-8e6d-29f18b13aa88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:08.884586 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e180141-fb2c-4d3c-8e6d-29f18b13aa88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:08.886299 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e180141-fb2c-4d3c-8e6d-29f18b13aa88 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:08.897397 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1275/2543] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:30:08.901455 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcacab6-7b3b-4f52-a8c5-a98c92a0afd6 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:08.912887 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcacab6-7b3b-4f52-a8c5-a98c92a0afd6 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:08.926606 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026788f8-30ac-45c7-a208-1a4925066dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:08.927600 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026788f8-30ac-45c7-a208-1a4925066dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:08.927953 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026788f8-30ac-45c7-a208-1a4925066dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:08.928238 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026788f8-30ac-45c7-a208-1a4925066dc7 admin admin] PATH_INFO: `/v3/projects/cd6fc6fb26cb46b1a2e713cf46c7be96/users/51b3231ce66c46cd98994a215eba8791/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:08.930392 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026788f8-30ac-45c7-a208-1a4925066dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd6fc6fb26cb46b1a2e713cf46c7be96, user_id=51b3231ce66c46cd98994a215eba8791, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:08.933114 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026788f8-30ac-45c7-a208-1a4925066dc7 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:08.949246 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1269/2544] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:30:08 2022] PUT /identity/v3/projects/cd6fc6fb26cb46b1a2e713cf46c7be96/users/51b3231ce66c46cd98994a215eba8791/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:30:08.961319 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651b5fc-56f3-479b-9416-98683b95475f None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:08.961711 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651b5fc-56f3-479b-9416-98683b95475f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:08.962102 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651b5fc-56f3-479b-9416-98683b95475f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:08.997563 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-c651b5fc-56f3-479b-9416-98683b95475f None None] MFA Rules not processed for user `51b3231ce66c46cd98994a215eba8791`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:30:08.998820 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c651b5fc-56f3-479b-9416-98683b95475f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:09.087443 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1276/2545] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:30:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:30:09.099543 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026788f8-30ac-45c7-a208-1a4925066dc7 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:09.101450 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-026788f8-30ac-45c7-a208-1a4925066dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:09.155679 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:09.190923 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026788f8-30ac-45c7-a208-1a4925066dc7 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:09.194689 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35fbbd-9fd1-466c-aefd-a94665ad8661 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:09.195353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35fbbd-9fd1-466c-aefd-a94665ad8661 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:09.195672 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35fbbd-9fd1-466c-aefd-a94665ad8661 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:09.196174 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35fbbd-9fd1-466c-aefd-a94665ad8661 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:09.268826 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35fbbd-9fd1-466c-aefd-a94665ad8661 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:09.270340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35fbbd-9fd1-466c-aefd-a94665ad8661 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:09.281455 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1270/2546] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:30:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:30:11.947928 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651b5fc-56f3-479b-9416-98683b95475f None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:11.953246 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c651b5fc-56f3-479b-9416-98683b95475f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:12.029969 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651b5fc-56f3-479b-9416-98683b95475f None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:12.034504 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360f961-6e24-4bce-bd16-a1082f375dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:12.035431 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360f961-6e24-4bce-bd16-a1082f375dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:12.035807 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360f961-6e24-4bce-bd16-a1082f375dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:12.036037 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360f961-6e24-4bce-bd16-a1082f375dcb admin admin] PATH_INFO: `/v3/users/e1e8c33d40ee43c693c28beaf794dff5` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:12.037239 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360f961-6e24-4bce-bd16-a1082f375dcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1e8c33d40ee43c693c28beaf794dff5)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:12.039252 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360f961-6e24-4bce-bd16-a1082f375dcb admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:12.044782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:12.087399 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f360f961-6e24-4bce-bd16-a1082f375dcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1e8c33d40ee43c693c28beaf794dff5'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:12.094537 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f360f961-6e24-4bce-bd16-a1082f375dcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1e8c33d40ee43c693c28beaf794dff5'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:12.095200 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f360f961-6e24-4bce-bd16-a1082f375dcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1e8c33d40ee43c693c28beaf794dff5'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:12.095801 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f360f961-6e24-4bce-bd16-a1082f375dcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1e8c33d40ee43c693c28beaf794dff5'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:12.108044 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f360f961-6e24-4bce-bd16-a1082f375dcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1e8c33d40ee43c693c28beaf794dff5'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:12.121784 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1277/2547] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:30:11 2022] DELETE /identity/v3/users/e1e8c33d40ee43c693c28beaf794dff5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:30:12.319558 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35fbbd-9fd1-466c-aefd-a94665ad8661 service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:12.337967 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35fbbd-9fd1-466c-aefd-a94665ad8661 service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:12.419791 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1da2d-de19-4bc0-bf0c-196998751667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:12.421184 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1da2d-de19-4bc0-bf0c-196998751667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:12.421961 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1da2d-de19-4bc0-bf0c-196998751667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:12.422406 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1da2d-de19-4bc0-bf0c-196998751667 admin admin] PATH_INFO: `/v3/projects/bb59e7902bf94c62a6f9b5e7e4cbabe3` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:12.424223 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1da2d-de19-4bc0-bf0c-196998751667 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb59e7902bf94c62a6f9b5e7e4cbabe3)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:12.427703 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1da2d-de19-4bc0-bf0c-196998751667 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:12.493138 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-08c1da2d-de19-4bc0-bf0c-196998751667 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb59e7902bf94c62a6f9b5e7e4cbabe3', 'request_id': 'req-08c1da2d-de19-4bc0-bf0c-196998751667'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:12.504484 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-08c1da2d-de19-4bc0-bf0c-196998751667 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb59e7902bf94c62a6f9b5e7e4cbabe3', 'request_id': 'req-08c1da2d-de19-4bc0-bf0c-196998751667'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:12.514418 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-08c1da2d-de19-4bc0-bf0c-196998751667 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb59e7902bf94c62a6f9b5e7e4cbabe3', 'request_id': 'req-08c1da2d-de19-4bc0-bf0c-196998751667'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:12.529251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-08c1da2d-de19-4bc0-bf0c-196998751667 admin admin] The token cache is being invalidate because project bb59e7902bf94c62a6f9b5e7e4cbabe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:30:12.530103 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-08c1da2d-de19-4bc0-bf0c-196998751667 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:12.531114 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-08c1da2d-de19-4bc0-bf0c-196998751667 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:12.533256 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1271/2548] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:30:12 2022] DELETE /identity/v3/projects/bb59e7902bf94c62a6f9b5e7e4cbabe3 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:30:12.538147 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c13fd0-19ca-4e8a-8714-b8f5920374cb None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:12.538447 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c13fd0-19ca-4e8a-8714-b8f5920374cb None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:12.538728 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c13fd0-19ca-4e8a-8714-b8f5920374cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:12.568216 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-05c13fd0-19ca-4e8a-8714-b8f5920374cb None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:30:12.571376 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-05c13fd0-19ca-4e8a-8714-b8f5920374cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:12.653744 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1278/2549] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:30:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:30:12.661715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55516dd-d4dd-4f0b-a6d5-ec3d5a4536d4 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:12.662224 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55516dd-d4dd-4f0b-a6d5-ec3d5a4536d4 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:12.662515 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55516dd-d4dd-4f0b-a6d5-ec3d5a4536d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:12.685017 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-f55516dd-d4dd-4f0b-a6d5-ec3d5a4536d4 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:30:12.686253 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f55516dd-d4dd-4f0b-a6d5-ec3d5a4536d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:12.698110 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1272/2550] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:30:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:30:12.705424 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c13fd0-19ca-4e8a-8714-b8f5920374cb None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:12.724204 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c13fd0-19ca-4e8a-8714-b8f5920374cb None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:12.732152 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23737a55-b4fb-44de-bba3-3f460711db9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:12.733167 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23737a55-b4fb-44de-bba3-3f460711db9f admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:12.733605 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23737a55-b4fb-44de-bba3-3f460711db9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:12.734326 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23737a55-b4fb-44de-bba3-3f460711db9f admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:12.735516 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23737a55-b4fb-44de-bba3-3f460711db9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:30:12.736851 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23737a55-b4fb-44de-bba3-3f460711db9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:12.739785 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23737a55-b4fb-44de-bba3-3f460711db9f admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:12.758368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1279/2551] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:30:12.763876 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55516dd-d4dd-4f0b-a6d5-ec3d5a4536d4 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:12.774128 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:12.787116 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55516dd-d4dd-4f0b-a6d5-ec3d5a4536d4 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:12.801264 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a839f5d-92bd-4234-8f9f-539505e90193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:12.802945 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a839f5d-92bd-4234-8f9f-539505e90193 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:12.803594 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a839f5d-92bd-4234-8f9f-539505e90193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:12.804087 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a839f5d-92bd-4234-8f9f-539505e90193 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:12.805617 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a839f5d-92bd-4234-8f9f-539505e90193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:12.810593 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a839f5d-92bd-4234-8f9f-539505e90193 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:12.883060 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1273/2552] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:30:12 2022] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:30:12.890346 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23737a55-b4fb-44de-bba3-3f460711db9f admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:12.930199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23737a55-b4fb-44de-bba3-3f460711db9f admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:13.100560 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8e0b6-2943-47cc-bec2-7fc18d373b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:13.102029 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8e0b6-2943-47cc-bec2-7fc18d373b0e admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:13.102459 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8e0b6-2943-47cc-bec2-7fc18d373b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:13.102928 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8e0b6-2943-47cc-bec2-7fc18d373b0e admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:13.103645 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8e0b6-2943-47cc-bec2-7fc18d373b0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:13.105576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8e0b6-2943-47cc-bec2-7fc18d373b0e admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:13.130203 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:13.136288 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1280/2553] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:30:12 2022] POST /identity/v3/users => generated 283 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:30:13.140152 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a839f5d-92bd-4234-8f9f-539505e90193 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:13.155447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a839f5d-92bd-4234-8f9f-539505e90193 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:13.160100 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcd76a-3d0c-48e1-854f-afa6ca2ff04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:13.160768 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcd76a-3d0c-48e1-854f-afa6ca2ff04a admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:13.161052 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcd76a-3d0c-48e1-854f-afa6ca2ff04a admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:13.161329 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcd76a-3d0c-48e1-854f-afa6ca2ff04a admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:13.162086 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbcd76a-3d0c-48e1-854f-afa6ca2ff04a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:13.163700 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbcd76a-3d0c-48e1-854f-afa6ca2ff04a admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:13.175265 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1274/2554] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:30:13.179363 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8e0b6-2943-47cc-bec2-7fc18d373b0e admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:13.191170 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8e0b6-2943-47cc-bec2-7fc18d373b0e admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:13.197502 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3c386-969b-4f98-9961-a71509f8f8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:13.198659 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3c386-969b-4f98-9961-a71509f8f8af admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:13.199263 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3c386-969b-4f98-9961-a71509f8f8af admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:13.199825 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3c386-969b-4f98-9961-a71509f8f8af admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:13.201074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3c386-969b-4f98-9961-a71509f8f8af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:13.203862 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3c386-969b-4f98-9961-a71509f8f8af admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:13.224749 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1281/2555] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:30:13.226187 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcd76a-3d0c-48e1-854f-afa6ca2ff04a admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:13.237252 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcd76a-3d0c-48e1-854f-afa6ca2ff04a admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:13.242147 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da27868-667b-459d-a8fa-0c34f6f2e456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:13.243051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da27868-667b-459d-a8fa-0c34f6f2e456 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:13.243339 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da27868-667b-459d-a8fa-0c34f6f2e456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:13.243620 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da27868-667b-459d-a8fa-0c34f6f2e456 admin admin] PATH_INFO: `/v3/projects/db435a44a0514ff5ad26c99a69c0c42f/users/6919e82d43094f3f9b7724b79d15be1d/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:13.261790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da27868-667b-459d-a8fa-0c34f6f2e456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db435a44a0514ff5ad26c99a69c0c42f, user_id=6919e82d43094f3f9b7724b79d15be1d, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:13.264643 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da27868-667b-459d-a8fa-0c34f6f2e456 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:13.278189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1275/2556] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:30:13 2022] PUT /identity/v3/projects/db435a44a0514ff5ad26c99a69c0c42f/users/6919e82d43094f3f9b7724b79d15be1d/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:30:13.288596 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493fb39-92bb-4a7e-abe7-6b5ca6d16d61 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:13.288886 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493fb39-92bb-4a7e-abe7-6b5ca6d16d61 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:13.289162 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493fb39-92bb-4a7e-abe7-6b5ca6d16d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:13.317388 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-4493fb39-92bb-4a7e-abe7-6b5ca6d16d61 None None] MFA Rules not processed for user `6919e82d43094f3f9b7724b79d15be1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:30:13.319285 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4493fb39-92bb-4a7e-abe7-6b5ca6d16d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:13.386867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1282/2557] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:30:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:30:13.391325 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da27868-667b-459d-a8fa-0c34f6f2e456 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:13.461137 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da27868-667b-459d-a8fa-0c34f6f2e456 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:13.467319 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e01391-bbe5-492f-abcf-f0746123eb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:13.468027 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e01391-bbe5-492f-abcf-f0746123eb3e admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:13.468317 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e01391-bbe5-492f-abcf-f0746123eb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:13.468602 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e01391-bbe5-492f-abcf-f0746123eb3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:13.469605 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e01391-bbe5-492f-abcf-f0746123eb3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:13.471400 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e01391-bbe5-492f-abcf-f0746123eb3e admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:13.500246 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1276/2558] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:30:13 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:30:13.504560 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493fb39-92bb-4a7e-abe7-6b5ca6d16d61 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:13.518178 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493fb39-92bb-4a7e-abe7-6b5ca6d16d61 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:13.585554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f69eca-7803-4fea-ade4-e5d42f1847d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:13.586277 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f69eca-7803-4fea-ade4-e5d42f1847d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:13.586558 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f69eca-7803-4fea-ade4-e5d42f1847d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:13.586833 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f69eca-7803-4fea-ade4-e5d42f1847d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:13.587534 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f69eca-7803-4fea-ade4-e5d42f1847d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:13.589468 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f69eca-7803-4fea-ade4-e5d42f1847d3 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:13.612945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1283/2559] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:30:13 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:30:13.617399 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e01391-bbe5-492f-abcf-f0746123eb3e admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:13.628608 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e01391-bbe5-492f-abcf-f0746123eb3e admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:13.633630 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08dc40-5ab6-4a43-84d0-64ebc1e04a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:13.634345 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08dc40-5ab6-4a43-84d0-64ebc1e04a7d admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:13.634634 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08dc40-5ab6-4a43-84d0-64ebc1e04a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:13.634933 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08dc40-5ab6-4a43-84d0-64ebc1e04a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:13.635663 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b08dc40-5ab6-4a43-84d0-64ebc1e04a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:13.637481 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b08dc40-5ab6-4a43-84d0-64ebc1e04a7d admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:13.650784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1277/2560] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:30:13.659357 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f69eca-7803-4fea-ade4-e5d42f1847d3 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:13.673658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f69eca-7803-4fea-ade4-e5d42f1847d3 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:13.679223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f02629-7018-498f-a720-4b898d00dd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:13.680084 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f02629-7018-498f-a720-4b898d00dd6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:13.680367 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f02629-7018-498f-a720-4b898d00dd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:13.680647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f02629-7018-498f-a720-4b898d00dd6a admin admin] PATH_INFO: `/v3/projects/b2de9dca5c264420aeed23c2e0924097/users/4e5c66fed6934a8aac694c48061e2ff4/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:13.697620 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f02629-7018-498f-a720-4b898d00dd6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2de9dca5c264420aeed23c2e0924097, user_id=4e5c66fed6934a8aac694c48061e2ff4, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:13.700906 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f02629-7018-498f-a720-4b898d00dd6a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:13.715145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1284/2561] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:30:13 2022] PUT /identity/v3/projects/b2de9dca5c264420aeed23c2e0924097/users/4e5c66fed6934a8aac694c48061e2ff4/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:30:13.719605 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08dc40-5ab6-4a43-84d0-64ebc1e04a7d admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:13.730085 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08dc40-5ab6-4a43-84d0-64ebc1e04a7d admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:13.788374 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d228e-5034-4c24-a735-2540c3692069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:13.804889 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d228e-5034-4c24-a735-2540c3692069 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:13.804889 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d228e-5034-4c24-a735-2540c3692069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:13.804889 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d228e-5034-4c24-a735-2540c3692069 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:13.804889 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d228e-5034-4c24-a735-2540c3692069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:13.804889 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d228e-5034-4c24-a735-2540c3692069 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:13.813903 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1278/2562] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:30:13.818260 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f02629-7018-498f-a720-4b898d00dd6a admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:13.829363 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f02629-7018-498f-a720-4b898d00dd6a admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:13.834379 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ca530-8788-4f0e-8e5e-72bc645ad25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:13.835398 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ca530-8788-4f0e-8e5e-72bc645ad25e admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:13.835550 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ca530-8788-4f0e-8e5e-72bc645ad25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:13.835805 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ca530-8788-4f0e-8e5e-72bc645ad25e admin admin] PATH_INFO: `/v3/projects/b2de9dca5c264420aeed23c2e0924097/users/4e5c66fed6934a8aac694c48061e2ff4/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:13.837764 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ca530-8788-4f0e-8e5e-72bc645ad25e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2de9dca5c264420aeed23c2e0924097, user_id=4e5c66fed6934a8aac694c48061e2ff4, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:13.840566 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ca530-8788-4f0e-8e5e-72bc645ad25e admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:13.851972 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1285/2563] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:30:13 2022] PUT /identity/v3/projects/b2de9dca5c264420aeed23c2e0924097/users/4e5c66fed6934a8aac694c48061e2ff4/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:30:13.864592 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f636bcc-7113-4384-9329-60c09cf4137d None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:13.864896 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f636bcc-7113-4384-9329-60c09cf4137d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:13.865296 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f636bcc-7113-4384-9329-60c09cf4137d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:13.897081 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-0f636bcc-7113-4384-9329-60c09cf4137d None None] MFA Rules not processed for user `4e5c66fed6934a8aac694c48061e2ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:30:13.898622 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0f636bcc-7113-4384-9329-60c09cf4137d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:13.905034 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:13.973038 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1279/2564] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:30:13 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:30:13.987710 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ca530-8788-4f0e-8e5e-72bc645ad25e admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:13.989432 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e79ca530-8788-4f0e-8e5e-72bc645ad25e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:14.026087 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:14.052649 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ca530-8788-4f0e-8e5e-72bc645ad25e admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:14.056319 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73dd34-258d-4c3f-a90a-2c064233bf11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:14.056978 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73dd34-258d-4c3f-a90a-2c064233bf11 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:14.057349 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73dd34-258d-4c3f-a90a-2c064233bf11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:14.057524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73dd34-258d-4c3f-a90a-2c064233bf11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:14.076775 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae73dd34-258d-4c3f-a90a-2c064233bf11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:14.078390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae73dd34-258d-4c3f-a90a-2c064233bf11 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:14.089557 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1286/2565] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:30:13 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:30:14.089965 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f636bcc-7113-4384-9329-60c09cf4137d None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:14.091647 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0f636bcc-7113-4384-9329-60c09cf4137d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:14.113077 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f636bcc-7113-4384-9329-60c09cf4137d None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:14.118565 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95911b77-8128-4957-99f9-38ae8cad5b29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:14.119244 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95911b77-8128-4957-99f9-38ae8cad5b29 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:14.119572 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95911b77-8128-4957-99f9-38ae8cad5b29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:14.119841 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95911b77-8128-4957-99f9-38ae8cad5b29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:14.122649 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-95911b77-8128-4957-99f9-38ae8cad5b29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:14.251740 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95911b77-8128-4957-99f9-38ae8cad5b29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:14.253222 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95911b77-8128-4957-99f9-38ae8cad5b29 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:14.260242 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73dd34-258d-4c3f-a90a-2c064233bf11 service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:14.263312 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1280/2566] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:30:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:30:14.270586 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73dd34-258d-4c3f-a90a-2c064233bf11 service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:14.274463 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb686b4-6bc3-4152-9a75-c52e3e30d648 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:14.275171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb686b4-6bc3-4152-9a75-c52e3e30d648 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:14.275460 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb686b4-6bc3-4152-9a75-c52e3e30d648 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:14.275743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb686b4-6bc3-4152-9a75-c52e3e30d648 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:14.338883 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb686b4-6bc3-4152-9a75-c52e3e30d648 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:14.341939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb686b4-6bc3-4152-9a75-c52e3e30d648 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:14.351800 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1287/2567] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:30:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:30:16.958695 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95911b77-8128-4957-99f9-38ae8cad5b29 service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:16.968272 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95911b77-8128-4957-99f9-38ae8cad5b29 service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:16.973940 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d3055-0d16-4db1-a585-8c4d3bcaff5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:16.974353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d3055-0d16-4db1-a585-8c4d3bcaff5a service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:16.974639 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d3055-0d16-4db1-a585-8c4d3bcaff5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:16.975014 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d3055-0d16-4db1-a585-8c4d3bcaff5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:16.977277 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-060d3055-0d16-4db1-a585-8c4d3bcaff5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:17.047248 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d3055-0d16-4db1-a585-8c4d3bcaff5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:17.048891 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d3055-0d16-4db1-a585-8c4d3bcaff5a service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:17.059787 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1281/2568] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:30:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:30:24.347623 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=40 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:27.054415 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=84 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:37.672551 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099854a-0a93-4756-8014-37c3993ab219 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:37.673144 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099854a-0a93-4756-8014-37c3993ab219 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:37.673408 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099854a-0a93-4756-8014-37c3993ab219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:37.692243 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-8099854a-0a93-4756-8014-37c3993ab219 None None] MFA Rules not processed for user `0c58a96bc78b4fa3a643125a6140bb00`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:30:37.693525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8099854a-0a93-4756-8014-37c3993ab219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:37.701785 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1288/2569] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:30:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:30:38.148747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d3055-0d16-4db1-a585-8c4d3bcaff5a service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:38.150426 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-060d3055-0d16-4db1-a585-8c4d3bcaff5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:38.216955 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d3055-0d16-4db1-a585-8c4d3bcaff5a service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:38.220743 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2d650-d7af-48d8-8f2e-2427d0a33557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:38.221444 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2d650-d7af-48d8-8f2e-2427d0a33557 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:38.221672 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2d650-d7af-48d8-8f2e-2427d0a33557 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:38.222057 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2d650-d7af-48d8-8f2e-2427d0a33557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:38.223900 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-afc2d650-d7af-48d8-8f2e-2427d0a33557 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:38.234051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2d650-d7af-48d8-8f2e-2427d0a33557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:38.235492 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2d650-d7af-48d8-8f2e-2427d0a33557 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:38.244296 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1282/2570] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:30:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:30:43.339826 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099854a-0a93-4756-8014-37c3993ab219 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:43.436353 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099854a-0a93-4756-8014-37c3993ab219 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:43.442543 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4350c20-6715-428e-a648-63872f42eebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:43.443436 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4350c20-6715-428e-a648-63872f42eebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:43.443724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4350c20-6715-428e-a648-63872f42eebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:43.443994 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4350c20-6715-428e-a648-63872f42eebf admin admin] PATH_INFO: `/v3/users/6919e82d43094f3f9b7724b79d15be1d` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:43.445493 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4350c20-6715-428e-a648-63872f42eebf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6919e82d43094f3f9b7724b79d15be1d)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:43.447441 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4350c20-6715-428e-a648-63872f42eebf admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:43.514149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f4350c20-6715-428e-a648-63872f42eebf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6919e82d43094f3f9b7724b79d15be1d'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:43.521986 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f4350c20-6715-428e-a648-63872f42eebf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6919e82d43094f3f9b7724b79d15be1d'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:43.522777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f4350c20-6715-428e-a648-63872f42eebf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6919e82d43094f3f9b7724b79d15be1d'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:43.523566 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f4350c20-6715-428e-a648-63872f42eebf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6919e82d43094f3f9b7724b79d15be1d'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:43.541072 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f4350c20-6715-428e-a648-63872f42eebf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6919e82d43094f3f9b7724b79d15be1d'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:43.565082 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1289/2571] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:30:43 2022] DELETE /identity/v3/users/6919e82d43094f3f9b7724b79d15be1d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:30:43.571172 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ac74f-b9d8-4520-af45-b54d17920a56 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:43.571687 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ac74f-b9d8-4520-af45-b54d17920a56 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:43.571784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ac74f-b9d8-4520-af45-b54d17920a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:43.595627 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-005ac74f-b9d8-4520-af45-b54d17920a56 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:30:43.597794 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-005ac74f-b9d8-4520-af45-b54d17920a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:43.679423 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1283/2572] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:30:43.691599 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4350c20-6715-428e-a648-63872f42eebf admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:43.693052 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f4350c20-6715-428e-a648-63872f42eebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:43.754878 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4350c20-6715-428e-a648-63872f42eebf admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:43.758876 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec025b9d-8a31-42d5-ade0-337c80837672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:43.759532 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec025b9d-8a31-42d5-ade0-337c80837672 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:43.759822 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec025b9d-8a31-42d5-ade0-337c80837672 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:43.760096 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec025b9d-8a31-42d5-ade0-337c80837672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:43.771312 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec025b9d-8a31-42d5-ade0-337c80837672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:43.772769 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec025b9d-8a31-42d5-ade0-337c80837672 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:43.785702 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1290/2573] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:30:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:30:44.119417 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ac74f-b9d8-4520-af45-b54d17920a56 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:44.122118 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-005ac74f-b9d8-4520-af45-b54d17920a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:44.144537 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ac74f-b9d8-4520-af45-b54d17920a56 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:44.152506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5ba99-0527-47f9-b0d6-6453a2188569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:44.155010 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5ba99-0527-47f9-b0d6-6453a2188569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:44.155657 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5ba99-0527-47f9-b0d6-6453a2188569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:44.156227 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5ba99-0527-47f9-b0d6-6453a2188569 admin admin] PATH_INFO: `/v3/projects/db435a44a0514ff5ad26c99a69c0c42f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:44.159703 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad5ba99-0527-47f9-b0d6-6453a2188569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db435a44a0514ff5ad26c99a69c0c42f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:44.162070 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad5ba99-0527-47f9-b0d6-6453a2188569 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:44.236163 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-dad5ba99-0527-47f9-b0d6-6453a2188569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db435a44a0514ff5ad26c99a69c0c42f', 'request_id': 'req-dad5ba99-0527-47f9-b0d6-6453a2188569'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:44.244682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-dad5ba99-0527-47f9-b0d6-6453a2188569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db435a44a0514ff5ad26c99a69c0c42f', 'request_id': 'req-dad5ba99-0527-47f9-b0d6-6453a2188569'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:44.257974 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-dad5ba99-0527-47f9-b0d6-6453a2188569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db435a44a0514ff5ad26c99a69c0c42f', 'request_id': 'req-dad5ba99-0527-47f9-b0d6-6453a2188569'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:44.272301 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-dad5ba99-0527-47f9-b0d6-6453a2188569 admin admin] The token cache is being invalidate because project db435a44a0514ff5ad26c99a69c0c42f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:30:44.273388 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-dad5ba99-0527-47f9-b0d6-6453a2188569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:44.274279 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-dad5ba99-0527-47f9-b0d6-6453a2188569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:44.276074 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1284/2574] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:30:44 2022] DELETE /identity/v3/projects/db435a44a0514ff5ad26c99a69c0c42f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:30:44.280865 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec025b9d-8a31-42d5-ade0-337c80837672 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:44.291870 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec025b9d-8a31-42d5-ade0-337c80837672 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:44.309356 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:44.361975 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f2f04-2441-4e07-9316-71f4a514df2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:44.362852 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f2f04-2441-4e07-9316-71f4a514df2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:44.363132 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f2f04-2441-4e07-9316-71f4a514df2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:44.363411 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f2f04-2441-4e07-9316-71f4a514df2f admin admin] PATH_INFO: `/v3/users/4e5c66fed6934a8aac694c48061e2ff4` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:44.364944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f2f04-2441-4e07-9316-71f4a514df2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e5c66fed6934a8aac694c48061e2ff4)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:44.366924 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f2f04-2441-4e07-9316-71f4a514df2f admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:44.422688 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a94f2f04-2441-4e07-9316-71f4a514df2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e5c66fed6934a8aac694c48061e2ff4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:44.429618 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a94f2f04-2441-4e07-9316-71f4a514df2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e5c66fed6934a8aac694c48061e2ff4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:44.430332 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a94f2f04-2441-4e07-9316-71f4a514df2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e5c66fed6934a8aac694c48061e2ff4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:44.430948 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a94f2f04-2441-4e07-9316-71f4a514df2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e5c66fed6934a8aac694c48061e2ff4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:44.445522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a94f2f04-2441-4e07-9316-71f4a514df2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e5c66fed6934a8aac694c48061e2ff4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:44.460612 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1291/2575] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:30:44 2022] DELETE /identity/v3/users/4e5c66fed6934a8aac694c48061e2ff4 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:30:44.760923 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5ba99-0527-47f9-b0d6-6453a2188569 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:44.763684 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-dad5ba99-0527-47f9-b0d6-6453a2188569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:44.785525 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5ba99-0527-47f9-b0d6-6453a2188569 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:44.818021 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:44.862092 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6579d-9cd5-48b1-8019-c7f7112cf01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:44.863049 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6579d-9cd5-48b1-8019-c7f7112cf01a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:44.863338 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6579d-9cd5-48b1-8019-c7f7112cf01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:44.863644 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6579d-9cd5-48b1-8019-c7f7112cf01a admin admin] PATH_INFO: `/v3/projects/b2de9dca5c264420aeed23c2e0924097` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:44.865028 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6579d-9cd5-48b1-8019-c7f7112cf01a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2de9dca5c264420aeed23c2e0924097)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:44.867304 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6579d-9cd5-48b1-8019-c7f7112cf01a admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:44.918122 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9bd6579d-9cd5-48b1-8019-c7f7112cf01a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2de9dca5c264420aeed23c2e0924097', 'request_id': 'req-9bd6579d-9cd5-48b1-8019-c7f7112cf01a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:44.927942 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9bd6579d-9cd5-48b1-8019-c7f7112cf01a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2de9dca5c264420aeed23c2e0924097', 'request_id': 'req-9bd6579d-9cd5-48b1-8019-c7f7112cf01a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:44.940968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9bd6579d-9cd5-48b1-8019-c7f7112cf01a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2de9dca5c264420aeed23c2e0924097', 'request_id': 'req-9bd6579d-9cd5-48b1-8019-c7f7112cf01a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:44.953598 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9bd6579d-9cd5-48b1-8019-c7f7112cf01a admin admin] The token cache is being invalidate because project b2de9dca5c264420aeed23c2e0924097 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:30:44.953799 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9bd6579d-9cd5-48b1-8019-c7f7112cf01a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:44.954463 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9bd6579d-9cd5-48b1-8019-c7f7112cf01a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:44.956010 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1285/2576] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:30:44 2022] DELETE /identity/v3/projects/b2de9dca5c264420aeed23c2e0924097 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:30:44.961020 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295a449-f096-423a-b2a7-14bdcb6e6200 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:44.961330 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295a449-f096-423a-b2a7-14bdcb6e6200 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:44.961655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295a449-f096-423a-b2a7-14bdcb6e6200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:44.984802 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-8295a449-f096-423a-b2a7-14bdcb6e6200 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:30:44.986439 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8295a449-f096-423a-b2a7-14bdcb6e6200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:45.051354 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1292/2577] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:30:45.059701 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154594af-ec41-47c2-8b0f-b6f1d0e6410b None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:45.060440 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154594af-ec41-47c2-8b0f-b6f1d0e6410b None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:45.060440 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154594af-ec41-47c2-8b0f-b6f1d0e6410b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:45.081620 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-154594af-ec41-47c2-8b0f-b6f1d0e6410b None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:30:45.082854 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-154594af-ec41-47c2-8b0f-b6f1d0e6410b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:45.091798 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1286/2578] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:30:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:30:45.096686 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295a449-f096-423a-b2a7-14bdcb6e6200 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:45.107198 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295a449-f096-423a-b2a7-14bdcb6e6200 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:45.113349 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0cff0-3814-46de-8a65-6797995f800c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:45.114355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0cff0-3814-46de-8a65-6797995f800c admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:45.114813 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0cff0-3814-46de-8a65-6797995f800c admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:45.115342 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0cff0-3814-46de-8a65-6797995f800c admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:45.115928 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0cff0-3814-46de-8a65-6797995f800c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:30:45.116243 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0cff0-3814-46de-8a65-6797995f800c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:45.118013 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0cff0-3814-46de-8a65-6797995f800c admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:45.131535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1293/2579] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:30:45.137157 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154594af-ec41-47c2-8b0f-b6f1d0e6410b None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:45.147261 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154594af-ec41-47c2-8b0f-b6f1d0e6410b None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:45.152277 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73053b9-9f2d-429c-90c3-cb0bc79560ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:45.152934 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73053b9-9f2d-429c-90c3-cb0bc79560ce admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:45.153220 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73053b9-9f2d-429c-90c3-cb0bc79560ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:45.153496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73053b9-9f2d-429c-90c3-cb0bc79560ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:45.154395 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73053b9-9f2d-429c-90c3-cb0bc79560ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:45.156711 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73053b9-9f2d-429c-90c3-cb0bc79560ce admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:45.186159 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1287/2580] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:30:45 2022] POST /identity/v3/projects => generated 401 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:30:45.190471 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0cff0-3814-46de-8a65-6797995f800c admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:45.202421 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0cff0-3814-46de-8a65-6797995f800c admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:45.222047 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:45.277518 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993e49c-1c52-4b3e-b54a-63751f9fe2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:45.278239 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993e49c-1c52-4b3e-b54a-63751f9fe2f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:45.278526 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993e49c-1c52-4b3e-b54a-63751f9fe2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:45.278805 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993e49c-1c52-4b3e-b54a-63751f9fe2f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:45.279554 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993e49c-1c52-4b3e-b54a-63751f9fe2f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:45.281952 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993e49c-1c52-4b3e-b54a-63751f9fe2f7 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:45.310522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1294/2581] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:30:45 2022] POST /identity/v3/users => generated 301 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:30:45.311712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73053b9-9f2d-429c-90c3-cb0bc79560ce admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:45.328408 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73053b9-9f2d-429c-90c3-cb0bc79560ce admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:45.333532 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236ff2a-ce8e-479d-93c0-23c2de7200f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:45.334246 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236ff2a-ce8e-479d-93c0-23c2de7200f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:45.334535 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236ff2a-ce8e-479d-93c0-23c2de7200f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:45.334813 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236ff2a-ce8e-479d-93c0-23c2de7200f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:45.335558 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236ff2a-ce8e-479d-93c0-23c2de7200f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:45.337170 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236ff2a-ce8e-479d-93c0-23c2de7200f4 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:45.351500 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1288/2582] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:30:45.354282 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993e49c-1c52-4b3e-b54a-63751f9fe2f7 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:45.368827 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993e49c-1c52-4b3e-b54a-63751f9fe2f7 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:45.374334 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab00675-fa49-4b16-821c-8f97a75db38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:45.375011 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab00675-fa49-4b16-821c-8f97a75db38a admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:45.375303 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab00675-fa49-4b16-821c-8f97a75db38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:45.375585 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab00675-fa49-4b16-821c-8f97a75db38a admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:45.376317 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab00675-fa49-4b16-821c-8f97a75db38a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:45.377970 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab00675-fa49-4b16-821c-8f97a75db38a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:45.390635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1295/2583] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:30:45.395639 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236ff2a-ce8e-479d-93c0-23c2de7200f4 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:45.408868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236ff2a-ce8e-479d-93c0-23c2de7200f4 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:45.414106 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7f112-de3d-4859-9444-93490324fcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:45.414918 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7f112-de3d-4859-9444-93490324fcca admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:45.415251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7f112-de3d-4859-9444-93490324fcca admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:45.415484 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7f112-de3d-4859-9444-93490324fcca admin admin] PATH_INFO: `/v3/projects/561dc2b2ae7f4ec6a1afe56211132ec9/users/48c5d0de67174edd9b16ac99af488b25/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:45.434889 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7f112-de3d-4859-9444-93490324fcca admin admin] RBAC: Authorizing `identity:create_grant(project_id=561dc2b2ae7f4ec6a1afe56211132ec9, user_id=48c5d0de67174edd9b16ac99af488b25, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:45.439747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7f112-de3d-4859-9444-93490324fcca admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:45.460683 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1289/2584] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:30:45 2022] PUT /identity/v3/projects/561dc2b2ae7f4ec6a1afe56211132ec9/users/48c5d0de67174edd9b16ac99af488b25/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:30:45.473935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d01c8-4d75-4b94-8f71-15ee2c9dc6fc None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:45.474377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d01c8-4d75-4b94-8f71-15ee2c9dc6fc None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:45.474674 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d01c8-4d75-4b94-8f71-15ee2c9dc6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:45.503645 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-242d01c8-4d75-4b94-8f71-15ee2c9dc6fc None None] MFA Rules not processed for user `48c5d0de67174edd9b16ac99af488b25`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:30:45.504863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-242d01c8-4d75-4b94-8f71-15ee2c9dc6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:45.574879 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1296/2585] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:30:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:30:45.580478 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7f112-de3d-4859-9444-93490324fcca admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:45.637511 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:45.650545 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7f112-de3d-4859-9444-93490324fcca admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:45.657745 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70653c1-701c-4e6a-a472-654a5f5def90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:45.658510 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70653c1-701c-4e6a-a472-654a5f5def90 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:45.658882 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70653c1-701c-4e6a-a472-654a5f5def90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:45.659217 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70653c1-701c-4e6a-a472-654a5f5def90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:45.659944 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70653c1-701c-4e6a-a472-654a5f5def90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:45.662491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70653c1-701c-4e6a-a472-654a5f5def90 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:45.691086 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1290/2586] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:30:45 2022] POST /identity/v3/projects => generated 399 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:30:45.696063 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d01c8-4d75-4b94-8f71-15ee2c9dc6fc None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:45.715113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d01c8-4d75-4b94-8f71-15ee2c9dc6fc None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:45.801801 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9f530-302a-4960-bbde-3164050ac378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:45.802811 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9f530-302a-4960-bbde-3164050ac378 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:45.803161 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9f530-302a-4960-bbde-3164050ac378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:45.803668 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9f530-302a-4960-bbde-3164050ac378 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:45.804961 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da9f530-302a-4960-bbde-3164050ac378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:45.808342 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da9f530-302a-4960-bbde-3164050ac378 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:45.839884 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1297/2587] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:30:45 2022] POST /identity/v3/users => generated 306 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:30:45.844109 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70653c1-701c-4e6a-a472-654a5f5def90 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:45.856037 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70653c1-701c-4e6a-a472-654a5f5def90 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:45.863790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7fa765-7ae5-4413-8a1b-64c4851271fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:45.864848 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7fa765-7ae5-4413-8a1b-64c4851271fd admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:45.865353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7fa765-7ae5-4413-8a1b-64c4851271fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:45.865866 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7fa765-7ae5-4413-8a1b-64c4851271fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:45.867256 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7fa765-7ae5-4413-8a1b-64c4851271fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:45.870649 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7fa765-7ae5-4413-8a1b-64c4851271fd admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:45.891030 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1291/2588] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:30:45.895177 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9f530-302a-4960-bbde-3164050ac378 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:45.909501 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9f530-302a-4960-bbde-3164050ac378 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:45.923827 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ddaab0-6f82-46d1-a9a8-7633d59b396b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:45.925604 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddaab0-6f82-46d1-a9a8-7633d59b396b admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:45.925971 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddaab0-6f82-46d1-a9a8-7633d59b396b admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:45.926261 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddaab0-6f82-46d1-a9a8-7633d59b396b admin admin] PATH_INFO: `/v3/projects/612ff5004fd44334a15e218b61ff5281/users/a0dc7f2774e948608db9fdfe3db94ff4/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:45.945103 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ddaab0-6f82-46d1-a9a8-7633d59b396b admin admin] RBAC: Authorizing `identity:create_grant(project_id=612ff5004fd44334a15e218b61ff5281, user_id=a0dc7f2774e948608db9fdfe3db94ff4, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:45.947821 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ddaab0-6f82-46d1-a9a8-7633d59b396b admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:45.953323 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:45.969190 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1298/2589] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:30:45 2022] PUT /identity/v3/projects/612ff5004fd44334a15e218b61ff5281/users/a0dc7f2774e948608db9fdfe3db94ff4/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:30:45.973588 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7fa765-7ae5-4413-8a1b-64c4851271fd admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:45.985987 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7fa765-7ae5-4413-8a1b-64c4851271fd admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:46.065968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c13e83-681b-4990-a668-b8a40bc49afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:46.066560 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c13e83-681b-4990-a668-b8a40bc49afa admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:46.066845 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c13e83-681b-4990-a668-b8a40bc49afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:46.067124 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c13e83-681b-4990-a668-b8a40bc49afa admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:46.067982 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c13e83-681b-4990-a668-b8a40bc49afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:46.069595 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c13e83-681b-4990-a668-b8a40bc49afa admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:46.080819 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1292/2590] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:30:46.085474 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ddaab0-6f82-46d1-a9a8-7633d59b396b admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:46.098858 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ddaab0-6f82-46d1-a9a8-7633d59b396b admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:46.104503 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2acd4-47f3-4243-b251-d015cbdad967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:46.105732 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2acd4-47f3-4243-b251-d015cbdad967 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:46.106228 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2acd4-47f3-4243-b251-d015cbdad967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:46.106602 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2acd4-47f3-4243-b251-d015cbdad967 admin admin] PATH_INFO: `/v3/projects/612ff5004fd44334a15e218b61ff5281/users/a0dc7f2774e948608db9fdfe3db94ff4/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:46.109573 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2acd4-47f3-4243-b251-d015cbdad967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=612ff5004fd44334a15e218b61ff5281, user_id=a0dc7f2774e948608db9fdfe3db94ff4, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:46.113939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2acd4-47f3-4243-b251-d015cbdad967 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:46.129352 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1299/2591] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:30:46 2022] PUT /identity/v3/projects/612ff5004fd44334a15e218b61ff5281/users/a0dc7f2774e948608db9fdfe3db94ff4/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:30:46.142964 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86b8ed-01bd-453e-870e-62b9437aff9d None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:46.143337 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86b8ed-01bd-453e-870e-62b9437aff9d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:46.143801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86b8ed-01bd-453e-870e-62b9437aff9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:46.182408 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-fd86b8ed-01bd-453e-870e-62b9437aff9d None None] MFA Rules not processed for user `a0dc7f2774e948608db9fdfe3db94ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:30:46.183690 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-fd86b8ed-01bd-453e-870e-62b9437aff9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:46.286453 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1293/2592] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:30:46 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:30:46.304442 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2acd4-47f3-4243-b251-d015cbdad967 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:46.306303 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-48a2acd4-47f3-4243-b251-d015cbdad967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:46.413031 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2acd4-47f3-4243-b251-d015cbdad967 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:46.423531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa9d4a-9540-4746-86a6-4a2261d05ea8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:46.424274 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa9d4a-9540-4746-86a6-4a2261d05ea8 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:46.424558 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa9d4a-9540-4746-86a6-4a2261d05ea8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:46.425268 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa9d4a-9540-4746-86a6-4a2261d05ea8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:46.441712 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa9d4a-9540-4746-86a6-4a2261d05ea8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:46.443932 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa9d4a-9540-4746-86a6-4a2261d05ea8 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:46.460533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1300/2593] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:30:46 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:30:46.560246 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86b8ed-01bd-453e-870e-62b9437aff9d None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:46.578959 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86b8ed-01bd-453e-870e-62b9437aff9d None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:46.584682 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76438f1e-bc2a-4b1f-9dfe-4501f57124f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:46.585417 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76438f1e-bc2a-4b1f-9dfe-4501f57124f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:46.585723 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76438f1e-bc2a-4b1f-9dfe-4501f57124f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:46.586031 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76438f1e-bc2a-4b1f-9dfe-4501f57124f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:46.661461 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:46.678205 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76438f1e-bc2a-4b1f-9dfe-4501f57124f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:46.679824 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76438f1e-bc2a-4b1f-9dfe-4501f57124f7 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:46.702763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1294/2594] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:30:46 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:30:52.147929 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa9d4a-9540-4746-86a6-4a2261d05ea8 service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:52.222283 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa9d4a-9540-4746-86a6-4a2261d05ea8 service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:52.228028 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb721b-f96f-4373-b9ab-ee73c8515565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:52.228912 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb721b-f96f-4373-b9ab-ee73c8515565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:52.229201 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb721b-f96f-4373-b9ab-ee73c8515565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:52.230392 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb721b-f96f-4373-b9ab-ee73c8515565 admin admin] PATH_INFO: `/v3/users/48c5d0de67174edd9b16ac99af488b25` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:52.231523 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb721b-f96f-4373-b9ab-ee73c8515565 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48c5d0de67174edd9b16ac99af488b25)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:52.233991 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb721b-f96f-4373-b9ab-ee73c8515565 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:52.288667 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2ebb721b-f96f-4373-b9ab-ee73c8515565 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48c5d0de67174edd9b16ac99af488b25'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:52.301853 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2ebb721b-f96f-4373-b9ab-ee73c8515565 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48c5d0de67174edd9b16ac99af488b25'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:52.302607 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2ebb721b-f96f-4373-b9ab-ee73c8515565 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48c5d0de67174edd9b16ac99af488b25'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:52.303355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2ebb721b-f96f-4373-b9ab-ee73c8515565 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48c5d0de67174edd9b16ac99af488b25'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:52.316770 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2ebb721b-f96f-4373-b9ab-ee73c8515565 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48c5d0de67174edd9b16ac99af488b25'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:52.333923 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1301/2595] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:30:52 2022] DELETE /identity/v3/users/48c5d0de67174edd9b16ac99af488b25 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:30:52.338664 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268859d-5035-437b-a3c2-18eb6cb9aa49 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:52.339638 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268859d-5035-437b-a3c2-18eb6cb9aa49 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:52.339876 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268859d-5035-437b-a3c2-18eb6cb9aa49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:52.362694 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-b268859d-5035-437b-a3c2-18eb6cb9aa49 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:30:52.364104 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-b268859d-5035-437b-a3c2-18eb6cb9aa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:52.434702 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1295/2596] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:30:52.446638 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb721b-f96f-4373-b9ab-ee73c8515565 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:52.448643 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2ebb721b-f96f-4373-b9ab-ee73c8515565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:52.457861 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:52.533480 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb721b-f96f-4373-b9ab-ee73c8515565 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:52.537590 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d55ce-e3ec-4b52-82b0-f01564c62d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:52.538291 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d55ce-e3ec-4b52-82b0-f01564c62d18 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:52.538582 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d55ce-e3ec-4b52-82b0-f01564c62d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:52.538857 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d55ce-e3ec-4b52-82b0-f01564c62d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:52.550396 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d55ce-e3ec-4b52-82b0-f01564c62d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:52.551850 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d55ce-e3ec-4b52-82b0-f01564c62d18 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:52.561939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1302/2597] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:30:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:30:52.866093 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268859d-5035-437b-a3c2-18eb6cb9aa49 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:52.867519 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-b268859d-5035-437b-a3c2-18eb6cb9aa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:52.881286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268859d-5035-437b-a3c2-18eb6cb9aa49 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:52.886941 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c73325-44f3-470e-bd53-585c879886ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:52.887970 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c73325-44f3-470e-bd53-585c879886ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:52.888309 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c73325-44f3-470e-bd53-585c879886ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:52.888589 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c73325-44f3-470e-bd53-585c879886ae admin admin] PATH_INFO: `/v3/projects/561dc2b2ae7f4ec6a1afe56211132ec9` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:52.889877 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c73325-44f3-470e-bd53-585c879886ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=561dc2b2ae7f4ec6a1afe56211132ec9)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:52.891812 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c73325-44f3-470e-bd53-585c879886ae admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:52.943038 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f6c73325-44f3-470e-bd53-585c879886ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '561dc2b2ae7f4ec6a1afe56211132ec9', 'request_id': 'req-f6c73325-44f3-470e-bd53-585c879886ae'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:52.950550 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f6c73325-44f3-470e-bd53-585c879886ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '561dc2b2ae7f4ec6a1afe56211132ec9', 'request_id': 'req-f6c73325-44f3-470e-bd53-585c879886ae'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:52.960630 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f6c73325-44f3-470e-bd53-585c879886ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '561dc2b2ae7f4ec6a1afe56211132ec9', 'request_id': 'req-f6c73325-44f3-470e-bd53-585c879886ae'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:52.980232 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f6c73325-44f3-470e-bd53-585c879886ae admin admin] The token cache is being invalidate because project 561dc2b2ae7f4ec6a1afe56211132ec9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:30:52.980518 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f6c73325-44f3-470e-bd53-585c879886ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:52.981178 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f6c73325-44f3-470e-bd53-585c879886ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:52.983369 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1296/2598] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:30:52 2022] DELETE /identity/v3/projects/561dc2b2ae7f4ec6a1afe56211132ec9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:30:52.987742 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d55ce-e3ec-4b52-82b0-f01564c62d18 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:52.997464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d55ce-e3ec-4b52-82b0-f01564c62d18 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:53.070986 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba1ae8-7d87-4b37-8605-8eb941c0488a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:53.072371 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba1ae8-7d87-4b37-8605-8eb941c0488a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:53.072843 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba1ae8-7d87-4b37-8605-8eb941c0488a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:53.073351 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba1ae8-7d87-4b37-8605-8eb941c0488a admin admin] PATH_INFO: `/v3/users/a0dc7f2774e948608db9fdfe3db94ff4` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:53.075845 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba1ae8-7d87-4b37-8605-8eb941c0488a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0dc7f2774e948608db9fdfe3db94ff4)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:53.079219 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba1ae8-7d87-4b37-8605-8eb941c0488a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:53.136524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4fba1ae8-7d87-4b37-8605-8eb941c0488a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0dc7f2774e948608db9fdfe3db94ff4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:53.144302 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4fba1ae8-7d87-4b37-8605-8eb941c0488a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0dc7f2774e948608db9fdfe3db94ff4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:53.145070 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4fba1ae8-7d87-4b37-8605-8eb941c0488a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0dc7f2774e948608db9fdfe3db94ff4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:53.145872 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4fba1ae8-7d87-4b37-8605-8eb941c0488a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0dc7f2774e948608db9fdfe3db94ff4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:53.159223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4fba1ae8-7d87-4b37-8605-8eb941c0488a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0dc7f2774e948608db9fdfe3db94ff4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:53.173782 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1303/2599] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:30:52 2022] DELETE /identity/v3/users/a0dc7f2774e948608db9fdfe3db94ff4 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:30:53.203098 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c73325-44f3-470e-bd53-585c879886ae admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:53.204662 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f6c73325-44f3-470e-bd53-585c879886ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:53.219594 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c73325-44f3-470e-bd53-585c879886ae admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:53.297107 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b097a2-274a-45d8-8519-73b54bb17b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:53.298058 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b097a2-274a-45d8-8519-73b54bb17b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:53.298340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b097a2-274a-45d8-8519-73b54bb17b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:53.298611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b097a2-274a-45d8-8519-73b54bb17b50 admin admin] PATH_INFO: `/v3/users/4325382e40f6458194532175dd146523` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:53.299846 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b097a2-274a-45d8-8519-73b54bb17b50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4325382e40f6458194532175dd146523)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:53.301993 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b097a2-274a-45d8-8519-73b54bb17b50 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:53.316694 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:53.361711 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c5b097a2-274a-45d8-8519-73b54bb17b50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4325382e40f6458194532175dd146523'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:53.369026 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c5b097a2-274a-45d8-8519-73b54bb17b50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4325382e40f6458194532175dd146523'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:53.369792 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c5b097a2-274a-45d8-8519-73b54bb17b50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4325382e40f6458194532175dd146523'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:53.389106 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c5b097a2-274a-45d8-8519-73b54bb17b50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4325382e40f6458194532175dd146523'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:53.391140 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c5b097a2-274a-45d8-8519-73b54bb17b50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4325382e40f6458194532175dd146523'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:53.413794 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1297/2600] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:30:53 2022] DELETE /identity/v3/users/4325382e40f6458194532175dd146523 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:30:53.418820 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87289015-2003-42e9-894b-a7bc2f9916aa None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:53.419120 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87289015-2003-42e9-894b-a7bc2f9916aa None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:53.419405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87289015-2003-42e9-894b-a7bc2f9916aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:53.441164 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-87289015-2003-42e9-894b-a7bc2f9916aa None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:30:53.442580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-87289015-2003-42e9-894b-a7bc2f9916aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:53.472579 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:53.506799 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b097a2-274a-45d8-8519-73b54bb17b50 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:53.508337 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c5b097a2-274a-45d8-8519-73b54bb17b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:53.538828 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1304/2601] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:30:53.549965 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87289015-2003-42e9-894b-a7bc2f9916aa None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:53.551382 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-87289015-2003-42e9-894b-a7bc2f9916aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:53.588907 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b097a2-274a-45d8-8519-73b54bb17b50 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:53.594649 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9250295-07d4-43e5-b42a-374905d1aa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:53.595634 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9250295-07d4-43e5-b42a-374905d1aa01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:53.596163 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9250295-07d4-43e5-b42a-374905d1aa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:53.596672 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9250295-07d4-43e5-b42a-374905d1aa01 admin admin] PATH_INFO: `/v3/projects/612ff5004fd44334a15e218b61ff5281` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:53.598796 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9250295-07d4-43e5-b42a-374905d1aa01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=612ff5004fd44334a15e218b61ff5281)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:53.602798 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9250295-07d4-43e5-b42a-374905d1aa01 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:53.636048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87289015-2003-42e9-894b-a7bc2f9916aa None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:53.641944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2adfe-4567-4f94-9267-01a1b8f71693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:53.642899 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2adfe-4567-4f94-9267-01a1b8f71693 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:53.643347 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2adfe-4567-4f94-9267-01a1b8f71693 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:53.643809 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2adfe-4567-4f94-9267-01a1b8f71693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:53.658662 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce2adfe-4567-4f94-9267-01a1b8f71693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:53.660708 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce2adfe-4567-4f94-9267-01a1b8f71693 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:53.675675 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1305/2602] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:30:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:30:53.690779 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-b9250295-07d4-43e5-b42a-374905d1aa01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '612ff5004fd44334a15e218b61ff5281', 'request_id': 'req-b9250295-07d4-43e5-b42a-374905d1aa01'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:53.706915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-b9250295-07d4-43e5-b42a-374905d1aa01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '612ff5004fd44334a15e218b61ff5281', 'request_id': 'req-b9250295-07d4-43e5-b42a-374905d1aa01'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:53.717903 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-b9250295-07d4-43e5-b42a-374905d1aa01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '612ff5004fd44334a15e218b61ff5281', 'request_id': 'req-b9250295-07d4-43e5-b42a-374905d1aa01'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:53.741508 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-b9250295-07d4-43e5-b42a-374905d1aa01 admin admin] The token cache is being invalidate because project 612ff5004fd44334a15e218b61ff5281 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:30:53.741671 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-b9250295-07d4-43e5-b42a-374905d1aa01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:53.742753 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-b9250295-07d4-43e5-b42a-374905d1aa01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:53.749812 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1298/2603] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:30:53 2022] DELETE /identity/v3/projects/612ff5004fd44334a15e218b61ff5281 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:30:53.752197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a681f-41f7-494b-8658-29e46653d860 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:53.752555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a681f-41f7-494b-8658-29e46653d860 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:53.752987 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a681f-41f7-494b-8658-29e46653d860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:53.774265 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-c88a681f-41f7-494b-8658-29e46653d860 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:30:53.776264 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c88a681f-41f7-494b-8658-29e46653d860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:53.868067 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1306/2604] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:30:53.883337 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60455cbd-160f-4292-943e-bea873e5b938 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:53.883622 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60455cbd-160f-4292-943e-bea873e5b938 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:53.883900 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60455cbd-160f-4292-943e-bea873e5b938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:53.904320 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-60455cbd-160f-4292-943e-bea873e5b938 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:30:53.905574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-60455cbd-160f-4292-943e-bea873e5b938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:53.923147 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1299/2605] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:30:53.927534 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a681f-41f7-494b-8658-29e46653d860 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:53.940361 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a681f-41f7-494b-8658-29e46653d860 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:53.947351 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8803b-3352-420f-9e82-711128e96d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:53.948028 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8803b-3352-420f-9e82-711128e96d50 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:53.948340 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8803b-3352-420f-9e82-711128e96d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:53.948614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8803b-3352-420f-9e82-711128e96d50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:53.949346 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8803b-3352-420f-9e82-711128e96d50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:30:53.949656 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8803b-3352-420f-9e82-711128e96d50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:53.951339 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8803b-3352-420f-9e82-711128e96d50 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:53.967293 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1307/2606] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:30:53.971769 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60455cbd-160f-4292-943e-bea873e5b938 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:53.988891 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60455cbd-160f-4292-943e-bea873e5b938 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:53.996042 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d398698-568d-48a0-b224-ddc44cf95f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:53.996914 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d398698-568d-48a0-b224-ddc44cf95f08 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:53.997301 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d398698-568d-48a0-b224-ddc44cf95f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:53.997649 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d398698-568d-48a0-b224-ddc44cf95f08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:53.998662 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d398698-568d-48a0-b224-ddc44cf95f08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:54.001315 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d398698-568d-48a0-b224-ddc44cf95f08 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:54.018299 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:54.027522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8803b-3352-420f-9e82-711128e96d50 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:54.030532 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-65d8803b-3352-420f-9e82-711128e96d50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:54.051745 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8803b-3352-420f-9e82-711128e96d50 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:54.058092 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1300/2607] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:30:53 2022] POST /identity/v3/projects => generated 381 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:30:54.060653 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d398698-568d-48a0-b224-ddc44cf95f08 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:54.131074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:54.139347 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fead42-b693-4aa9-abb9-a3d8384ae921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:54.140360 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fead42-b693-4aa9-abb9-a3d8384ae921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:54.140647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fead42-b693-4aa9-abb9-a3d8384ae921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:54.140922 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fead42-b693-4aa9-abb9-a3d8384ae921 admin admin] PATH_INFO: `/v3/projects/9a12f06abf3543f9b74d323553f9e880` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:54.142188 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fead42-b693-4aa9-abb9-a3d8384ae921 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a12f06abf3543f9b74d323553f9e880)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:54.144285 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fead42-b693-4aa9-abb9-a3d8384ae921 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:54.151927 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d398698-568d-48a0-b224-ddc44cf95f08 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:54.157478 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c360a-15f9-4de9-8ba2-118be1b9489d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:54.158543 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c360a-15f9-4de9-8ba2-118be1b9489d admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:54.159034 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c360a-15f9-4de9-8ba2-118be1b9489d admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:54.159547 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c360a-15f9-4de9-8ba2-118be1b9489d admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:54.160806 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c360a-15f9-4de9-8ba2-118be1b9489d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:54.163044 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c360a-15f9-4de9-8ba2-118be1b9489d admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:54.185993 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1301/2608] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:30:54 2022] POST /identity/v3/users => generated 291 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:30:54.194376 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c360a-15f9-4de9-8ba2-118be1b9489d admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:54.202040 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c2fead42-b693-4aa9-abb9-a3d8384ae921 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a12f06abf3543f9b74d323553f9e880', 'request_id': 'req-c2fead42-b693-4aa9-abb9-a3d8384ae921'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:54.206975 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c360a-15f9-4de9-8ba2-118be1b9489d admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:54.211130 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c2fead42-b693-4aa9-abb9-a3d8384ae921 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a12f06abf3543f9b74d323553f9e880', 'request_id': 'req-c2fead42-b693-4aa9-abb9-a3d8384ae921'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:54.223425 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c2fead42-b693-4aa9-abb9-a3d8384ae921 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a12f06abf3543f9b74d323553f9e880', 'request_id': 'req-c2fead42-b693-4aa9-abb9-a3d8384ae921'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:54.238629 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c2fead42-b693-4aa9-abb9-a3d8384ae921 admin admin] The token cache is being invalidate because project 9a12f06abf3543f9b74d323553f9e880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:30:54.238923 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c2fead42-b693-4aa9-abb9-a3d8384ae921 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:54.239627 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c2fead42-b693-4aa9-abb9-a3d8384ae921 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:54.241446 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1308/2609] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:30:54 2022] DELETE /identity/v3/projects/9a12f06abf3543f9b74d323553f9e880 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:30:54.246143 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fead42-b693-4aa9-abb9-a3d8384ae921 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:54.248623 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c2fead42-b693-4aa9-abb9-a3d8384ae921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:54.289693 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f1230-e839-4d4e-a641-e59df9b63631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:54.290419 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f1230-e839-4d4e-a641-e59df9b63631 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:54.290712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f1230-e839-4d4e-a641-e59df9b63631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:54.291395 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f1230-e839-4d4e-a641-e59df9b63631 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:54.293448 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f1230-e839-4d4e-a641-e59df9b63631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:54.295163 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f1230-e839-4d4e-a641-e59df9b63631 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:54.308509 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1302/2610] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:30:54.312737 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f1230-e839-4d4e-a641-e59df9b63631 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:54.314524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-3b3f1230-e839-4d4e-a641-e59df9b63631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:54.332395 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f1230-e839-4d4e-a641-e59df9b63631 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:54.336576 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fead42-b693-4aa9-abb9-a3d8384ae921 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:54.338278 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0b6b0-6e2a-4901-83d8-c1641968885c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:54.340212 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0b6b0-6e2a-4901-83d8-c1641968885c admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:54.340501 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0b6b0-6e2a-4901-83d8-c1641968885c admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:54.340782 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0b6b0-6e2a-4901-83d8-c1641968885c admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:54.341525 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0b6b0-6e2a-4901-83d8-c1641968885c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:54.343188 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0b6b0-6e2a-4901-83d8-c1641968885c admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:54.344317 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9679ac-8287-4feb-aab8-70082d339d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:54.344539 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9679ac-8287-4feb-aab8-70082d339d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:54.344791 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9679ac-8287-4feb-aab8-70082d339d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:54.345070 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9679ac-8287-4feb-aab8-70082d339d94 admin admin] PATH_INFO: `/v3/users/51b3231ce66c46cd98994a215eba8791` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:54.346751 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9679ac-8287-4feb-aab8-70082d339d94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51b3231ce66c46cd98994a215eba8791)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:54.348435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9679ac-8287-4feb-aab8-70082d339d94 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:54.358871 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1303/2611] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:30:54.359971 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0b6b0-6e2a-4901-83d8-c1641968885c admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:54.371602 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0b6b0-6e2a-4901-83d8-c1641968885c admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:54.376411 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f07f5-2a64-4465-b562-4df2de459897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:54.377304 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f07f5-2a64-4465-b562-4df2de459897 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:54.377633 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f07f5-2a64-4465-b562-4df2de459897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:54.377950 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f07f5-2a64-4465-b562-4df2de459897 admin admin] PATH_INFO: `/v3/projects/1a3286213cec4c43a66b52e5808a4586/users/c099c3f376fd489caaeec1712cf97574/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:54.403480 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f07f5-2a64-4465-b562-4df2de459897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a3286213cec4c43a66b52e5808a4586, user_id=c099c3f376fd489caaeec1712cf97574, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:54.408732 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f07f5-2a64-4465-b562-4df2de459897 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:54.416390 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-5b9679ac-8287-4feb-aab8-70082d339d94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51b3231ce66c46cd98994a215eba8791'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:54.425433 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-5b9679ac-8287-4feb-aab8-70082d339d94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51b3231ce66c46cd98994a215eba8791'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:54.426105 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-5b9679ac-8287-4feb-aab8-70082d339d94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51b3231ce66c46cd98994a215eba8791'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:54.426795 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-5b9679ac-8287-4feb-aab8-70082d339d94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51b3231ce66c46cd98994a215eba8791'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:54.429198 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1304/2612] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:30:54 2022] PUT /identity/v3/projects/1a3286213cec4c43a66b52e5808a4586/users/c099c3f376fd489caaeec1712cf97574/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:30:54.441011 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fdfcb-8392-4142-b599-5aa7110cea6f None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:54.441313 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fdfcb-8392-4142-b599-5aa7110cea6f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:54.441571 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fdfcb-8392-4142-b599-5aa7110cea6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:54.449281 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-5b9679ac-8287-4feb-aab8-70082d339d94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51b3231ce66c46cd98994a215eba8791'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:54.465044 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1309/2613] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:30:54 2022] DELETE /identity/v3/users/51b3231ce66c46cd98994a215eba8791 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:30:54.493648 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-fa0fdfcb-8392-4142-b599-5aa7110cea6f None None] MFA Rules not processed for user `c099c3f376fd489caaeec1712cf97574`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:30:54.494961 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-fa0fdfcb-8392-4142-b599-5aa7110cea6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:54.543920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:54.589996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1305/2614] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:30:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:30:54.596207 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9679ac-8287-4feb-aab8-70082d339d94 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:54.597875 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-5b9679ac-8287-4feb-aab8-70082d339d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:54.608378 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:54.671701 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9679ac-8287-4feb-aab8-70082d339d94 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:54.677694 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427280a-479b-4c5e-ac4f-eba589f14217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:54.678368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427280a-479b-4c5e-ac4f-eba589f14217 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:54.678598 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427280a-479b-4c5e-ac4f-eba589f14217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:54.678889 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427280a-479b-4c5e-ac4f-eba589f14217 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:54.679737 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427280a-479b-4c5e-ac4f-eba589f14217 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:54.681675 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427280a-479b-4c5e-ac4f-eba589f14217 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:54.710610 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1310/2615] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:30:54 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:30:54.714792 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fdfcb-8392-4142-b599-5aa7110cea6f None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:54.726286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fdfcb-8392-4142-b599-5aa7110cea6f None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:54.793556 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da94cad-8161-4eea-b2b7-927bee01d471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:54.794599 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da94cad-8161-4eea-b2b7-927bee01d471 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:54.795078 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da94cad-8161-4eea-b2b7-927bee01d471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:54.795586 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da94cad-8161-4eea-b2b7-927bee01d471 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:54.796737 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da94cad-8161-4eea-b2b7-927bee01d471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:54.799325 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da94cad-8161-4eea-b2b7-927bee01d471 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:54.842920 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1306/2616] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:30:54 2022] POST /identity/v3/users => generated 298 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:30:54.844679 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427280a-479b-4c5e-ac4f-eba589f14217 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:54.858367 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da94cad-8161-4eea-b2b7-927bee01d471 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:54.860105 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427280a-479b-4c5e-ac4f-eba589f14217 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:54.860319 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4da94cad-8161-4eea-b2b7-927bee01d471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:54.864947 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4e945-516f-4796-90b9-83fc5e59c59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:54.865623 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4e945-516f-4796-90b9-83fc5e59c59a admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:54.865940 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4e945-516f-4796-90b9-83fc5e59c59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:54.866216 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4e945-516f-4796-90b9-83fc5e59c59a admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:54.866953 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4e945-516f-4796-90b9-83fc5e59c59a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:54.868586 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4e945-516f-4796-90b9-83fc5e59c59a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:54.878276 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da94cad-8161-4eea-b2b7-927bee01d471 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:54.882025 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1311/2617] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:30:54.888101 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4e945-516f-4796-90b9-83fc5e59c59a admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:54.890683 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8c677-baf7-4dac-975b-e31f9764409d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:54.891581 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8c677-baf7-4dac-975b-e31f9764409d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:54.891878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8c677-baf7-4dac-975b-e31f9764409d admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:54.892166 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8c677-baf7-4dac-975b-e31f9764409d admin admin] PATH_INFO: `/v3/projects/cd6fc6fb26cb46b1a2e713cf46c7be96` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:54.893860 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e8c677-baf7-4dac-975b-e31f9764409d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd6fc6fb26cb46b1a2e713cf46c7be96)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:54.895899 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e8c677-baf7-4dac-975b-e31f9764409d admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:54.913945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4e945-516f-4796-90b9-83fc5e59c59a admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:54.921713 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12032d-8a46-45b0-9da6-2e5724bc4691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:54.923824 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12032d-8a46-45b0-9da6-2e5724bc4691 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:54.924307 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12032d-8a46-45b0-9da6-2e5724bc4691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:54.924730 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12032d-8a46-45b0-9da6-2e5724bc4691 admin admin] PATH_INFO: `/v3/projects/522b4d76117944519434fee236b04218/users/0ce079701fa149ddad7aabe625bb8a86/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:54.955611 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12032d-8a46-45b0-9da6-2e5724bc4691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=522b4d76117944519434fee236b04218, user_id=0ce079701fa149ddad7aabe625bb8a86, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:54.960326 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12032d-8a46-45b0-9da6-2e5724bc4691 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:54.981024 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c6e8c677-baf7-4dac-975b-e31f9764409d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd6fc6fb26cb46b1a2e713cf46c7be96', 'request_id': 'req-c6e8c677-baf7-4dac-975b-e31f9764409d'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:54.984435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1312/2618] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:30:54 2022] PUT /identity/v3/projects/522b4d76117944519434fee236b04218/users/0ce079701fa149ddad7aabe625bb8a86/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:30:54.985940 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12032d-8a46-45b0-9da6-2e5724bc4691 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:54.989962 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c6e8c677-baf7-4dac-975b-e31f9764409d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd6fc6fb26cb46b1a2e713cf46c7be96', 'request_id': 'req-c6e8c677-baf7-4dac-975b-e31f9764409d'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:54.999917 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c6e8c677-baf7-4dac-975b-e31f9764409d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd6fc6fb26cb46b1a2e713cf46c7be96', 'request_id': 'req-c6e8c677-baf7-4dac-975b-e31f9764409d'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:55.013631 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c6e8c677-baf7-4dac-975b-e31f9764409d admin admin] The token cache is being invalidate because project cd6fc6fb26cb46b1a2e713cf46c7be96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:30:55.014039 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c6e8c677-baf7-4dac-975b-e31f9764409d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:55.014792 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c6e8c677-baf7-4dac-975b-e31f9764409d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:55.016690 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1307/2619] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:30:54 2022] DELETE /identity/v3/projects/cd6fc6fb26cb46b1a2e713cf46c7be96 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:30:55.021529 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5f70d-c48a-4db4-bffe-a2bb4a47e1e3 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:55.021795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5f70d-c48a-4db4-bffe-a2bb4a47e1e3 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:55.022131 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5f70d-c48a-4db4-bffe-a2bb4a47e1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:55.044180 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-d3b5f70d-c48a-4db4-bffe-a2bb4a47e1e3 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:30:55.045423 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d3b5f70d-c48a-4db4-bffe-a2bb4a47e1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:55.100387 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12032d-8a46-45b0-9da6-2e5724bc4691 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:55.106159 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab02f7-0d67-4292-ab77-da9cfeea09e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:55.106930 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab02f7-0d67-4292-ab77-da9cfeea09e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:55.107220 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab02f7-0d67-4292-ab77-da9cfeea09e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:55.107567 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab02f7-0d67-4292-ab77-da9cfeea09e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:55.108249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab02f7-0d67-4292-ab77-da9cfeea09e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:55.108556 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:55.110441 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab02f7-0d67-4292-ab77-da9cfeea09e7 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:55.121954 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1313/2620] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:30:55.126704 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab02f7-0d67-4292-ab77-da9cfeea09e7 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:55.134109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8cab02f7-0d67-4292-ab77-da9cfeea09e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:55.136593 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1308/2621] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:30:55.152809 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c899596-5982-4e82-a037-6fdc875be86f None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:55.153152 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c899596-5982-4e82-a037-6fdc875be86f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:55.153495 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c899596-5982-4e82-a037-6fdc875be86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:55.156309 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab02f7-0d67-4292-ab77-da9cfeea09e7 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:55.179412 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980fe5da-4fb2-4bb8-b539-d7e3431f16d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:55.181792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fe5da-4fb2-4bb8-b539-d7e3431f16d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:55.182688 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fe5da-4fb2-4bb8-b539-d7e3431f16d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:55.183282 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fe5da-4fb2-4bb8-b539-d7e3431f16d7 admin admin] PATH_INFO: `/v3/projects/522b4d76117944519434fee236b04218/users/0ce079701fa149ddad7aabe625bb8a86/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:55.183494 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-4c899596-5982-4e82-a037-6fdc875be86f None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:30:55.185437 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4c899596-5982-4e82-a037-6fdc875be86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:55.187579 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980fe5da-4fb2-4bb8-b539-d7e3431f16d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=522b4d76117944519434fee236b04218, user_id=0ce079701fa149ddad7aabe625bb8a86, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:55.193240 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980fe5da-4fb2-4bb8-b539-d7e3431f16d7 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:55.200911 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1309/2622] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:30:55.206140 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c899596-5982-4e82-a037-6fdc875be86f None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:55.218235 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c899596-5982-4e82-a037-6fdc875be86f None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:55.220410 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1314/2623] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:30:55 2022] PUT /identity/v3/projects/522b4d76117944519434fee236b04218/users/0ce079701fa149ddad7aabe625bb8a86/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:30:55.233419 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c42791-7ec2-487a-a2e4-96587445aed2 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:55.233939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c42791-7ec2-487a-a2e4-96587445aed2 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:55.234121 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c42791-7ec2-487a-a2e4-96587445aed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:55.271760 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-80c42791-7ec2-487a-a2e4-96587445aed2 None None] MFA Rules not processed for user `0ce079701fa149ddad7aabe625bb8a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:30:55.273381 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-80c42791-7ec2-487a-a2e4-96587445aed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:55.334907 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:55.349323 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b366a9f-37ce-4f7f-be0c-b9438b1b8f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:55.350477 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b366a9f-37ce-4f7f-be0c-b9438b1b8f98 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:55.352101 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b366a9f-37ce-4f7f-be0c-b9438b1b8f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:55.352559 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b366a9f-37ce-4f7f-be0c-b9438b1b8f98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:55.355730 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b366a9f-37ce-4f7f-be0c-b9438b1b8f98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:30:55.356435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b366a9f-37ce-4f7f-be0c-b9438b1b8f98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:55.358897 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b366a9f-37ce-4f7f-be0c-b9438b1b8f98 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:55.386939 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1310/2624] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:30:55.394157 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b366a9f-37ce-4f7f-be0c-b9438b1b8f98 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:55.410860 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1315/2625] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:30:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:30:55.411566 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c42791-7ec2-487a-a2e4-96587445aed2 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:55.412403 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b366a9f-37ce-4f7f-be0c-b9438b1b8f98 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:55.413151 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-80c42791-7ec2-487a-a2e4-96587445aed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:55.428366 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5710f0-be90-42c2-94b9-ca586769027f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:55.429063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5710f0-be90-42c2-94b9-ca586769027f admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:55.429380 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5710f0-be90-42c2-94b9-ca586769027f admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:55.429767 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5710f0-be90-42c2-94b9-ca586769027f admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:55.430524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5710f0-be90-42c2-94b9-ca586769027f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:55.430665 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c42791-7ec2-487a-a2e4-96587445aed2 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:55.433277 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5710f0-be90-42c2-94b9-ca586769027f admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:55.435598 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a218f-fc4b-4e48-a73a-388643ce9b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:55.436507 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a218f-fc4b-4e48-a73a-388643ce9b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:55.436921 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a218f-fc4b-4e48-a73a-388643ce9b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:55.437193 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a218f-fc4b-4e48-a73a-388643ce9b09 admin admin] PATH_INFO: `/v3/users/98afac2fef274f40997b1535d113d9b1` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:55.438488 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a218f-fc4b-4e48-a73a-388643ce9b09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98afac2fef274f40997b1535d113d9b1)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:55.440639 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a218f-fc4b-4e48-a73a-388643ce9b09 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:55.484022 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1311/2626] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:30:55 2022] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:30:55.484697 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5710f0-be90-42c2-94b9-ca586769027f admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:55.486763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-6a5710f0-be90-42c2-94b9-ca586769027f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:55.532210 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0d4a218f-fc4b-4e48-a73a-388643ce9b09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98afac2fef274f40997b1535d113d9b1'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:55.544779 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0d4a218f-fc4b-4e48-a73a-388643ce9b09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98afac2fef274f40997b1535d113d9b1'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:55.544779 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0d4a218f-fc4b-4e48-a73a-388643ce9b09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98afac2fef274f40997b1535d113d9b1'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:55.545350 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0d4a218f-fc4b-4e48-a73a-388643ce9b09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98afac2fef274f40997b1535d113d9b1'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:55.572365 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0d4a218f-fc4b-4e48-a73a-388643ce9b09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98afac2fef274f40997b1535d113d9b1'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:55.572585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5710f0-be90-42c2-94b9-ca586769027f admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:55.578916 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6fdbfc-d5bf-459c-9227-2358105f01c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:55.578916 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6fdbfc-d5bf-459c-9227-2358105f01c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:55.578916 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6fdbfc-d5bf-459c-9227-2358105f01c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:55.578916 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6fdbfc-d5bf-459c-9227-2358105f01c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:55.582973 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-7b6fdbfc-d5bf-459c-9227-2358105f01c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:55.603335 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1316/2627] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:30:55 2022] DELETE /identity/v3/users/98afac2fef274f40997b1535d113d9b1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:30:55.603609 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a218f-fc4b-4e48-a73a-388643ce9b09 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:55.606186 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0d4a218f-fc4b-4e48-a73a-388643ce9b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:55.695728 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6fdbfc-d5bf-459c-9227-2358105f01c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:55.698734 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6fdbfc-d5bf-459c-9227-2358105f01c2 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:55.707820 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:55.720795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1312/2628] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:30:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:30:55.723464 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a218f-fc4b-4e48-a73a-388643ce9b09 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:55.728970 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99aa71-6ead-4207-b79e-7d274cb880bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:55.729764 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99aa71-6ead-4207-b79e-7d274cb880bb admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:55.730086 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99aa71-6ead-4207-b79e-7d274cb880bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:55.730519 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99aa71-6ead-4207-b79e-7d274cb880bb admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:55.731240 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99aa71-6ead-4207-b79e-7d274cb880bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:55.733379 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99aa71-6ead-4207-b79e-7d274cb880bb admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:55.738839 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8d928-82e4-4825-83a0-f7cb2bf63938 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:55.739531 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8d928-82e4-4825-83a0-f7cb2bf63938 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:55.740113 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8d928-82e4-4825-83a0-f7cb2bf63938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:55.769688 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-31d8d928-82e4-4825-83a0-f7cb2bf63938 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:30:55.772467 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-31d8d928-82e4-4825-83a0-f7cb2bf63938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:55.777869 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1317/2629] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:30:55 2022] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:30:55.782219 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99aa71-6ead-4207-b79e-7d274cb880bb admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:55.785364 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1313/2630] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:30:55.798212 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8d928-82e4-4825-83a0-f7cb2bf63938 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:55.799684 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-31d8d928-82e4-4825-83a0-f7cb2bf63938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:55.813132 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99aa71-6ead-4207-b79e-7d274cb880bb admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:55.818968 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5dd93e-ae5b-4b8c-a739-491f68815c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:55.820035 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5dd93e-ae5b-4b8c-a739-491f68815c9d admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:55.820706 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5dd93e-ae5b-4b8c-a739-491f68815c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:55.820983 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5dd93e-ae5b-4b8c-a739-491f68815c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:55.821976 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5dd93e-ae5b-4b8c-a739-491f68815c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:55.823741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5dd93e-ae5b-4b8c-a739-491f68815c9d admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:55.836910 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1318/2631] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:30:55.842238 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5dd93e-ae5b-4b8c-a739-491f68815c9d admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:55.859861 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5dd93e-ae5b-4b8c-a739-491f68815c9d admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:55.865346 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238a8f3-8e43-4906-9ab6-3c780beab32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:55.865655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238a8f3-8e43-4906-9ab6-3c780beab32d admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:55.866042 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238a8f3-8e43-4906-9ab6-3c780beab32d admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:55.866397 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238a8f3-8e43-4906-9ab6-3c780beab32d admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:55.867211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238a8f3-8e43-4906-9ab6-3c780beab32d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:55.868915 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238a8f3-8e43-4906-9ab6-3c780beab32d admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:55.885867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1319/2632] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:30:55.891425 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238a8f3-8e43-4906-9ab6-3c780beab32d admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:55.899743 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:55.911570 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238a8f3-8e43-4906-9ab6-3c780beab32d admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:55.921470 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b3737-6b82-4340-b22e-ff9e9bade1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:55.923116 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b3737-6b82-4340-b22e-ff9e9bade1ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:55.923632 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b3737-6b82-4340-b22e-ff9e9bade1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:55.924071 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b3737-6b82-4340-b22e-ff9e9bade1ed admin admin] PATH_INFO: `/v3/projects/843713c2b83545c4ad52f902f30ee7ac/users/97347986b95e49e79dc8bb0abe3c47e0/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:55.936884 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8d928-82e4-4825-83a0-f7cb2bf63938 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:55.942306 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a3e9d-d885-4687-b999-087244462828 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:55.943242 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a3e9d-d885-4687-b999-087244462828 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:55.943797 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a3e9d-d885-4687-b999-087244462828 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:55.944174 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a3e9d-d885-4687-b999-087244462828 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:55.952249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b3737-6b82-4340-b22e-ff9e9bade1ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=843713c2b83545c4ad52f902f30ee7ac, user_id=97347986b95e49e79dc8bb0abe3c47e0, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:55.954963 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a3e9d-d885-4687-b999-087244462828 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:55.957164 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a3e9d-d885-4687-b999-087244462828 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:55.958246 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b3737-6b82-4340-b22e-ff9e9bade1ed admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:55.972466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1314/2633] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:30:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:30:55.974340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a3e9d-d885-4687-b999-087244462828 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:55.976513 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-821a3e9d-d885-4687-b999-087244462828 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:55.993053 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1320/2634] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:30:55 2022] PUT /identity/v3/projects/843713c2b83545c4ad52f902f30ee7ac/users/97347986b95e49e79dc8bb0abe3c47e0/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:30:55.997750 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b514520-183f-475a-bee1-2e606244dbc5 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:55.998698 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b514520-183f-475a-bee1-2e606244dbc5 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:55.999049 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b514520-183f-475a-bee1-2e606244dbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:56.031411 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-9b514520-183f-475a-bee1-2e606244dbc5 None None] MFA Rules not processed for user `97347986b95e49e79dc8bb0abe3c47e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:30:56.032806 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9b514520-183f-475a-bee1-2e606244dbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:56.073424 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a3e9d-d885-4687-b999-087244462828 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:56.141010 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1321/2635] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:30:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:30:56.145696 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b514520-183f-475a-bee1-2e606244dbc5 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:56.158045 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d387115-b708-44fe-9350-e7d72a92c619 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:56.159240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d387115-b708-44fe-9350-e7d72a92c619 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:56.159829 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d387115-b708-44fe-9350-e7d72a92c619 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:56.160618 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d387115-b708-44fe-9350-e7d72a92c619 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:56.163807 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-9d387115-b708-44fe-9350-e7d72a92c619 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:56.228060 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b514520-183f-475a-bee1-2e606244dbc5 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:56.237267 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ec230-f6b7-4366-8912-18fe821e426f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:56.238292 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ec230-f6b7-4366-8912-18fe821e426f admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:56.238636 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ec230-f6b7-4366-8912-18fe821e426f admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:56.238898 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ec230-f6b7-4366-8912-18fe821e426f admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:56.240253 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ec230-f6b7-4366-8912-18fe821e426f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:56.243226 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ec230-f6b7-4366-8912-18fe821e426f admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:56.271039 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d387115-b708-44fe-9350-e7d72a92c619 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:56.277435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1322/2636] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:30:56 2022] POST /identity/v3/projects => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:30:56.277637 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d387115-b708-44fe-9350-e7d72a92c619 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:56.279011 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ec230-f6b7-4366-8912-18fe821e426f admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:56.293102 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1315/2637] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:30:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:30:56.359172 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:56.372140 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ec230-f6b7-4366-8912-18fe821e426f admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:56.377239 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bfc26-f0b3-4a2e-a24d-339f827d5288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:56.378347 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bfc26-f0b3-4a2e-a24d-339f827d5288 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:56.379068 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bfc26-f0b3-4a2e-a24d-339f827d5288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:56.381407 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bfc26-f0b3-4a2e-a24d-339f827d5288 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:56.382830 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1bfc26-f0b3-4a2e-a24d-339f827d5288 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:56.388211 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1bfc26-f0b3-4a2e-a24d-339f827d5288 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:56.435165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1323/2638] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:30:56 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:30:56.438677 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d387115-b708-44fe-9350-e7d72a92c619 service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:56.452136 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d387115-b708-44fe-9350-e7d72a92c619 service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:56.460796 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85474175-d171-45a9-a331-7e46196378bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:56.462331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85474175-d171-45a9-a331-7e46196378bb admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:56.462973 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85474175-d171-45a9-a331-7e46196378bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:56.463645 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85474175-d171-45a9-a331-7e46196378bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:56.466065 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85474175-d171-45a9-a331-7e46196378bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:56.469384 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85474175-d171-45a9-a331-7e46196378bb admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:56.472117 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:56.493515 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1316/2639] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:30:56.501053 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bfc26-f0b3-4a2e-a24d-339f827d5288 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:56.518717 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bfc26-f0b3-4a2e-a24d-339f827d5288 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:56.526102 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ffd35-e2ea-4d5a-a3b7-da0e0a1b707d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:56.527706 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ffd35-e2ea-4d5a-a3b7-da0e0a1b707d admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:56.528183 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ffd35-e2ea-4d5a-a3b7-da0e0a1b707d admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:56.528692 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ffd35-e2ea-4d5a-a3b7-da0e0a1b707d admin admin] PATH_INFO: `/v3/projects/abff542719fa4f32ad5a20be0bf6fc3c/users/e0e1033e18074f61acdc66c5ab75705b/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:56.558073 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ffd35-e2ea-4d5a-a3b7-da0e0a1b707d admin admin] RBAC: Authorizing `identity:create_grant(project_id=abff542719fa4f32ad5a20be0bf6fc3c, user_id=e0e1033e18074f61acdc66c5ab75705b, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:56.561162 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ffd35-e2ea-4d5a-a3b7-da0e0a1b707d admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:56.585145 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85474175-d171-45a9-a331-7e46196378bb admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:56.586423 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1324/2640] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:30:56 2022] PUT /identity/v3/projects/abff542719fa4f32ad5a20be0bf6fc3c/users/e0e1033e18074f61acdc66c5ab75705b/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:30:56.592277 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-85474175-d171-45a9-a331-7e46196378bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:56.597649 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ffd35-e2ea-4d5a-a3b7-da0e0a1b707d admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:56.618262 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85474175-d171-45a9-a331-7e46196378bb admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:56.720219 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ffd35-e2ea-4d5a-a3b7-da0e0a1b707d admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:56.721257 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105fec21-1d48-4d35-8509-d9585cc6370d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:56.722243 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fec21-1d48-4d35-8509-d9585cc6370d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:56.722626 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fec21-1d48-4d35-8509-d9585cc6370d admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:56.722797 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fec21-1d48-4d35-8509-d9585cc6370d admin admin] PATH_INFO: `/v3/projects/0cef3d09e53b43f889ff7446e69f7477` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:56.724164 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105fec21-1d48-4d35-8509-d9585cc6370d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cef3d09e53b43f889ff7446e69f7477)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:56.726167 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105fec21-1d48-4d35-8509-d9585cc6370d admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:56.727158 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68771d-a8ca-4b64-8f93-8c7a53d97d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:56.728120 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68771d-a8ca-4b64-8f93-8c7a53d97d97 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:56.728545 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68771d-a8ca-4b64-8f93-8c7a53d97d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:56.728954 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68771d-a8ca-4b64-8f93-8c7a53d97d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:56.730510 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68771d-a8ca-4b64-8f93-8c7a53d97d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:56.732605 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68771d-a8ca-4b64-8f93-8c7a53d97d97 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:56.749634 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1325/2641] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:30:56.755045 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68771d-a8ca-4b64-8f93-8c7a53d97d97 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:56.777699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68771d-a8ca-4b64-8f93-8c7a53d97d97 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:56.788792 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb619016-f972-4d25-8cb2-c71d68da2325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:56.790561 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb619016-f972-4d25-8cb2-c71d68da2325 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:56.791100 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb619016-f972-4d25-8cb2-c71d68da2325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:56.791569 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb619016-f972-4d25-8cb2-c71d68da2325 admin admin] PATH_INFO: `/v3/projects/abff542719fa4f32ad5a20be0bf6fc3c/users/e0e1033e18074f61acdc66c5ab75705b/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:56.795533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb619016-f972-4d25-8cb2-c71d68da2325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abff542719fa4f32ad5a20be0bf6fc3c, user_id=e0e1033e18074f61acdc66c5ab75705b, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:56.799534 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-105fec21-1d48-4d35-8509-d9585cc6370d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cef3d09e53b43f889ff7446e69f7477', 'request_id': 'req-105fec21-1d48-4d35-8509-d9585cc6370d'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:56.802489 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb619016-f972-4d25-8cb2-c71d68da2325 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:56.807975 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-105fec21-1d48-4d35-8509-d9585cc6370d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cef3d09e53b43f889ff7446e69f7477', 'request_id': 'req-105fec21-1d48-4d35-8509-d9585cc6370d'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:56.819123 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-105fec21-1d48-4d35-8509-d9585cc6370d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cef3d09e53b43f889ff7446e69f7477', 'request_id': 'req-105fec21-1d48-4d35-8509-d9585cc6370d'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:56.833897 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1326/2642] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:30:56 2022] PUT /identity/v3/projects/abff542719fa4f32ad5a20be0bf6fc3c/users/e0e1033e18074f61acdc66c5ab75705b/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:30:56.843530 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-105fec21-1d48-4d35-8509-d9585cc6370d admin admin] The token cache is being invalidate because project 0cef3d09e53b43f889ff7446e69f7477 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:30:56.843831 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-105fec21-1d48-4d35-8509-d9585cc6370d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:56.844549 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-105fec21-1d48-4d35-8509-d9585cc6370d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:56.846574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1317/2643] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:30:56 2022] DELETE /identity/v3/projects/0cef3d09e53b43f889ff7446e69f7477 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:30:56.848973 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f19fe0-a3c2-4d06-965f-bb33577a1c06 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:56.849629 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f19fe0-a3c2-4d06-965f-bb33577a1c06 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:56.849629 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f19fe0-a3c2-4d06-965f-bb33577a1c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:56.851439 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105fec21-1d48-4d35-8509-d9585cc6370d admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:56.852955 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-105fec21-1d48-4d35-8509-d9585cc6370d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:56.884888 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-69f19fe0-a3c2-4d06-965f-bb33577a1c06 None None] MFA Rules not processed for user `e0e1033e18074f61acdc66c5ab75705b`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:30:56.886251 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-69f19fe0-a3c2-4d06-965f-bb33577a1c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:56.939239 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105fec21-1d48-4d35-8509-d9585cc6370d admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:56.978250 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:56.980658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1327/2644] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:30:56 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:30:56.998984 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f19fe0-a3c2-4d06-965f-bb33577a1c06 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:57.008188 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-69f19fe0-a3c2-4d06-965f-bb33577a1c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:57.016912 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecfe660-37d1-4538-8387-e35f080ef740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:57.018081 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfe660-37d1-4538-8387-e35f080ef740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:57.018240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfe660-37d1-4538-8387-e35f080ef740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:57.018395 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfe660-37d1-4538-8387-e35f080ef740 admin admin] PATH_INFO: `/v3/users/07db345d411d4bcba760a7f7960092e7` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:57.019811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecfe660-37d1-4538-8387-e35f080ef740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07db345d411d4bcba760a7f7960092e7)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:57.022032 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecfe660-37d1-4538-8387-e35f080ef740 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:57.049789 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:57.076589 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0ecfe660-37d1-4538-8387-e35f080ef740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07db345d411d4bcba760a7f7960092e7'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:57.084456 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0ecfe660-37d1-4538-8387-e35f080ef740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07db345d411d4bcba760a7f7960092e7'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:57.085195 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0ecfe660-37d1-4538-8387-e35f080ef740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07db345d411d4bcba760a7f7960092e7'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:57.093041 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f19fe0-a3c2-4d06-965f-bb33577a1c06 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:57.098820 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0ecfe660-37d1-4538-8387-e35f080ef740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07db345d411d4bcba760a7f7960092e7'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:57.099008 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a4818-32f4-4c6e-935a-6ec9d2928137 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:57.099615 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0ecfe660-37d1-4538-8387-e35f080ef740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07db345d411d4bcba760a7f7960092e7'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:57.099869 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a4818-32f4-4c6e-935a-6ec9d2928137 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:57.100283 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a4818-32f4-4c6e-935a-6ec9d2928137 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:57.100721 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a4818-32f4-4c6e-935a-6ec9d2928137 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:57.105347 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-5a4a4818-32f4-4c6e-935a-6ec9d2928137 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:57.117505 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1318/2645] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:30:56 2022] DELETE /identity/v3/users/07db345d411d4bcba760a7f7960092e7 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:30:57.121651 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a4818-32f4-4c6e-935a-6ec9d2928137 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:57.123316 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a4818-32f4-4c6e-935a-6ec9d2928137 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:57.135092 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1328/2646] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:30:56 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:30:57.491194 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecfe660-37d1-4538-8387-e35f080ef740 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:57.493193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0ecfe660-37d1-4538-8387-e35f080ef740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:57.583902 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecfe660-37d1-4538-8387-e35f080ef740 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:57.591662 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a803c-c4b5-401e-805e-ab6bb0c422f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:57.593121 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a803c-c4b5-401e-805e-ab6bb0c422f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:57.593562 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a803c-c4b5-401e-805e-ab6bb0c422f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:57.594025 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a803c-c4b5-401e-805e-ab6bb0c422f6 admin admin] PATH_INFO: `/v3/projects/d7b5ce251a3a46eca7f951387ea0a036` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:57.598770 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a803c-c4b5-401e-805e-ab6bb0c422f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7b5ce251a3a46eca7f951387ea0a036)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:57.601384 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a803c-c4b5-401e-805e-ab6bb0c422f6 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:57.648869 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a4818-32f4-4c6e-935a-6ec9d2928137 service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:57.660268 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a4818-32f4-4c6e-935a-6ec9d2928137 service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:57.677867 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-622a803c-c4b5-401e-805e-ab6bb0c422f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7b5ce251a3a46eca7f951387ea0a036', 'request_id': 'req-622a803c-c4b5-401e-805e-ab6bb0c422f6'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:57.691638 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-622a803c-c4b5-401e-805e-ab6bb0c422f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7b5ce251a3a46eca7f951387ea0a036', 'request_id': 'req-622a803c-c4b5-401e-805e-ab6bb0c422f6'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:57.696085 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:57.708687 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-622a803c-c4b5-401e-805e-ab6bb0c422f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7b5ce251a3a46eca7f951387ea0a036', 'request_id': 'req-622a803c-c4b5-401e-805e-ab6bb0c422f6'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:57.727066 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-622a803c-c4b5-401e-805e-ab6bb0c422f6 admin admin] The token cache is being invalidate because project d7b5ce251a3a46eca7f951387ea0a036 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:30:57.727514 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-622a803c-c4b5-401e-805e-ab6bb0c422f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:57.728240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-622a803c-c4b5-401e-805e-ab6bb0c422f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:57.729980 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1319/2647] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:30:57 2022] DELETE /identity/v3/projects/d7b5ce251a3a46eca7f951387ea0a036 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:30:57.736991 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48082091-80f1-4db8-9cfc-066994307f64 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:57.737245 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48082091-80f1-4db8-9cfc-066994307f64 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:57.737528 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48082091-80f1-4db8-9cfc-066994307f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:57.743391 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600baa05-e1ed-41d1-ad5a-4bc798443393 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1033e18074f61acdc66c5ab75705b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abff542719fa4f32ad5a20be0bf6fc3c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:57.745423 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600baa05-e1ed-41d1-ad5a-4bc798443393 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:57.745812 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600baa05-e1ed-41d1-ad5a-4bc798443393 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:57.747484 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600baa05-e1ed-41d1-ad5a-4bc798443393 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:57.747484 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600baa05-e1ed-41d1-ad5a-4bc798443393 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:30:57.747484 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600baa05-e1ed-41d1-ad5a-4bc798443393 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:57.749590 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600baa05-e1ed-41d1-ad5a-4bc798443393 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:57.761330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-48082091-80f1-4db8-9cfc-066994307f64 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:30:57.762763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-48082091-80f1-4db8-9cfc-066994307f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:57.766364 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1329/2648] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:30:57.773123 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600baa05-e1ed-41d1-ad5a-4bc798443393 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:57.776912 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-600baa05-e1ed-41d1-ad5a-4bc798443393 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:57.796628 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600baa05-e1ed-41d1-ad5a-4bc798443393 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:57.802539 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9ee4e-5054-4d31-ba15-1ddd44939ae4 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1033e18074f61acdc66c5ab75705b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abff542719fa4f32ad5a20be0bf6fc3c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:57.802952 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9ee4e-5054-4d31-ba15-1ddd44939ae4 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:57.803240 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9ee4e-5054-4d31-ba15-1ddd44939ae4 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:57.803529 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9ee4e-5054-4d31-ba15-1ddd44939ae4 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:57.804267 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9ee4e-5054-4d31-ba15-1ddd44939ae4 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:57.806416 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9ee4e-5054-4d31-ba15-1ddd44939ae4 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:57.843928 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1330/2649] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:30:57 2022] POST /identity/v3/projects => generated 354 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:30:57.848574 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9ee4e-5054-4d31-ba15-1ddd44939ae4 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:57.859082 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1320/2650] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:30:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:30:57.866944 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41050667-5f3c-4748-906d-b79d8fd3e119 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:57.867364 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41050667-5f3c-4748-906d-b79d8fd3e119 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:57.867727 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41050667-5f3c-4748-906d-b79d8fd3e119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:57.898319 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-41050667-5f3c-4748-906d-b79d8fd3e119 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:30:57.899570 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-41050667-5f3c-4748-906d-b79d8fd3e119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:57.945858 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9ee4e-5054-4d31-ba15-1ddd44939ae4 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:57.957502 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092f828-40c1-4fef-b3ea-3b456455bda4 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1033e18074f61acdc66c5ab75705b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abff542719fa4f32ad5a20be0bf6fc3c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:57.958919 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092f828-40c1-4fef-b3ea-3b456455bda4 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:57.959354 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092f828-40c1-4fef-b3ea-3b456455bda4 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:57.960102 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092f828-40c1-4fef-b3ea-3b456455bda4 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:57.960960 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092f828-40c1-4fef-b3ea-3b456455bda4 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:30:57.961141 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092f828-40c1-4fef-b3ea-3b456455bda4 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:57.962793 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092f828-40c1-4fef-b3ea-3b456455bda4 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:57.981594 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1331/2651] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:30:57.987949 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1321/2652] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:30:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:30:57.989431 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092f828-40c1-4fef-b3ea-3b456455bda4 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:58.007759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092f828-40c1-4fef-b3ea-3b456455bda4 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:58.016885 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a3b7a-ad6e-4165-bddb-a1f64758466a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:58.018035 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a3b7a-ad6e-4165-bddb-a1f64758466a admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:58.018582 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a3b7a-ad6e-4165-bddb-a1f64758466a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:58.020090 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a3b7a-ad6e-4165-bddb-a1f64758466a admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:58.021579 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a3b7a-ad6e-4165-bddb-a1f64758466a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:30:58.022439 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a3b7a-ad6e-4165-bddb-a1f64758466a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:58.025584 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a3b7a-ad6e-4165-bddb-a1f64758466a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:58.044139 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41050667-5f3c-4748-906d-b79d8fd3e119 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:58.055179 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1332/2653] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:30:58.057474 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41050667-5f3c-4748-906d-b79d8fd3e119 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:58.060538 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a3b7a-ad6e-4165-bddb-a1f64758466a admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:58.065968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebf952-e6e8-48b8-ac04-280c11d1b2b1 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1033e18074f61acdc66c5ab75705b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abff542719fa4f32ad5a20be0bf6fc3c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:58.066653 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebf952-e6e8-48b8-ac04-280c11d1b2b1 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:58.067016 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebf952-e6e8-48b8-ac04-280c11d1b2b1 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:58.067443 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebf952-e6e8-48b8-ac04-280c11d1b2b1 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] PATH_INFO: `/v3/projects/3ec1d9901ad84e01b414a4b6dc46aa3d` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:58.069197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebf952-e6e8-48b8-ac04-280c11d1b2b1 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3ec1d9901ad84e01b414a4b6dc46aa3d)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:58.073897 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebf952-e6e8-48b8-ac04-280c11d1b2b1 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:58.096421 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a3b7a-ad6e-4165-bddb-a1f64758466a admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:58.108967 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24844bea-60a3-4449-a82f-bc8a01c6ff58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:58.110125 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24844bea-60a3-4449-a82f-bc8a01c6ff58 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:58.110783 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24844bea-60a3-4449-a82f-bc8a01c6ff58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:58.111261 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24844bea-60a3-4449-a82f-bc8a01c6ff58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:58.121101 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24844bea-60a3-4449-a82f-bc8a01c6ff58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:58.121101 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24844bea-60a3-4449-a82f-bc8a01c6ff58 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:58.147333 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-46ebf952-e6e8-48b8-ac04-280c11d1b2b1 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ec1d9901ad84e01b414a4b6dc46aa3d', 'request_id': 'req-46ebf952-e6e8-48b8-ac04-280c11d1b2b1'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:58.150338 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1333/2654] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:30:58 2022] POST /identity/v3/projects => generated 387 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:30:58.156301 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-46ebf952-e6e8-48b8-ac04-280c11d1b2b1 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ec1d9901ad84e01b414a4b6dc46aa3d', 'request_id': 'req-46ebf952-e6e8-48b8-ac04-280c11d1b2b1'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:58.156905 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24844bea-60a3-4449-a82f-bc8a01c6ff58 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:58.162267 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:58.167354 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-46ebf952-e6e8-48b8-ac04-280c11d1b2b1 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ec1d9901ad84e01b414a4b6dc46aa3d', 'request_id': 'req-46ebf952-e6e8-48b8-ac04-280c11d1b2b1'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:58.182625 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-46ebf952-e6e8-48b8-ac04-280c11d1b2b1 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] The token cache is being invalidate because project 3ec1d9901ad84e01b414a4b6dc46aa3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:30:58.183204 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-46ebf952-e6e8-48b8-ac04-280c11d1b2b1 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:58.184463 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-46ebf952-e6e8-48b8-ac04-280c11d1b2b1 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:58.190002 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1322/2655] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:30:58 2022] DELETE /identity/v3/projects/3ec1d9901ad84e01b414a4b6dc46aa3d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:30:58.276986 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24844bea-60a3-4449-a82f-bc8a01c6ff58 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:58.283282 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028ec7d-c056-4c10-8963-0a1af581286f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:58.283961 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028ec7d-c056-4c10-8963-0a1af581286f admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:58.284252 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028ec7d-c056-4c10-8963-0a1af581286f admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:58.284525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028ec7d-c056-4c10-8963-0a1af581286f admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:58.285244 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028ec7d-c056-4c10-8963-0a1af581286f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:58.287425 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028ec7d-c056-4c10-8963-0a1af581286f admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:58.312403 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1334/2656] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:30:58 2022] POST /identity/v3/users => generated 294 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:30:58.316656 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebf952-e6e8-48b8-ac04-280c11d1b2b1 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:58.318180 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-46ebf952-e6e8-48b8-ac04-280c11d1b2b1 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:58.329392 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:58.397237 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebf952-e6e8-48b8-ac04-280c11d1b2b1 tempest-VolumeQuotaClassesTest-1806060993 tempest-VolumeQuotaClassesTest-1806060993-project-admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:58.402327 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e913780-600e-4407-bdae-2e50139c7593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:58.403402 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e913780-600e-4407-bdae-2e50139c7593 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:58.403795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e913780-600e-4407-bdae-2e50139c7593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:58.404226 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e913780-600e-4407-bdae-2e50139c7593 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:58.405006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e913780-600e-4407-bdae-2e50139c7593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:58.406931 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e913780-600e-4407-bdae-2e50139c7593 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:58.418512 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1323/2657] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:30:58.422865 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028ec7d-c056-4c10-8963-0a1af581286f admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:58.429641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e913780-600e-4407-bdae-2e50139c7593 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:58.431503 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-3e913780-600e-4407-bdae-2e50139c7593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:58.434734 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028ec7d-c056-4c10-8963-0a1af581286f admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:58.440251 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe54bf-f2cb-41d7-8ebd-0395fb41f546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:58.440945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe54bf-f2cb-41d7-8ebd-0395fb41f546 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:58.441233 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe54bf-f2cb-41d7-8ebd-0395fb41f546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:58.441511 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe54bf-f2cb-41d7-8ebd-0395fb41f546 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:58.442306 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe54bf-f2cb-41d7-8ebd-0395fb41f546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:58.443979 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe54bf-f2cb-41d7-8ebd-0395fb41f546 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:58.445781 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e913780-600e-4407-bdae-2e50139c7593 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:58.451441 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9797fd-0ad8-4ff6-80e4-a681bf04ae60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:58.452461 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9797fd-0ad8-4ff6-80e4-a681bf04ae60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:58.452606 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9797fd-0ad8-4ff6-80e4-a681bf04ae60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:58.452875 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9797fd-0ad8-4ff6-80e4-a681bf04ae60 admin admin] PATH_INFO: `/v3/users/97347986b95e49e79dc8bb0abe3c47e0` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:58.454197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9797fd-0ad8-4ff6-80e4-a681bf04ae60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97347986b95e49e79dc8bb0abe3c47e0)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:58.456169 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9797fd-0ad8-4ff6-80e4-a681bf04ae60 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:58.456646 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1335/2658] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:30:58.460961 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe54bf-f2cb-41d7-8ebd-0395fb41f546 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:58.475507 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe54bf-f2cb-41d7-8ebd-0395fb41f546 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:58.484830 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eebc4d-b3ef-4e14-8277-d1525ae447fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:58.484830 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eebc4d-b3ef-4e14-8277-d1525ae447fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:58.484830 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eebc4d-b3ef-4e14-8277-d1525ae447fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:58.484830 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eebc4d-b3ef-4e14-8277-d1525ae447fa admin admin] PATH_INFO: `/v3/projects/49d235b1cdc5434caaad2be580d2b77b/users/50039f4b1efb4d73b6bdddb4107bfe0d/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:58.507830 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eebc4d-b3ef-4e14-8277-d1525ae447fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=49d235b1cdc5434caaad2be580d2b77b, user_id=50039f4b1efb4d73b6bdddb4107bfe0d, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:58.511681 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eebc4d-b3ef-4e14-8277-d1525ae447fa admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:58.531289 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1336/2659] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:30:58 2022] PUT /identity/v3/projects/49d235b1cdc5434caaad2be580d2b77b/users/50039f4b1efb4d73b6bdddb4107bfe0d/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:30:58.534133 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-db9797fd-0ad8-4ff6-80e4-a681bf04ae60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97347986b95e49e79dc8bb0abe3c47e0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:58.542254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-db9797fd-0ad8-4ff6-80e4-a681bf04ae60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97347986b95e49e79dc8bb0abe3c47e0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:58.543017 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-db9797fd-0ad8-4ff6-80e4-a681bf04ae60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97347986b95e49e79dc8bb0abe3c47e0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:58.552777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a074a2-9368-4036-88e2-9569fa6e9d2c None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:58.553064 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a074a2-9368-4036-88e2-9569fa6e9d2c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:58.553338 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a074a2-9368-4036-88e2-9569fa6e9d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:58.562926 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-db9797fd-0ad8-4ff6-80e4-a681bf04ae60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97347986b95e49e79dc8bb0abe3c47e0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:58.563694 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-db9797fd-0ad8-4ff6-80e4-a681bf04ae60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97347986b95e49e79dc8bb0abe3c47e0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:58.581331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1324/2660] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:30:58 2022] DELETE /identity/v3/users/97347986b95e49e79dc8bb0abe3c47e0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:30:58.586461 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76553b99-0bec-4289-96ff-30c37419ba42 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:58.587292 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76553b99-0bec-4289-96ff-30c37419ba42 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:58.587679 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-75a074a2-9368-4036-88e2-9569fa6e9d2c None None] MFA Rules not processed for user `50039f4b1efb4d73b6bdddb4107bfe0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:30:58.588057 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76553b99-0bec-4289-96ff-30c37419ba42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:58.588990 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-75a074a2-9368-4036-88e2-9569fa6e9d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:58.612472 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-76553b99-0bec-4289-96ff-30c37419ba42 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:30:58.614495 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-76553b99-0bec-4289-96ff-30c37419ba42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:58.698689 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1337/2661] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:30:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:30:58.700236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a074a2-9368-4036-88e2-9569fa6e9d2c None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:58.701763 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-75a074a2-9368-4036-88e2-9569fa6e9d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:58.714236 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1325/2662] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:30:58.725022 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76553b99-0bec-4289-96ff-30c37419ba42 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:58.726567 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-76553b99-0bec-4289-96ff-30c37419ba42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:58.751239 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:58.785910 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:58.837537 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a074a2-9368-4036-88e2-9569fa6e9d2c None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:58.844023 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76553b99-0bec-4289-96ff-30c37419ba42 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:58.847781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2d007-7924-4c08-8619-9da37a36e932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:58.848193 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999310c-6626-49bd-a30d-5bc9554b183a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:58.848792 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999310c-6626-49bd-a30d-5bc9554b183a service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:58.848966 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2d007-7924-4c08-8619-9da37a36e932 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:58.849120 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999310c-6626-49bd-a30d-5bc9554b183a service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:58.849514 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999310c-6626-49bd-a30d-5bc9554b183a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:58.849684 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2d007-7924-4c08-8619-9da37a36e932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:58.850275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2d007-7924-4c08-8619-9da37a36e932 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:58.851606 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2d007-7924-4c08-8619-9da37a36e932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:58.855544 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2d007-7924-4c08-8619-9da37a36e932 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:58.860782 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999310c-6626-49bd-a30d-5bc9554b183a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:58.862463 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999310c-6626-49bd-a30d-5bc9554b183a service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:58.880687 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1326/2663] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:30:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:30:58.895281 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1338/2664] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:30:58 2022] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:30:58.899436 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999310c-6626-49bd-a30d-5bc9554b183a service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:58.912545 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999310c-6626-49bd-a30d-5bc9554b183a service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:58.990341 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ac8d4-ce6e-4ca0-a431-db8cbbe963cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:58.991305 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ac8d4-ce6e-4ca0-a431-db8cbbe963cd admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:58.991697 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ac8d4-ce6e-4ca0-a431-db8cbbe963cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:58.992075 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ac8d4-ce6e-4ca0-a431-db8cbbe963cd admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:58.993202 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ac8d4-ce6e-4ca0-a431-db8cbbe963cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:58.995321 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ac8d4-ce6e-4ca0-a431-db8cbbe963cd admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:59.019472 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1327/2665] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:30:58 2022] POST /identity/v3/users => generated 299 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:30:59.023750 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2d007-7924-4c08-8619-9da37a36e932 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:59.035708 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2d007-7924-4c08-8619-9da37a36e932 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:59.041605 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69e3ac-cf03-44b0-afa1-4a20e8d7ea8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:59.042780 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69e3ac-cf03-44b0-afa1-4a20e8d7ea8c admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:59.043064 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69e3ac-cf03-44b0-afa1-4a20e8d7ea8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:59.043350 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69e3ac-cf03-44b0-afa1-4a20e8d7ea8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:59.044103 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69e3ac-cf03-44b0-afa1-4a20e8d7ea8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:59.045809 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69e3ac-cf03-44b0-afa1-4a20e8d7ea8c admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:59.059313 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1339/2666] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:30:59.068077 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ac8d4-ce6e-4ca0-a431-db8cbbe963cd admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:59.080023 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ac8d4-ce6e-4ca0-a431-db8cbbe963cd admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:59.085816 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac63229-f5fb-48a6-b329-cf43b35dbf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:59.087053 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac63229-f5fb-48a6-b329-cf43b35dbf0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:59.087613 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac63229-f5fb-48a6-b329-cf43b35dbf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:59.088062 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac63229-f5fb-48a6-b329-cf43b35dbf0e admin admin] PATH_INFO: `/v3/projects/53fdbb2c89a1444e9ca74f92a3404578/users/7f411b81886846c28dc448313323035a/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:59.107547 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac63229-f5fb-48a6-b329-cf43b35dbf0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=53fdbb2c89a1444e9ca74f92a3404578, user_id=7f411b81886846c28dc448313323035a, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:59.110471 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac63229-f5fb-48a6-b329-cf43b35dbf0e admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:59.133608 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1328/2667] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:30:59 2022] PUT /identity/v3/projects/53fdbb2c89a1444e9ca74f92a3404578/users/7f411b81886846c28dc448313323035a/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:30:59.138622 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69e3ac-cf03-44b0-afa1-4a20e8d7ea8c admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:59.148657 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69e3ac-cf03-44b0-afa1-4a20e8d7ea8c admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:59.149451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac63229-f5fb-48a6-b329-cf43b35dbf0e admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:59.151856 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1ac63229-f5fb-48a6-b329-cf43b35dbf0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:59.222188 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac63229-f5fb-48a6-b329-cf43b35dbf0e admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:59.240137 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72ccda-b671-4280-af0a-a75f8707874a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:59.241680 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72ccda-b671-4280-af0a-a75f8707874a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:59.241680 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72ccda-b671-4280-af0a-a75f8707874a admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:59.242130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72ccda-b671-4280-af0a-a75f8707874a admin admin] PATH_INFO: `/v3/users/c099c3f376fd489caaeec1712cf97574` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:59.243799 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c72ccda-b671-4280-af0a-a75f8707874a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c099c3f376fd489caaeec1712cf97574)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:59.246298 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c72ccda-b671-4280-af0a-a75f8707874a admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:59.257096 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70be9b9-7b04-409c-8bdf-a362cf562e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:59.258282 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70be9b9-7b04-409c-8bdf-a362cf562e85 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:59.258282 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70be9b9-7b04-409c-8bdf-a362cf562e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:59.258496 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70be9b9-7b04-409c-8bdf-a362cf562e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:59.259735 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70be9b9-7b04-409c-8bdf-a362cf562e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:59.261894 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70be9b9-7b04-409c-8bdf-a362cf562e85 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:59.277226 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1340/2668] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:30:59.279735 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70be9b9-7b04-409c-8bdf-a362cf562e85 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:59.285412 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:59.293120 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b70be9b9-7b04-409c-8bdf-a362cf562e85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:59.310374 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70be9b9-7b04-409c-8bdf-a362cf562e85 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:59.317192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173f014-1d11-425b-8232-bf7dc4f0f868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:59.318183 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173f014-1d11-425b-8232-bf7dc4f0f868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:59.318474 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173f014-1d11-425b-8232-bf7dc4f0f868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:59.318758 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173f014-1d11-425b-8232-bf7dc4f0f868 admin admin] PATH_INFO: `/v3/projects/843713c2b83545c4ad52f902f30ee7ac` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:59.321059 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173f014-1d11-425b-8232-bf7dc4f0f868 admin admin] RBAC: Authorizing `identity:delete_project(project_id=843713c2b83545c4ad52f902f30ee7ac)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:59.323404 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173f014-1d11-425b-8232-bf7dc4f0f868 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:59.333484 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2c72ccda-b671-4280-af0a-a75f8707874a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c099c3f376fd489caaeec1712cf97574'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:59.345158 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2c72ccda-b671-4280-af0a-a75f8707874a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c099c3f376fd489caaeec1712cf97574'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:59.346045 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2c72ccda-b671-4280-af0a-a75f8707874a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c099c3f376fd489caaeec1712cf97574'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:59.363554 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2c72ccda-b671-4280-af0a-a75f8707874a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c099c3f376fd489caaeec1712cf97574'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:59.364878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2c72ccda-b671-4280-af0a-a75f8707874a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c099c3f376fd489caaeec1712cf97574'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:59.388053 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1329/2669] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:30:59 2022] DELETE /identity/v3/users/c099c3f376fd489caaeec1712cf97574 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:30:59.388053 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72ccda-b671-4280-af0a-a75f8707874a admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:59.388053 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2c72ccda-b671-4280-af0a-a75f8707874a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:59.423859 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-7173f014-1d11-425b-8232-bf7dc4f0f868 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '843713c2b83545c4ad52f902f30ee7ac', 'request_id': 'req-7173f014-1d11-425b-8232-bf7dc4f0f868'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:59.434000 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-7173f014-1d11-425b-8232-bf7dc4f0f868 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '843713c2b83545c4ad52f902f30ee7ac', 'request_id': 'req-7173f014-1d11-425b-8232-bf7dc4f0f868'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:59.450587 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-7173f014-1d11-425b-8232-bf7dc4f0f868 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '843713c2b83545c4ad52f902f30ee7ac', 'request_id': 'req-7173f014-1d11-425b-8232-bf7dc4f0f868'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:59.482070 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-7173f014-1d11-425b-8232-bf7dc4f0f868 admin admin] The token cache is being invalidate because project 843713c2b83545c4ad52f902f30ee7ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:30:59.482538 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-7173f014-1d11-425b-8232-bf7dc4f0f868 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:59.484515 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-7173f014-1d11-425b-8232-bf7dc4f0f868 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:59.488157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1341/2670] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:30:59 2022] DELETE /identity/v3/projects/843713c2b83545c4ad52f902f30ee7ac => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:30:59.490797 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72ccda-b671-4280-af0a-a75f8707874a admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:59.494875 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2180fe-486d-4c54-9d31-cab0640022d6 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:59.495167 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2180fe-486d-4c54-9d31-cab0640022d6 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:59.495542 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2180fe-486d-4c54-9d31-cab0640022d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:59.497867 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d3ca7-fd08-4d3d-9cf4-1ae9d9f8bb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:59.499094 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d3ca7-fd08-4d3d-9cf4-1ae9d9f8bb41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:59.499570 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d3ca7-fd08-4d3d-9cf4-1ae9d9f8bb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:59.500028 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d3ca7-fd08-4d3d-9cf4-1ae9d9f8bb41 admin admin] PATH_INFO: `/v3/projects/53fdbb2c89a1444e9ca74f92a3404578/users/7f411b81886846c28dc448313323035a/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:59.502948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d3ca7-fd08-4d3d-9cf4-1ae9d9f8bb41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53fdbb2c89a1444e9ca74f92a3404578, user_id=7f411b81886846c28dc448313323035a, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:59.506302 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d3ca7-fd08-4d3d-9cf4-1ae9d9f8bb41 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:59.519750 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1330/2671] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:30:59 2022] PUT /identity/v3/projects/53fdbb2c89a1444e9ca74f92a3404578/users/7f411b81886846c28dc448313323035a/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:30:59.520704 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d3ca7-fd08-4d3d-9cf4-1ae9d9f8bb41 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:59.522774 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e51d3ca7-fd08-4d3d-9cf4-1ae9d9f8bb41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:59.525550 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-3b2180fe-486d-4c54-9d31-cab0640022d6 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:30:59.528348 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3b2180fe-486d-4c54-9d31-cab0640022d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:59.598506 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:59.630745 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d3ca7-fd08-4d3d-9cf4-1ae9d9f8bb41 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:59.638215 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc7971-14b8-4d3c-9e81-5259d66ef8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:59.639147 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc7971-14b8-4d3c-9e81-5259d66ef8cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:59.639448 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc7971-14b8-4d3c-9e81-5259d66ef8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:59.639720 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc7971-14b8-4d3c-9e81-5259d66ef8cd admin admin] PATH_INFO: `/v3/users/e0e1033e18074f61acdc66c5ab75705b` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:59.641020 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc7971-14b8-4d3c-9e81-5259d66ef8cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0e1033e18074f61acdc66c5ab75705b)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:30:59.643298 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc7971-14b8-4d3c-9e81-5259d66ef8cd admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:30:59.643657 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1342/2672] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:30:59.645653 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0427575-1c0f-4b16-a620-a4529a3ea2f5 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:59.646064 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0427575-1c0f-4b16-a620-a4529a3ea2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:59.646435 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0427575-1c0f-4b16-a620-a4529a3ea2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:59.685072 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-c0427575-1c0f-4b16-a620-a4529a3ea2f5 None None] MFA Rules not processed for user `7f411b81886846c28dc448313323035a`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:30:59.686467 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c0427575-1c0f-4b16-a620-a4529a3ea2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:59.711745 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:30:59.729787 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5adc7971-14b8-4d3c-9e81-5259d66ef8cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0e1033e18074f61acdc66c5ab75705b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:59.750088 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5adc7971-14b8-4d3c-9e81-5259d66ef8cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0e1033e18074f61acdc66c5ab75705b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:59.751080 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5adc7971-14b8-4d3c-9e81-5259d66ef8cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0e1033e18074f61acdc66c5ab75705b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:59.770330 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5adc7971-14b8-4d3c-9e81-5259d66ef8cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0e1033e18074f61acdc66c5ab75705b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:59.771312 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5adc7971-14b8-4d3c-9e81-5259d66ef8cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0e1033e18074f61acdc66c5ab75705b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:30:59.789468 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1331/2673] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:30:59 2022] DELETE /identity/v3/users/e0e1033e18074f61acdc66c5ab75705b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:30:59.790573 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc7971-14b8-4d3c-9e81-5259d66ef8cd admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:59.791135 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1343/2674] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:30:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:30:59.792841 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0427575-1c0f-4b16-a620-a4529a3ea2f5 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:30:59.794528 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c0427575-1c0f-4b16-a620-a4529a3ea2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:59.798374 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-5adc7971-14b8-4d3c-9e81-5259d66ef8cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:59.895064 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0427575-1c0f-4b16-a620-a4529a3ea2f5 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:59.899207 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f4e59-11ba-46ae-9bf2-1969a06f2b04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:59.899902 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f4e59-11ba-46ae-9bf2-1969a06f2b04 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:59.900595 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f4e59-11ba-46ae-9bf2-1969a06f2b04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:59.900595 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f4e59-11ba-46ae-9bf2-1969a06f2b04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:59.902894 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ef2f4e59-11ba-46ae-9bf2-1969a06f2b04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:59.904540 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc7971-14b8-4d3c-9e81-5259d66ef8cd admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:30:59.908896 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e3e5e-c423-46bd-9e6a-bc9088ee5f5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:30:59.909583 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e3e5e-c423-46bd-9e6a-bc9088ee5f5d service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:30:59.910363 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e3e5e-c423-46bd-9e6a-bc9088ee5f5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:30:59.910660 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e3e5e-c423-46bd-9e6a-bc9088ee5f5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:30:59.919626 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ee6e3e5e-c423-46bd-9e6a-bc9088ee5f5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:30:59.998217 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f4e59-11ba-46ae-9bf2-1969a06f2b04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:00.001579 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f4e59-11ba-46ae-9bf2-1969a06f2b04 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:00.024307 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1344/2675] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:30:59 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:31:00.025877 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f4e59-11ba-46ae-9bf2-1969a06f2b04 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:00.027880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ef2f4e59-11ba-46ae-9bf2-1969a06f2b04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:00.044573 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e3e5e-c423-46bd-9e6a-bc9088ee5f5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:00.048156 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e3e5e-c423-46bd-9e6a-bc9088ee5f5d service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:00.051892 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:00.068190 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1332/2676] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:30:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:31:00.133098 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f4e59-11ba-46ae-9bf2-1969a06f2b04 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:00.142975 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa35d43-a9c6-429f-84c7-1694ea08a7ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:00.143663 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa35d43-a9c6-429f-84c7-1694ea08a7ba service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:00.143997 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa35d43-a9c6-429f-84c7-1694ea08a7ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:00.144275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa35d43-a9c6-429f-84c7-1694ea08a7ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:00.174310 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e3e5e-c423-46bd-9e6a-bc9088ee5f5d service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:00.176160 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ee6e3e5e-c423-46bd-9e6a-bc9088ee5f5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:00.199525 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e3e5e-c423-46bd-9e6a-bc9088ee5f5d service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:00.209570 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174e6e6-2ec6-4c16-bfbf-cd6187efd5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:00.211340 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174e6e6-2ec6-4c16-bfbf-cd6187efd5c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:00.211978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174e6e6-2ec6-4c16-bfbf-cd6187efd5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:00.212938 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174e6e6-2ec6-4c16-bfbf-cd6187efd5c4 admin admin] PATH_INFO: `/v3/projects/abff542719fa4f32ad5a20be0bf6fc3c` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:00.215535 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174e6e6-2ec6-4c16-bfbf-cd6187efd5c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abff542719fa4f32ad5a20be0bf6fc3c)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:00.220304 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174e6e6-2ec6-4c16-bfbf-cd6187efd5c4 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:00.270168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa35d43-a9c6-429f-84c7-1694ea08a7ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:00.272626 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa35d43-a9c6-429f-84c7-1694ea08a7ba service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:00.295577 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1345/2677] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:31:00 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:31:00.313608 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-3174e6e6-2ec6-4c16-bfbf-cd6187efd5c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abff542719fa4f32ad5a20be0bf6fc3c', 'request_id': 'req-3174e6e6-2ec6-4c16-bfbf-cd6187efd5c4'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:00.334450 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-3174e6e6-2ec6-4c16-bfbf-cd6187efd5c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abff542719fa4f32ad5a20be0bf6fc3c', 'request_id': 'req-3174e6e6-2ec6-4c16-bfbf-cd6187efd5c4'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:00.345778 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa35d43-a9c6-429f-84c7-1694ea08a7ba service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:00.347605 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2fa35d43-a9c6-429f-84c7-1694ea08a7ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:00.348237 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-3174e6e6-2ec6-4c16-bfbf-cd6187efd5c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abff542719fa4f32ad5a20be0bf6fc3c', 'request_id': 'req-3174e6e6-2ec6-4c16-bfbf-cd6187efd5c4'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:00.350961 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:00.366861 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa35d43-a9c6-429f-84c7-1694ea08a7ba service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:00.375107 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-3174e6e6-2ec6-4c16-bfbf-cd6187efd5c4 admin admin] The token cache is being invalidate because project abff542719fa4f32ad5a20be0bf6fc3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:31:00.376087 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-3174e6e6-2ec6-4c16-bfbf-cd6187efd5c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:00.377037 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-3174e6e6-2ec6-4c16-bfbf-cd6187efd5c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:00.382765 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1333/2678] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:31:00 2022] DELETE /identity/v3/projects/abff542719fa4f32ad5a20be0bf6fc3c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:31:00.385906 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b73f5-20de-47a2-99fc-680250230d25 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:00.386524 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b73f5-20de-47a2-99fc-680250230d25 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:00.386668 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b73f5-20de-47a2-99fc-680250230d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:00.413466 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-b45b73f5-20de-47a2-99fc-680250230d25 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:00.414693 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-b45b73f5-20de-47a2-99fc-680250230d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:00.464963 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cc17a-7106-4199-9ccb-340ed18bc869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:00.466030 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cc17a-7106-4199-9ccb-340ed18bc869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:00.466739 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cc17a-7106-4199-9ccb-340ed18bc869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:00.466739 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cc17a-7106-4199-9ccb-340ed18bc869 admin admin] PATH_INFO: `/v3/users/50039f4b1efb4d73b6bdddb4107bfe0d` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:00.468184 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8cc17a-7106-4199-9ccb-340ed18bc869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50039f4b1efb4d73b6bdddb4107bfe0d)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:00.470399 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8cc17a-7106-4199-9ccb-340ed18bc869 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:00.514611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1334/2679] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:00.523299 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8dc4f8-a9cd-44a4-92ec-fa4e31be8358 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:00.523585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8dc4f8-a9cd-44a4-92ec-fa4e31be8358 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:00.523867 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8dc4f8-a9cd-44a4-92ec-fa4e31be8358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:00.547313 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-5e8dc4f8-a9cd-44a4-92ec-fa4e31be8358 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:00.548583 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-5e8dc4f8-a9cd-44a4-92ec-fa4e31be8358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:00.559170 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1335/2680] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:31:00.563677 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8dc4f8-a9cd-44a4-92ec-fa4e31be8358 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:00.573654 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8dc4f8-a9cd-44a4-92ec-fa4e31be8358 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:00.579738 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-cb8cc17a-7106-4199-9ccb-340ed18bc869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50039f4b1efb4d73b6bdddb4107bfe0d'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:00.581154 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce61c1-e57d-49ca-bf82-b88198053091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:00.581881 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce61c1-e57d-49ca-bf82-b88198053091 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:00.582173 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce61c1-e57d-49ca-bf82-b88198053091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:00.582451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce61c1-e57d-49ca-bf82-b88198053091 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:00.586631 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce61c1-e57d-49ca-bf82-b88198053091 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:31:00.587181 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce61c1-e57d-49ca-bf82-b88198053091 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:00.589787 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce61c1-e57d-49ca-bf82-b88198053091 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:00.596565 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-cb8cc17a-7106-4199-9ccb-340ed18bc869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50039f4b1efb4d73b6bdddb4107bfe0d'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:00.597995 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-cb8cc17a-7106-4199-9ccb-340ed18bc869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50039f4b1efb4d73b6bdddb4107bfe0d'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:00.599159 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-cb8cc17a-7106-4199-9ccb-340ed18bc869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50039f4b1efb4d73b6bdddb4107bfe0d'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:00.608496 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1336/2681] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:31:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 08:31:00.615103 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce61c1-e57d-49ca-bf82-b88198053091 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:00.617559 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:00.618672 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-59ce61c1-e57d-49ca-bf82-b88198053091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:00.632848 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-cb8cc17a-7106-4199-9ccb-340ed18bc869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50039f4b1efb4d73b6bdddb4107bfe0d'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:00.652023 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce61c1-e57d-49ca-bf82-b88198053091 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:00.652923 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1346/2682] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:31:00 2022] DELETE /identity/v3/users/50039f4b1efb4d73b6bdddb4107bfe0d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:31:00.658478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928b2de-c812-42bc-9aff-aebef3e2a8c1 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:00.658478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928b2de-c812-42bc-9aff-aebef3e2a8c1 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:00.658478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928b2de-c812-42bc-9aff-aebef3e2a8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:00.679213 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-3928b2de-c812-42bc-9aff-aebef3e2a8c1 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:00.680632 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3928b2de-c812-42bc-9aff-aebef3e2a8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:00.778294 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0ea34-188d-4eaf-8528-010b2c169965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:00.779515 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0ea34-188d-4eaf-8528-010b2c169965 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:00.779515 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0ea34-188d-4eaf-8528-010b2c169965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:00.779885 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0ea34-188d-4eaf-8528-010b2c169965 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:00.780279 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0ea34-188d-4eaf-8528-010b2c169965 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:00.782905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0ea34-188d-4eaf-8528-010b2c169965 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:00.795523 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1347/2683] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:31:00.797405 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928b2de-c812-42bc-9aff-aebef3e2a8c1 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:00.800822 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3928b2de-c812-42bc-9aff-aebef3e2a8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:00.835172 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1337/2684] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:31:00 2022] POST /identity/v3/projects => generated 385 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:31:00.835172 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0ea34-188d-4eaf-8528-010b2c169965 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:00.835488 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928b2de-c812-42bc-9aff-aebef3e2a8c1 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:00.838152 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8ee0ea34-188d-4eaf-8528-010b2c169965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:00.932334 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0ea34-188d-4eaf-8528-010b2c169965 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:00.938491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1059b44-ec45-4763-8c88-2b44f6e89b9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:00.939333 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1059b44-ec45-4763-8c88-2b44f6e89b9e service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:00.940111 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1059b44-ec45-4763-8c88-2b44f6e89b9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:00.940439 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1059b44-ec45-4763-8c88-2b44f6e89b9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:00.958156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b9929-0b49-41ca-99ea-5eb3dd75f20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:00.958753 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:00.959195 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b9929-0b49-41ca-99ea-5eb3dd75f20d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:00.960224 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b9929-0b49-41ca-99ea-5eb3dd75f20d admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:00.960580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b9929-0b49-41ca-99ea-5eb3dd75f20d admin admin] PATH_INFO: `/v3/projects/1a3286213cec4c43a66b52e5808a4586` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:00.962091 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b9929-0b49-41ca-99ea-5eb3dd75f20d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a3286213cec4c43a66b52e5808a4586)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:00.964962 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b9929-0b49-41ca-99ea-5eb3dd75f20d admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:01.031281 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-210b9929-0b49-41ca-99ea-5eb3dd75f20d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a3286213cec4c43a66b52e5808a4586', 'request_id': 'req-210b9929-0b49-41ca-99ea-5eb3dd75f20d'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:01.039960 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-210b9929-0b49-41ca-99ea-5eb3dd75f20d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a3286213cec4c43a66b52e5808a4586', 'request_id': 'req-210b9929-0b49-41ca-99ea-5eb3dd75f20d'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:01.054250 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-210b9929-0b49-41ca-99ea-5eb3dd75f20d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a3286213cec4c43a66b52e5808a4586', 'request_id': 'req-210b9929-0b49-41ca-99ea-5eb3dd75f20d'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:01.059389 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1059b44-ec45-4763-8c88-2b44f6e89b9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:01.061516 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1059b44-ec45-4763-8c88-2b44f6e89b9e service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:01.073598 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-210b9929-0b49-41ca-99ea-5eb3dd75f20d admin admin] The token cache is being invalidate because project 1a3286213cec4c43a66b52e5808a4586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:31:01.074261 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-210b9929-0b49-41ca-99ea-5eb3dd75f20d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:01.075553 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-210b9929-0b49-41ca-99ea-5eb3dd75f20d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:01.078376 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1348/2685] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:31:00 2022] DELETE /identity/v3/projects/1a3286213cec4c43a66b52e5808a4586 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:01.080065 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b9929-0b49-41ca-99ea-5eb3dd75f20d admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:01.082257 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1338/2686] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:31:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:31:01.082467 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-210b9929-0b49-41ca-99ea-5eb3dd75f20d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:01.084156 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1059b44-ec45-4763-8c88-2b44f6e89b9e service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:01.101331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1059b44-ec45-4763-8c88-2b44f6e89b9e service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:01.117214 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:01.208731 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b9929-0b49-41ca-99ea-5eb3dd75f20d admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:01.220439 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d55501-de3c-4461-9e72-7cef20e2734d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:01.221149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d55501-de3c-4461-9e72-7cef20e2734d admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:01.221569 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d55501-de3c-4461-9e72-7cef20e2734d admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:01.222531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d55501-de3c-4461-9e72-7cef20e2734d admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:01.223277 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d55501-de3c-4461-9e72-7cef20e2734d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:01.225475 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d55501-de3c-4461-9e72-7cef20e2734d admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:01.234176 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c0f22-a5c2-4f70-bc27-25b495526670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:01.235509 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c0f22-a5c2-4f70-bc27-25b495526670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:01.235966 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c0f22-a5c2-4f70-bc27-25b495526670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:01.236459 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c0f22-a5c2-4f70-bc27-25b495526670 admin admin] PATH_INFO: `/v3/users/0ce079701fa149ddad7aabe625bb8a86` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:01.238959 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c0f22-a5c2-4f70-bc27-25b495526670 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ce079701fa149ddad7aabe625bb8a86)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:01.243177 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c0f22-a5c2-4f70-bc27-25b495526670 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:01.261091 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1349/2687] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:31:01 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:31:01.263555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d55501-de3c-4461-9e72-7cef20e2734d admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:01.282450 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d55501-de3c-4461-9e72-7cef20e2734d admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:01.288028 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584436d-73fc-4ce5-8c08-4445fa09e380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:01.289546 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584436d-73fc-4ce5-8c08-4445fa09e380 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:01.290043 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584436d-73fc-4ce5-8c08-4445fa09e380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:01.290490 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584436d-73fc-4ce5-8c08-4445fa09e380 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:01.293043 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584436d-73fc-4ce5-8c08-4445fa09e380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:01.295006 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584436d-73fc-4ce5-8c08-4445fa09e380 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:01.317377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1350/2688] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:31:01.318502 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584436d-73fc-4ce5-8c08-4445fa09e380 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:01.334229 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584436d-73fc-4ce5-8c08-4445fa09e380 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:01.346232 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859df0d-c441-4591-9410-554e19840ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:01.349650 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859df0d-c441-4591-9410-554e19840ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:01.350062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859df0d-c441-4591-9410-554e19840ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:01.350398 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859df0d-c441-4591-9410-554e19840ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:01.351139 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859df0d-c441-4591-9410-554e19840ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:01.351906 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-fa3c0f22-a5c2-4f70-bc27-25b495526670 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ce079701fa149ddad7aabe625bb8a86'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:01.355944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859df0d-c441-4591-9410-554e19840ae2 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:01.372915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-fa3c0f22-a5c2-4f70-bc27-25b495526670 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ce079701fa149ddad7aabe625bb8a86'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:01.374598 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-fa3c0f22-a5c2-4f70-bc27-25b495526670 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ce079701fa149ddad7aabe625bb8a86'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:01.377067 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1351/2689] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:31:01.381855 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859df0d-c441-4591-9410-554e19840ae2 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:01.399119 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859df0d-c441-4591-9410-554e19840ae2 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:01.405331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-fa3c0f22-a5c2-4f70-bc27-25b495526670 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ce079701fa149ddad7aabe625bb8a86'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:01.407116 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-fa3c0f22-a5c2-4f70-bc27-25b495526670 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ce079701fa149ddad7aabe625bb8a86'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:01.407975 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c25a8-c65a-4775-bfe3-e0221848b297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:01.409492 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c25a8-c65a-4775-bfe3-e0221848b297 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:01.410086 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c25a8-c65a-4775-bfe3-e0221848b297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:01.410620 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c25a8-c65a-4775-bfe3-e0221848b297 admin admin] PATH_INFO: `/v3/projects/f34002c98b3241aab2dc25329be63dc9/users/f212c44237624c0aa47549117bd2a9b4/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:01.430060 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1339/2690] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:31:01 2022] DELETE /identity/v3/users/0ce079701fa149ddad7aabe625bb8a86 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:01.435732 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c25a8-c65a-4775-bfe3-e0221848b297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f34002c98b3241aab2dc25329be63dc9, user_id=f212c44237624c0aa47549117bd2a9b4, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:01.439522 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c25a8-c65a-4775-bfe3-e0221848b297 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:01.457885 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1352/2691] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:31:01 2022] PUT /identity/v3/projects/f34002c98b3241aab2dc25329be63dc9/users/f212c44237624c0aa47549117bd2a9b4/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:31:01.467830 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762d30c-c6f4-41e6-9ed3-351631bee84f None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:01.468024 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762d30c-c6f4-41e6-9ed3-351631bee84f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:01.468592 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762d30c-c6f4-41e6-9ed3-351631bee84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:01.503665 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c25a8-c65a-4775-bfe3-e0221848b297 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:01.506211 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-c762d30c-c6f4-41e6-9ed3-351631bee84f None None] MFA Rules not processed for user `f212c44237624c0aa47549117bd2a9b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:01.507851 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c762d30c-c6f4-41e6-9ed3-351631bee84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:01.508434 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-708c25a8-c65a-4775-bfe3-e0221848b297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:01.524447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:01.596452 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1340/2692] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:01.612111 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762d30c-c6f4-41e6-9ed3-351631bee84f None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:01.613677 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c762d30c-c6f4-41e6-9ed3-351631bee84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:01.624495 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c25a8-c65a-4775-bfe3-e0221848b297 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:01.633442 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d9f71-ea10-48be-9db1-4e4f6a275cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:01.634416 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d9f71-ea10-48be-9db1-4e4f6a275cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:01.634729 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d9f71-ea10-48be-9db1-4e4f6a275cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:01.634981 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d9f71-ea10-48be-9db1-4e4f6a275cf9 admin admin] PATH_INFO: `/v3/projects/49d235b1cdc5434caaad2be580d2b77b` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:01.636629 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d9f71-ea10-48be-9db1-4e4f6a275cf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49d235b1cdc5434caaad2be580d2b77b)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:01.639037 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d9f71-ea10-48be-9db1-4e4f6a275cf9 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:01.707776 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-db3d9f71-ea10-48be-9db1-4e4f6a275cf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49d235b1cdc5434caaad2be580d2b77b', 'request_id': 'req-db3d9f71-ea10-48be-9db1-4e4f6a275cf9'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:01.713109 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762d30c-c6f4-41e6-9ed3-351631bee84f None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:01.720911 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-db3d9f71-ea10-48be-9db1-4e4f6a275cf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49d235b1cdc5434caaad2be580d2b77b', 'request_id': 'req-db3d9f71-ea10-48be-9db1-4e4f6a275cf9'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:01.741058 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-db3d9f71-ea10-48be-9db1-4e4f6a275cf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49d235b1cdc5434caaad2be580d2b77b', 'request_id': 'req-db3d9f71-ea10-48be-9db1-4e4f6a275cf9'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:01.744563 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:01.768669 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-db3d9f71-ea10-48be-9db1-4e4f6a275cf9 admin admin] The token cache is being invalidate because project 49d235b1cdc5434caaad2be580d2b77b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:31:01.769345 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-db3d9f71-ea10-48be-9db1-4e4f6a275cf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:01.770468 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-db3d9f71-ea10-48be-9db1-4e4f6a275cf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:01.773134 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1353/2693] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:31:01 2022] DELETE /identity/v3/projects/49d235b1cdc5434caaad2be580d2b77b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:01.779128 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d9f71-ea10-48be-9db1-4e4f6a275cf9 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:01.781408 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-db3d9f71-ea10-48be-9db1-4e4f6a275cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:01.801450 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd929db-b675-4ae8-946e-6d276fee2205 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:01.803018 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd929db-b675-4ae8-946e-6d276fee2205 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:01.803236 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd929db-b675-4ae8-946e-6d276fee2205 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:01.803774 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd929db-b675-4ae8-946e-6d276fee2205 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:01.806207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-bbd929db-b675-4ae8-946e-6d276fee2205 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:01.906479 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d9f71-ea10-48be-9db1-4e4f6a275cf9 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:01.943272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59180dcb-4603-454b-b066-371d7ae0bb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:01.943272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59180dcb-4603-454b-b066-371d7ae0bb9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:01.943272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59180dcb-4603-454b-b066-371d7ae0bb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:01.943272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59180dcb-4603-454b-b066-371d7ae0bb9d admin admin] PATH_INFO: `/v3/users/7f411b81886846c28dc448313323035a` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:01.946624 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59180dcb-4603-454b-b066-371d7ae0bb9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f411b81886846c28dc448313323035a)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:01.950646 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59180dcb-4603-454b-b066-371d7ae0bb9d admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:02.006839 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd929db-b675-4ae8-946e-6d276fee2205 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:02.008331 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd929db-b675-4ae8-946e-6d276fee2205 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:02.023612 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1341/2694] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:31:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:31:02.047779 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd929db-b675-4ae8-946e-6d276fee2205 service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:02.049373 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-bbd929db-b675-4ae8-946e-6d276fee2205 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:02.059286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-59180dcb-4603-454b-b066-371d7ae0bb9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f411b81886846c28dc448313323035a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:02.070469 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-59180dcb-4603-454b-b066-371d7ae0bb9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f411b81886846c28dc448313323035a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:02.071196 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-59180dcb-4603-454b-b066-371d7ae0bb9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f411b81886846c28dc448313323035a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:02.073559 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-59180dcb-4603-454b-b066-371d7ae0bb9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f411b81886846c28dc448313323035a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:02.075047 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd929db-b675-4ae8-946e-6d276fee2205 service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:02.084133 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1748c-3e71-4260-b8d2-da67c8774542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:02.085063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1748c-3e71-4260-b8d2-da67c8774542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:02.085348 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1748c-3e71-4260-b8d2-da67c8774542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:02.085642 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1748c-3e71-4260-b8d2-da67c8774542 admin admin] PATH_INFO: `/v3/users/f212c44237624c0aa47549117bd2a9b4` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:02.087004 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1748c-3e71-4260-b8d2-da67c8774542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f212c44237624c0aa47549117bd2a9b4)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:02.089473 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1748c-3e71-4260-b8d2-da67c8774542 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:02.119083 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:02.123087 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-59180dcb-4603-454b-b066-371d7ae0bb9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f411b81886846c28dc448313323035a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:02.140768 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1354/2695] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:31:01 2022] DELETE /identity/v3/users/7f411b81886846c28dc448313323035a => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:02.143666 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59180dcb-4603-454b-b066-371d7ae0bb9d admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:02.145442 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-59180dcb-4603-454b-b066-371d7ae0bb9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:02.160311 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a3a1748c-3e71-4260-b8d2-da67c8774542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f212c44237624c0aa47549117bd2a9b4'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:02.184338 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a3a1748c-3e71-4260-b8d2-da67c8774542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f212c44237624c0aa47549117bd2a9b4'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:02.185759 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a3a1748c-3e71-4260-b8d2-da67c8774542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f212c44237624c0aa47549117bd2a9b4'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:02.218759 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a3a1748c-3e71-4260-b8d2-da67c8774542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f212c44237624c0aa47549117bd2a9b4'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:02.220714 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a3a1748c-3e71-4260-b8d2-da67c8774542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f212c44237624c0aa47549117bd2a9b4'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:02.230887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59180dcb-4603-454b-b066-371d7ae0bb9d admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:02.240214 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc634f-9931-4952-93f1-46e11c7f4550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:02.241592 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc634f-9931-4952-93f1-46e11c7f4550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:02.242105 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc634f-9931-4952-93f1-46e11c7f4550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:02.242549 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc634f-9931-4952-93f1-46e11c7f4550 admin admin] PATH_INFO: `/v3/projects/522b4d76117944519434fee236b04218` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:02.245580 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc634f-9931-4952-93f1-46e11c7f4550 admin admin] RBAC: Authorizing `identity:delete_project(project_id=522b4d76117944519434fee236b04218)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:02.248779 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc634f-9931-4952-93f1-46e11c7f4550 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:02.254142 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1342/2696] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:31:02 2022] DELETE /identity/v3/users/f212c44237624c0aa47549117bd2a9b4 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:02.256914 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4357d6-5aa7-43b7-bdfd-fa8d54c3f454 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:02.257520 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4357d6-5aa7-43b7-bdfd-fa8d54c3f454 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:02.258700 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4357d6-5aa7-43b7-bdfd-fa8d54c3f454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:02.277761 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:02.281970 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-8a4357d6-5aa7-43b7-bdfd-fa8d54c3f454 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:02.283426 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8a4357d6-5aa7-43b7-bdfd-fa8d54c3f454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:02.367649 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-38dc634f-9931-4952-93f1-46e11c7f4550 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '522b4d76117944519434fee236b04218', 'request_id': 'req-38dc634f-9931-4952-93f1-46e11c7f4550'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:02.392654 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1343/2697] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:02.398408 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-38dc634f-9931-4952-93f1-46e11c7f4550 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '522b4d76117944519434fee236b04218', 'request_id': 'req-38dc634f-9931-4952-93f1-46e11c7f4550'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:02.407645 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4357d6-5aa7-43b7-bdfd-fa8d54c3f454 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:02.410176 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8a4357d6-5aa7-43b7-bdfd-fa8d54c3f454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:02.420117 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-38dc634f-9931-4952-93f1-46e11c7f4550 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '522b4d76117944519434fee236b04218', 'request_id': 'req-38dc634f-9931-4952-93f1-46e11c7f4550'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:02.442499 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-38dc634f-9931-4952-93f1-46e11c7f4550 admin admin] The token cache is being invalidate because project 522b4d76117944519434fee236b04218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:31:02.442790 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-38dc634f-9931-4952-93f1-46e11c7f4550 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:02.444026 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-38dc634f-9931-4952-93f1-46e11c7f4550 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:02.446719 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1355/2698] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:31:02 2022] DELETE /identity/v3/projects/522b4d76117944519434fee236b04218 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:02.453400 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17abce-eb2c-463f-8dd7-3c717216f3c0 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:02.453698 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17abce-eb2c-463f-8dd7-3c717216f3c0 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:02.454053 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17abce-eb2c-463f-8dd7-3c717216f3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:02.479486 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-0d17abce-eb2c-463f-8dd7-3c717216f3c0 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:02.487200 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0d17abce-eb2c-463f-8dd7-3c717216f3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:02.544581 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4357d6-5aa7-43b7-bdfd-fa8d54c3f454 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:02.571111 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1356/2699] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:02.571795 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17abce-eb2c-463f-8dd7-3c717216f3c0 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:02.575720 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0d17abce-eb2c-463f-8dd7-3c717216f3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:02.589880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17abce-eb2c-463f-8dd7-3c717216f3c0 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:02.595413 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460705d-061f-42e9-99ad-f8857e4c8246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:02.596364 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460705d-061f-42e9-99ad-f8857e4c8246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:02.596728 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460705d-061f-42e9-99ad-f8857e4c8246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:02.597110 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460705d-061f-42e9-99ad-f8857e4c8246 admin admin] PATH_INFO: `/v3/projects/53fdbb2c89a1444e9ca74f92a3404578` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:02.598481 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460705d-061f-42e9-99ad-f8857e4c8246 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53fdbb2c89a1444e9ca74f92a3404578)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:02.600622 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460705d-061f-42e9-99ad-f8857e4c8246 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:02.606223 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecf16c-8eb8-4484-b941-d7367d6e6812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:02.606856 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecf16c-8eb8-4484-b941-d7367d6e6812 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:02.607343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecf16c-8eb8-4484-b941-d7367d6e6812 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:02.609995 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecf16c-8eb8-4484-b941-d7367d6e6812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:02.612338 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-81ecf16c-8eb8-4484-b941-d7367d6e6812 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:02.626899 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:02.629604 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ecf16c-8eb8-4484-b941-d7367d6e6812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:02.631632 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ecf16c-8eb8-4484-b941-d7367d6e6812 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:02.657491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1344/2700] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:31:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:31:02.659124 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ff89f-19b2-4330-9007-27a5f56071e3 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:02.660433 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ff89f-19b2-4330-9007-27a5f56071e3 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:02.661530 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ff89f-19b2-4330-9007-27a5f56071e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:02.665340 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2460705d-061f-42e9-99ad-f8857e4c8246 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53fdbb2c89a1444e9ca74f92a3404578', 'request_id': 'req-2460705d-061f-42e9-99ad-f8857e4c8246'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:02.679109 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2460705d-061f-42e9-99ad-f8857e4c8246 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53fdbb2c89a1444e9ca74f92a3404578', 'request_id': 'req-2460705d-061f-42e9-99ad-f8857e4c8246'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:02.690871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2460705d-061f-42e9-99ad-f8857e4c8246 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53fdbb2c89a1444e9ca74f92a3404578', 'request_id': 'req-2460705d-061f-42e9-99ad-f8857e4c8246'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:02.705102 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2460705d-061f-42e9-99ad-f8857e4c8246 admin admin] The token cache is being invalidate because project 53fdbb2c89a1444e9ca74f92a3404578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:31:02.705440 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2460705d-061f-42e9-99ad-f8857e4c8246 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:02.707671 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2460705d-061f-42e9-99ad-f8857e4c8246 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:02.717246 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-4a0ff89f-19b2-4330-9007-27a5f56071e3 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:02.719720 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4a0ff89f-19b2-4330-9007-27a5f56071e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:02.720247 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1357/2701] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:31:02 2022] DELETE /identity/v3/projects/53fdbb2c89a1444e9ca74f92a3404578 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:02.723169 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236249b-6268-457a-b36d-e7e7a36d48eb None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:02.724016 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236249b-6268-457a-b36d-e7e7a36d48eb None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:02.724345 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236249b-6268-457a-b36d-e7e7a36d48eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:02.764830 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-7236249b-6268-457a-b36d-e7e7a36d48eb None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:02.768429 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-7236249b-6268-457a-b36d-e7e7a36d48eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:02.805630 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:02.867261 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1345/2702] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:02.872215 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ff89f-19b2-4330-9007-27a5f56071e3 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:02.895370 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ff89f-19b2-4330-9007-27a5f56071e3 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:02.907001 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3492674-e423-4c2a-a2c2-e9ecd6f5d9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:02.907512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1358/2703] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:02.908002 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3492674-e423-4c2a-a2c2-e9ecd6f5d9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:02.908389 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3492674-e423-4c2a-a2c2-e9ecd6f5d9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:02.908790 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3492674-e423-4c2a-a2c2-e9ecd6f5d9d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:02.921655 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306a5ec-31ab-4678-b82f-d18d2e118d51 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:02.922653 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306a5ec-31ab-4678-b82f-d18d2e118d51 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:02.922923 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306a5ec-31ab-4678-b82f-d18d2e118d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:02.926461 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3492674-e423-4c2a-a2c2-e9ecd6f5d9d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:31:02.927517 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3492674-e423-4c2a-a2c2-e9ecd6f5d9d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:02.931269 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3492674-e423-4c2a-a2c2-e9ecd6f5d9d5 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:02.957035 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e306a5ec-31ab-4678-b82f-d18d2e118d51 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:02.960074 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1346/2704] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:31:02.960999 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e306a5ec-31ab-4678-b82f-d18d2e118d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:02.964990 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3492674-e423-4c2a-a2c2-e9ecd6f5d9d5 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:02.985889 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1359/2705] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:03.000639 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3492674-e423-4c2a-a2c2-e9ecd6f5d9d5 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:03.006064 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306a5ec-31ab-4678-b82f-d18d2e118d51 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:03.024016 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab98b9-8823-4833-bf17-673b4c773392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:03.025143 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab98b9-8823-4833-bf17-673b4c773392 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:03.025620 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab98b9-8823-4833-bf17-673b4c773392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:03.026103 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab98b9-8823-4833-bf17-673b4c773392 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:03.027134 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab98b9-8823-4833-bf17-673b4c773392 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:03.030092 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab98b9-8823-4833-bf17-673b4c773392 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:03.043011 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306a5ec-31ab-4678-b82f-d18d2e118d51 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:03.066299 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4c512-105c-4e27-aaf8-36c5169897a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:03.067585 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4c512-105c-4e27-aaf8-36c5169897a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:03.067882 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4c512-105c-4e27-aaf8-36c5169897a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:03.068138 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4c512-105c-4e27-aaf8-36c5169897a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:03.068909 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4c512-105c-4e27-aaf8-36c5169897a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:31:03.069278 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4c512-105c-4e27-aaf8-36c5169897a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:03.071178 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4c512-105c-4e27-aaf8-36c5169897a6 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:03.089002 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1347/2706] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:31:02 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:31:03.093403 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab98b9-8823-4833-bf17-673b4c773392 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:03.094103 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1360/2707] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:31:03.105499 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4c512-105c-4e27-aaf8-36c5169897a6 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:03.122430 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4c512-105c-4e27-aaf8-36c5169897a6 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:03.207490 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250617e-de30-45b3-a45d-8d8f16a9c211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:03.208453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250617e-de30-45b3-a45d-8d8f16a9c211 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:03.208901 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250617e-de30-45b3-a45d-8d8f16a9c211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:03.209337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250617e-de30-45b3-a45d-8d8f16a9c211 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:03.210459 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4250617e-de30-45b3-a45d-8d8f16a9c211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:03.212848 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4250617e-de30-45b3-a45d-8d8f16a9c211 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:03.256170 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab98b9-8823-4833-bf17-673b4c773392 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:03.266547 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d137bc-9929-4f06-aea9-e744863cb108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:03.268113 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d137bc-9929-4f06-aea9-e744863cb108 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:03.269733 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d137bc-9929-4f06-aea9-e744863cb108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:03.270435 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d137bc-9929-4f06-aea9-e744863cb108 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:03.271883 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d137bc-9929-4f06-aea9-e744863cb108 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:03.274478 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d137bc-9929-4f06-aea9-e744863cb108 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:03.278487 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1361/2708] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:31:03 2022] POST /identity/v3/projects => generated 389 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:31:03.280682 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250617e-de30-45b3-a45d-8d8f16a9c211 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:03.323455 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1348/2709] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:31:03 2022] POST /identity/v3/users => generated 283 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:31:03.323455 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d137bc-9929-4f06-aea9-e744863cb108 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:03.324222 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c6d137bc-9929-4f06-aea9-e744863cb108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:03.351795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d137bc-9929-4f06-aea9-e744863cb108 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:03.413191 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250617e-de30-45b3-a45d-8d8f16a9c211 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:03.421476 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883e6fa-4c08-43ac-b466-2ebfd1b072d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:03.421763 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883e6fa-4c08-43ac-b466-2ebfd1b072d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:03.422286 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883e6fa-4c08-43ac-b466-2ebfd1b072d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:03.422752 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883e6fa-4c08-43ac-b466-2ebfd1b072d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:03.423399 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883e6fa-4c08-43ac-b466-2ebfd1b072d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:03.426053 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883e6fa-4c08-43ac-b466-2ebfd1b072d6 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:03.441017 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:03.455176 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1362/2710] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:31:03 2022] POST /identity/v3/users => generated 295 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:31:03.455176 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883e6fa-4c08-43ac-b466-2ebfd1b072d6 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:03.464211 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8bf5a-b4cc-424b-961f-1119543af1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:03.465028 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883e6fa-4c08-43ac-b466-2ebfd1b072d6 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:03.465286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8bf5a-b4cc-424b-961f-1119543af1b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:03.465579 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8bf5a-b4cc-424b-961f-1119543af1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:03.465889 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8bf5a-b4cc-424b-961f-1119543af1b7 admin admin] PATH_INFO: `/v3/projects/f34002c98b3241aab2dc25329be63dc9` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:03.467170 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8bf5a-b4cc-424b-961f-1119543af1b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f34002c98b3241aab2dc25329be63dc9)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:03.469133 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8bf5a-b4cc-424b-961f-1119543af1b7 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:03.470291 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218245d-bec0-471a-8b32-6c88f0b0bc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:03.471031 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218245d-bec0-471a-8b32-6c88f0b0bc2f admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:03.471325 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218245d-bec0-471a-8b32-6c88f0b0bc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:03.471606 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218245d-bec0-471a-8b32-6c88f0b0bc2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:03.472402 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b218245d-bec0-471a-8b32-6c88f0b0bc2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:03.475771 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b218245d-bec0-471a-8b32-6c88f0b0bc2f admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:03.487848 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1363/2711] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:31:03.488834 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218245d-bec0-471a-8b32-6c88f0b0bc2f admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:03.502634 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218245d-bec0-471a-8b32-6c88f0b0bc2f admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:03.507893 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639e0cd-bb91-4405-bafe-5e954458ffec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:03.509551 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639e0cd-bb91-4405-bafe-5e954458ffec admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:03.510101 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639e0cd-bb91-4405-bafe-5e954458ffec admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:03.510529 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639e0cd-bb91-4405-bafe-5e954458ffec admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:03.511790 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639e0cd-bb91-4405-bafe-5e954458ffec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:03.513841 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639e0cd-bb91-4405-bafe-5e954458ffec admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:03.515620 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:03.531964 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1364/2712] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:31:03.532903 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639e0cd-bb91-4405-bafe-5e954458ffec admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:03.550795 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639e0cd-bb91-4405-bafe-5e954458ffec admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:03.553124 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a6c8bf5a-b4cc-424b-961f-1119543af1b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f34002c98b3241aab2dc25329be63dc9', 'request_id': 'req-a6c8bf5a-b4cc-424b-961f-1119543af1b7'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:03.561383 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a6c8bf5a-b4cc-424b-961f-1119543af1b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f34002c98b3241aab2dc25329be63dc9', 'request_id': 'req-a6c8bf5a-b4cc-424b-961f-1119543af1b7'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:03.573255 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a6c8bf5a-b4cc-424b-961f-1119543af1b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f34002c98b3241aab2dc25329be63dc9', 'request_id': 'req-a6c8bf5a-b4cc-424b-961f-1119543af1b7'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:03.589618 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a6c8bf5a-b4cc-424b-961f-1119543af1b7 admin admin] The token cache is being invalidate because project f34002c98b3241aab2dc25329be63dc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:31:03.590137 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a6c8bf5a-b4cc-424b-961f-1119543af1b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:03.591239 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a6c8bf5a-b4cc-424b-961f-1119543af1b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:03.593879 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1349/2713] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:31:03 2022] DELETE /identity/v3/projects/f34002c98b3241aab2dc25329be63dc9 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:03.594700 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8bf5a-b4cc-424b-961f-1119543af1b7 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:03.597516 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a6c8bf5a-b4cc-424b-961f-1119543af1b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:03.645637 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a8e76-a70c-425b-abf4-64d0d6f65d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:03.646517 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a8e76-a70c-425b-abf4-64d0d6f65d0c admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:03.646906 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a8e76-a70c-425b-abf4-64d0d6f65d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:03.647491 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a8e76-a70c-425b-abf4-64d0d6f65d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:03.650072 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a8e76-a70c-425b-abf4-64d0d6f65d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:03.650072 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a8e76-a70c-425b-abf4-64d0d6f65d0c admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:03.664376 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1365/2714] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:31:03.667222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaed38-cb10-42e0-a4fe-bd02228658e2 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:03.667516 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaed38-cb10-42e0-a4fe-bd02228658e2 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:03.667796 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaed38-cb10-42e0-a4fe-bd02228658e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:03.689522 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8bf5a-b4cc-424b-961f-1119543af1b7 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:03.692449 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-dcaaed38-cb10-42e0-a4fe-bd02228658e2 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:03.693966 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-dcaaed38-cb10-42e0-a4fe-bd02228658e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:03.696084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97e8b0-55bb-4ca0-882b-20ac57b20440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:03.696843 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97e8b0-55bb-4ca0-882b-20ac57b20440 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:03.697205 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97e8b0-55bb-4ca0-882b-20ac57b20440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:03.697579 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97e8b0-55bb-4ca0-882b-20ac57b20440 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:03.698456 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97e8b0-55bb-4ca0-882b-20ac57b20440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:03.700159 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97e8b0-55bb-4ca0-882b-20ac57b20440 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:03.703903 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1366/2715] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:03.704934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaaed38-cb10-42e0-a4fe-bd02228658e2 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:03.706352 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-dcaaed38-cb10-42e0-a4fe-bd02228658e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:03.715126 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1350/2716] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:31:03.716878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207cfd4-d11e-4b51-ac35-c2cbc327686e None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:03.717170 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207cfd4-d11e-4b51-ac35-c2cbc327686e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:03.717454 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207cfd4-d11e-4b51-ac35-c2cbc327686e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:03.724147 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaaed38-cb10-42e0-a4fe-bd02228658e2 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:03.730132 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e17686-86e6-4bc9-a694-6b90a3ae86a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:03.731050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e17686-86e6-4bc9-a694-6b90a3ae86a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:03.731330 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e17686-86e6-4bc9-a694-6b90a3ae86a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:03.731606 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e17686-86e6-4bc9-a694-6b90a3ae86a4 admin admin] PATH_INFO: `/v3/projects/01ddcf447eb14d488c321c57d1fadf05/users/aa36e84afb124f31bdcff57d9d72a2d0/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:03.740709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-9207cfd4-d11e-4b51-ac35-c2cbc327686e None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:03.742730 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-9207cfd4-d11e-4b51-ac35-c2cbc327686e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:03.749804 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e17686-86e6-4bc9-a694-6b90a3ae86a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01ddcf447eb14d488c321c57d1fadf05, user_id=aa36e84afb124f31bdcff57d9d72a2d0, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:03.752614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e17686-86e6-4bc9-a694-6b90a3ae86a4 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:03.758047 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1351/2717] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:03.759485 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207cfd4-d11e-4b51-ac35-c2cbc327686e None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:03.771630 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207cfd4-d11e-4b51-ac35-c2cbc327686e None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:03.775573 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1367/2718] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:31:03 2022] PUT /identity/v3/projects/01ddcf447eb14d488c321c57d1fadf05/users/aa36e84afb124f31bdcff57d9d72a2d0/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:03.778735 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e17686-86e6-4bc9-a694-6b90a3ae86a4 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:03.859115 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3f21f-665b-40aa-aed7-ce115dc230bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:03.860018 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3f21f-665b-40aa-aed7-ce115dc230bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:03.860296 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3f21f-665b-40aa-aed7-ce115dc230bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:03.860574 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3f21f-665b-40aa-aed7-ce115dc230bc admin admin] PATH_INFO: `/v3/projects/c3238a04da17438785c20d6ab3ea16ce/users/be48c18b8fff4f71b086ad92a9895b84/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:03.864764 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e17686-86e6-4bc9-a694-6b90a3ae86a4 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:03.871331 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1163965-d67e-431e-9ebc-ae6b63e9545c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:03.872199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1163965-d67e-431e-9ebc-ae6b63e9545c admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:03.872558 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1163965-d67e-431e-9ebc-ae6b63e9545c admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:03.872906 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1163965-d67e-431e-9ebc-ae6b63e9545c admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:03.873724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1163965-d67e-431e-9ebc-ae6b63e9545c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:31:03.874192 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1163965-d67e-431e-9ebc-ae6b63e9545c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:03.875948 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1163965-d67e-431e-9ebc-ae6b63e9545c admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:03.880377 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3f21f-665b-40aa-aed7-ce115dc230bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3238a04da17438785c20d6ab3ea16ce, user_id=be48c18b8fff4f71b086ad92a9895b84, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:03.883384 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3f21f-665b-40aa-aed7-ce115dc230bc admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:03.886877 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:03.891641 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1368/2719] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:31:03.894240 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1587ed-44f4-425b-81a3-d6d5681d7bac None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:03.894531 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1587ed-44f4-425b-81a3-d6d5681d7bac None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:03.894821 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1587ed-44f4-425b-81a3-d6d5681d7bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:03.904528 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1352/2720] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:31:03 2022] PUT /identity/v3/projects/c3238a04da17438785c20d6ab3ea16ce/users/be48c18b8fff4f71b086ad92a9895b84/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:03.915011 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3f21f-665b-40aa-aed7-ce115dc230bc admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:03.947698 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-2a1587ed-44f4-425b-81a3-d6d5681d7bac None None] MFA Rules not processed for user `aa36e84afb124f31bdcff57d9d72a2d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:03.949496 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2a1587ed-44f4-425b-81a3-d6d5681d7bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:04.005904 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3f21f-665b-40aa-aed7-ce115dc230bc admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:04.013979 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50324365-04e8-4038-a5a4-0241f6053700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:04.015052 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50324365-04e8-4038-a5a4-0241f6053700 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:04.015532 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50324365-04e8-4038-a5a4-0241f6053700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:04.015995 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50324365-04e8-4038-a5a4-0241f6053700 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:04.017290 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50324365-04e8-4038-a5a4-0241f6053700 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:04.020494 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50324365-04e8-4038-a5a4-0241f6053700 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:04.028736 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:04.057126 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1353/2721] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:31:03 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:31:04.058558 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdfb63-1780-40cb-a896-2b7f8c22e59f None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:04.058852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdfb63-1780-40cb-a896-2b7f8c22e59f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:04.059133 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdfb63-1780-40cb-a896-2b7f8c22e59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:04.085249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1369/2722] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:03 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:04.087584 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1587ed-44f4-425b-81a3-d6d5681d7bac None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:04.093282 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-38bdfb63-1780-40cb-a896-2b7f8c22e59f None None] MFA Rules not processed for user `be48c18b8fff4f71b086ad92a9895b84`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:04.094782 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-38bdfb63-1780-40cb-a896-2b7f8c22e59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:04.112882 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1587ed-44f4-425b-81a3-d6d5681d7bac None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:04.177633 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1354/2723] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:04.178839 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdfb63-1780-40cb-a896-2b7f8c22e59f None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:04.216906 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3741a8-0f94-4bc3-bc9d-744403d0e418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:04.218438 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3741a8-0f94-4bc3-bc9d-744403d0e418 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:04.218929 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3741a8-0f94-4bc3-bc9d-744403d0e418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:04.219385 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3741a8-0f94-4bc3-bc9d-744403d0e418 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:04.220573 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3741a8-0f94-4bc3-bc9d-744403d0e418 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:04.223006 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3741a8-0f94-4bc3-bc9d-744403d0e418 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:04.251159 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1370/2724] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:31:04 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:31:04.252834 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3741a8-0f94-4bc3-bc9d-744403d0e418 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:04.266310 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdfb63-1780-40cb-a896-2b7f8c22e59f None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:04.272831 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35ba53-d302-4dca-8c73-4db4b4444a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:04.273576 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35ba53-d302-4dca-8c73-4db4b4444a11 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:04.273710 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3741a8-0f94-4bc3-bc9d-744403d0e418 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:04.273926 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35ba53-d302-4dca-8c73-4db4b4444a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:04.274184 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35ba53-d302-4dca-8c73-4db4b4444a11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:04.274890 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c35ba53-d302-4dca-8c73-4db4b4444a11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:04.277397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c35ba53-d302-4dca-8c73-4db4b4444a11 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:04.282217 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc6f61-0501-4ba2-99c1-b4728636c853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:04.283279 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc6f61-0501-4ba2-99c1-b4728636c853 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:04.284056 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc6f61-0501-4ba2-99c1-b4728636c853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:04.284448 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc6f61-0501-4ba2-99c1-b4728636c853 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:04.285680 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc6f61-0501-4ba2-99c1-b4728636c853 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:04.289767 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc6f61-0501-4ba2-99c1-b4728636c853 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:04.292925 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:04.310210 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1355/2725] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:31:04 2022] POST /identity/v3/projects => generated 367 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:31:04.310988 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35ba53-d302-4dca-8c73-4db4b4444a11 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:04.340663 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1371/2726] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:31:04 2022] POST /identity/v3/projects => generated 387 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:31:04.340663 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc6f61-0501-4ba2-99c1-b4728636c853 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:04.403741 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35ba53-d302-4dca-8c73-4db4b4444a11 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:04.408612 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc6f61-0501-4ba2-99c1-b4728636c853 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:04.409219 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445596d2-991f-4e38-bfef-be646f307ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:04.409924 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445596d2-991f-4e38-bfef-be646f307ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:04.410213 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445596d2-991f-4e38-bfef-be646f307ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:04.410507 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445596d2-991f-4e38-bfef-be646f307ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:04.411601 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445596d2-991f-4e38-bfef-be646f307ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:04.413205 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445596d2-991f-4e38-bfef-be646f307ca8 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:04.413889 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0b0fe-eb99-439a-98ee-a6f611ef076d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:04.414811 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0b0fe-eb99-439a-98ee-a6f611ef076d admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:04.415097 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0b0fe-eb99-439a-98ee-a6f611ef076d admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:04.415746 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0b0fe-eb99-439a-98ee-a6f611ef076d admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:04.417021 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba0b0fe-eb99-439a-98ee-a6f611ef076d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:04.418982 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba0b0fe-eb99-439a-98ee-a6f611ef076d admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:04.424714 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1356/2727] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:31:04.425614 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445596d2-991f-4e38-bfef-be646f307ca8 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:04.438309 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445596d2-991f-4e38-bfef-be646f307ca8 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:04.442956 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1372/2728] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:31:04 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:31:04.443798 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0b0fe-eb99-439a-98ee-a6f611ef076d admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:04.443957 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9357ea5-9b03-46d1-acf6-452adaee295f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:04.444486 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9357ea5-9b03-46d1-acf6-452adaee295f admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:04.444774 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9357ea5-9b03-46d1-acf6-452adaee295f admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:04.445053 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9357ea5-9b03-46d1-acf6-452adaee295f admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:04.445747 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9357ea5-9b03-46d1-acf6-452adaee295f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:04.447799 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9357ea5-9b03-46d1-acf6-452adaee295f admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:04.456090 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0b0fe-eb99-439a-98ee-a6f611ef076d admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:04.462558 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d57641-1087-4169-bc9a-82c340b20033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:04.464313 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d57641-1087-4169-bc9a-82c340b20033 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:04.464739 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d57641-1087-4169-bc9a-82c340b20033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:04.465175 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d57641-1087-4169-bc9a-82c340b20033 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:04.466163 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d57641-1087-4169-bc9a-82c340b20033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:04.468058 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d57641-1087-4169-bc9a-82c340b20033 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:04.470074 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1357/2729] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:31:04 2022] POST /identity/v3/users => generated 300 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:31:04.470921 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9357ea5-9b03-46d1-acf6-452adaee295f admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:04.482030 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9357ea5-9b03-46d1-acf6-452adaee295f admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:04.487069 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1373/2730] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:31:04.487069 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d57641-1087-4169-bc9a-82c340b20033 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:04.489634 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ef6f2-cbfd-4cd1-8c9a-6f6582bfe5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:04.490242 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ef6f2-cbfd-4cd1-8c9a-6f6582bfe5ab admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:04.490528 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ef6f2-cbfd-4cd1-8c9a-6f6582bfe5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:04.491465 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ef6f2-cbfd-4cd1-8c9a-6f6582bfe5ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:04.492211 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ef6f2-cbfd-4cd1-8c9a-6f6582bfe5ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:04.494265 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ef6f2-cbfd-4cd1-8c9a-6f6582bfe5ab admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:04.494877 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d57641-1087-4169-bc9a-82c340b20033 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:04.500544 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53f6b6-5bc9-4870-96de-6445fd155730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:04.501222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53f6b6-5bc9-4870-96de-6445fd155730 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:04.501696 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53f6b6-5bc9-4870-96de-6445fd155730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:04.502173 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53f6b6-5bc9-4870-96de-6445fd155730 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:04.502919 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53f6b6-5bc9-4870-96de-6445fd155730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:04.504539 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53f6b6-5bc9-4870-96de-6445fd155730 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:04.507255 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1358/2731] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:31:04.507255 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ef6f2-cbfd-4cd1-8c9a-6f6582bfe5ab admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:04.517558 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1374/2732] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:31:04.518249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53f6b6-5bc9-4870-96de-6445fd155730 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:04.522158 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ef6f2-cbfd-4cd1-8c9a-6f6582bfe5ab admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:04.528695 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb356ad8-c995-4821-84e0-0c54f9adbe61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:04.529401 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53f6b6-5bc9-4870-96de-6445fd155730 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:04.529698 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb356ad8-c995-4821-84e0-0c54f9adbe61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:04.530085 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb356ad8-c995-4821-84e0-0c54f9adbe61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:04.530527 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb356ad8-c995-4821-84e0-0c54f9adbe61 admin admin] PATH_INFO: `/v3/projects/656757a74a704dcaa556c18d131c7571/users/7ef7e1fae883462b8ea4acc42fef9ed3/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:04.534277 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b7937-52d1-4a1b-816f-9aba5f0545b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:04.535168 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b7937-52d1-4a1b-816f-9aba5f0545b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:04.535449 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b7937-52d1-4a1b-816f-9aba5f0545b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:04.535724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b7937-52d1-4a1b-816f-9aba5f0545b3 admin admin] PATH_INFO: `/v3/projects/6a1f06d8d86a49f281fa941a0e1f6973/users/b0689710b1c1444bae1d67a283cfae34/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:04.547789 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb356ad8-c995-4821-84e0-0c54f9adbe61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=656757a74a704dcaa556c18d131c7571, user_id=7ef7e1fae883462b8ea4acc42fef9ed3, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:04.550536 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb356ad8-c995-4821-84e0-0c54f9adbe61 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:04.551533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b7937-52d1-4a1b-816f-9aba5f0545b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1f06d8d86a49f281fa941a0e1f6973, user_id=b0689710b1c1444bae1d67a283cfae34, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:04.554218 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b7937-52d1-4a1b-816f-9aba5f0545b3 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:04.557670 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:04.582191 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1359/2733] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:31:04 2022] PUT /identity/v3/projects/656757a74a704dcaa556c18d131c7571/users/7ef7e1fae883462b8ea4acc42fef9ed3/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:04.582191 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb356ad8-c995-4821-84e0-0c54f9adbe61 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:04.582578 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1375/2734] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:31:04 2022] PUT /identity/v3/projects/6a1f06d8d86a49f281fa941a0e1f6973/users/b0689710b1c1444bae1d67a283cfae34/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:04.583990 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b7937-52d1-4a1b-816f-9aba5f0545b3 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:04.652495 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb356ad8-c995-4821-84e0-0c54f9adbe61 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:04.657213 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a6dcf-733c-4d64-b0d3-f19f149fd3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:04.658139 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a6dcf-733c-4d64-b0d3-f19f149fd3e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:04.658542 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a6dcf-733c-4d64-b0d3-f19f149fd3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:04.659063 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a6dcf-733c-4d64-b0d3-f19f149fd3e6 admin admin] PATH_INFO: `/v3/projects/e2d6d78d76d04775a319544e6208ffdf/users/01da2c7540d9412e9726b716ae49216a/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:04.664538 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b7937-52d1-4a1b-816f-9aba5f0545b3 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:04.672901 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7558782-bf25-4cb4-aadf-77a23a57c8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:04.673633 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7558782-bf25-4cb4-aadf-77a23a57c8da admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:04.673951 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7558782-bf25-4cb4-aadf-77a23a57c8da admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:04.674234 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7558782-bf25-4cb4-aadf-77a23a57c8da admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:04.674971 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7558782-bf25-4cb4-aadf-77a23a57c8da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:04.675350 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a6dcf-733c-4d64-b0d3-f19f149fd3e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d6d78d76d04775a319544e6208ffdf, user_id=01da2c7540d9412e9726b716ae49216a, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:04.676608 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7558782-bf25-4cb4-aadf-77a23a57c8da admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:04.678030 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a6dcf-733c-4d64-b0d3-f19f149fd3e6 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:04.687571 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1376/2735] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:31:04.688899 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f87ace-5491-467b-89e6-6c583e09d298 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:04.689330 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f87ace-5491-467b-89e6-6c583e09d298 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:04.689615 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f87ace-5491-467b-89e6-6c583e09d298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:04.694168 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1360/2736] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:31:04 2022] PUT /identity/v3/projects/e2d6d78d76d04775a319544e6208ffdf/users/01da2c7540d9412e9726b716ae49216a/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:04.694979 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a6dcf-733c-4d64-b0d3-f19f149fd3e6 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:04.718920 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-81f87ace-5491-467b-89e6-6c583e09d298 None None] MFA Rules not processed for user `7ef7e1fae883462b8ea4acc42fef9ed3`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:04.720342 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-81f87ace-5491-467b-89e6-6c583e09d298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:04.725847 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:04.773799 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a6dcf-733c-4d64-b0d3-f19f149fd3e6 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:04.780293 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722efb4-7833-48f6-ab80-e4393b6f9c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:04.781243 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722efb4-7833-48f6-ab80-e4393b6f9c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:04.781926 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722efb4-7833-48f6-ab80-e4393b6f9c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:04.782025 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722efb4-7833-48f6-ab80-e4393b6f9c10 admin admin] PATH_INFO: `/v3/projects/6a1f06d8d86a49f281fa941a0e1f6973/users/b0689710b1c1444bae1d67a283cfae34/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:04.783981 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722efb4-7833-48f6-ab80-e4393b6f9c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1f06d8d86a49f281fa941a0e1f6973, user_id=b0689710b1c1444bae1d67a283cfae34, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:04.786674 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722efb4-7833-48f6-ab80-e4393b6f9c10 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:04.798811 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1377/2737] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:04.799862 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1361/2738] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:31:04 2022] PUT /identity/v3/projects/6a1f06d8d86a49f281fa941a0e1f6973/users/b0689710b1c1444bae1d67a283cfae34/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:04.800062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f87ace-5491-467b-89e6-6c583e09d298 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:04.810415 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18842eff-7f1f-4c67-8f23-4cd0b9765ec1 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:04.810707 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18842eff-7f1f-4c67-8f23-4cd0b9765ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:04.810982 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18842eff-7f1f-4c67-8f23-4cd0b9765ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:04.812150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f87ace-5491-467b-89e6-6c583e09d298 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:04.844729 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-18842eff-7f1f-4c67-8f23-4cd0b9765ec1 None None] MFA Rules not processed for user `b0689710b1c1444bae1d67a283cfae34`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:04.846029 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-18842eff-7f1f-4c67-8f23-4cd0b9765ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:04.903933 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b1418-a9f4-495a-9e27-97250ed3921e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:04.905074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b1418-a9f4-495a-9e27-97250ed3921e admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:04.905579 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b1418-a9f4-495a-9e27-97250ed3921e admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:04.906142 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b1418-a9f4-495a-9e27-97250ed3921e admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:04.907476 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b1418-a9f4-495a-9e27-97250ed3921e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:04.910462 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b1418-a9f4-495a-9e27-97250ed3921e admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:04.922611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1362/2739] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:04 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:31:04.923951 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18842eff-7f1f-4c67-8f23-4cd0b9765ec1 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:04.925731 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-18842eff-7f1f-4c67-8f23-4cd0b9765ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:04.929614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1378/2740] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:31:04.934669 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b1418-a9f4-495a-9e27-97250ed3921e admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:04.951386 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b1418-a9f4-495a-9e27-97250ed3921e admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:04.958175 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1b537-585d-4473-b9d4-f1eef6d0898f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:04.959495 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1b537-585d-4473-b9d4-f1eef6d0898f admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:04.959912 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1b537-585d-4473-b9d4-f1eef6d0898f admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:04.960325 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1b537-585d-4473-b9d4-f1eef6d0898f admin admin] PATH_INFO: `/v3/projects/e2d6d78d76d04775a319544e6208ffdf/users/01da2c7540d9412e9726b716ae49216a/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:04.963477 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1b537-585d-4473-b9d4-f1eef6d0898f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d6d78d76d04775a319544e6208ffdf, user_id=01da2c7540d9412e9726b716ae49216a, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:04.968151 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1b537-585d-4473-b9d4-f1eef6d0898f admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:04.985560 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1379/2741] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:31:04 2022] PUT /identity/v3/projects/e2d6d78d76d04775a319544e6208ffdf/users/01da2c7540d9412e9726b716ae49216a/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:04.986883 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1b537-585d-4473-b9d4-f1eef6d0898f admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:04.987540 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18842eff-7f1f-4c67-8f23-4cd0b9765ec1 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:04.993738 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-17b1b537-585d-4473-b9d4-f1eef6d0898f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:05.001461 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:05.053995 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ff696-166f-4416-bc69-587e5ff3db7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:05.054676 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ff696-166f-4416-bc69-587e5ff3db7d service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:05.054960 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ff696-166f-4416-bc69-587e5ff3db7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:05.055238 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ff696-166f-4416-bc69-587e5ff3db7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:05.062672 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1b537-585d-4473-b9d4-f1eef6d0898f admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:05.065606 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:05.067022 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20c9d2-5db4-4c2e-9797-122ff68efc42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:05.067252 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20c9d2-5db4-4c2e-9797-122ff68efc42 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:05.067533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20c9d2-5db4-4c2e-9797-122ff68efc42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:05.067804 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20c9d2-5db4-4c2e-9797-122ff68efc42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:05.131408 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ff696-166f-4416-bc69-587e5ff3db7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:05.132910 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ff696-166f-4416-bc69-587e5ff3db7d service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:05.142950 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1363/2742] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:31:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:31:05.144478 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c64ea7-6142-4ab4-9158-670244fada6e None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:05.144777 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c64ea7-6142-4ab4-9158-670244fada6e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:05.145055 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c64ea7-6142-4ab4-9158-670244fada6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:05.152097 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce20c9d2-5db4-4c2e-9797-122ff68efc42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:05.153573 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce20c9d2-5db4-4c2e-9797-122ff68efc42 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:05.164125 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1380/2743] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:31:04 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:31:05.195827 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-08c64ea7-6142-4ab4-9158-670244fada6e None None] MFA Rules not processed for user `01da2c7540d9412e9726b716ae49216a`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:05.199127 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-08c64ea7-6142-4ab4-9158-670244fada6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:05.287076 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20c9d2-5db4-4c2e-9797-122ff68efc42 service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:05.303158 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20c9d2-5db4-4c2e-9797-122ff68efc42 service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:05.309003 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0f620-a218-4ff6-873d-1755201a2bf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:05.309676 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0f620-a218-4ff6-873d-1755201a2bf9 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:05.309995 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0f620-a218-4ff6-873d-1755201a2bf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:05.310273 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0f620-a218-4ff6-873d-1755201a2bf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:05.339540 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1364/2744] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:05.390061 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0f620-a218-4ff6-873d-1755201a2bf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:05.391816 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0f620-a218-4ff6-873d-1755201a2bf9 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:05.403748 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1381/2745] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:31:05 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:31:05.477699 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c64ea7-6142-4ab4-9158-670244fada6e None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:05.491048 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c64ea7-6142-4ab4-9158-670244fada6e None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:05.496307 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4eaf4-8598-46e4-8341-59d7917f5261 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:05.497074 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4eaf4-8598-46e4-8341-59d7917f5261 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:05.497443 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4eaf4-8598-46e4-8341-59d7917f5261 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:05.497808 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4eaf4-8598-46e4-8341-59d7917f5261 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:05.510715 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4eaf4-8598-46e4-8341-59d7917f5261 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:05.513499 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4eaf4-8598-46e4-8341-59d7917f5261 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:05.529506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1365/2746] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:31:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:31:05.710305 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0f620-a218-4ff6-873d-1755201a2bf9 service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:05.771145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:05.784986 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0f620-a218-4ff6-873d-1755201a2bf9 service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:05.791864 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bd599-2157-42f0-b783-2f6465155ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:05.793705 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bd599-2157-42f0-b783-2f6465155ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:05.793705 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bd599-2157-42f0-b783-2f6465155ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:05.793705 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bd599-2157-42f0-b783-2f6465155ea4 admin admin] PATH_INFO: `/v3/users/be48c18b8fff4f71b086ad92a9895b84` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:05.802688 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3bd599-2157-42f0-b783-2f6465155ea4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be48c18b8fff4f71b086ad92a9895b84)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:05.802688 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3bd599-2157-42f0-b783-2f6465155ea4 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:05.852913 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-3d3bd599-2157-42f0-b783-2f6465155ea4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be48c18b8fff4f71b086ad92a9895b84'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:05.865169 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-3d3bd599-2157-42f0-b783-2f6465155ea4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be48c18b8fff4f71b086ad92a9895b84'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:05.866249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-3d3bd599-2157-42f0-b783-2f6465155ea4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be48c18b8fff4f71b086ad92a9895b84'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:05.867227 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-3d3bd599-2157-42f0-b783-2f6465155ea4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be48c18b8fff4f71b086ad92a9895b84'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:05.887971 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-3d3bd599-2157-42f0-b783-2f6465155ea4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be48c18b8fff4f71b086ad92a9895b84'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:05.902989 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1382/2747] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:31:05 2022] DELETE /identity/v3/users/be48c18b8fff4f71b086ad92a9895b84 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:31:05.907640 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65a2e7-3298-48e5-aac5-419edd0ac52b None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:05.908169 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65a2e7-3298-48e5-aac5-419edd0ac52b None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:05.908290 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65a2e7-3298-48e5-aac5-419edd0ac52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:05.931351 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-cf65a2e7-3298-48e5-aac5-419edd0ac52b None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:05.933084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-cf65a2e7-3298-48e5-aac5-419edd0ac52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:05.991730 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1366/2748] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:06.002232 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bd599-2157-42f0-b783-2f6465155ea4 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:06.003651 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3d3bd599-2157-42f0-b783-2f6465155ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:06.085530 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bd599-2157-42f0-b783-2f6465155ea4 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:06.090377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac451a7c-d3a0-4c26-82a4-2676df944503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:06.091033 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac451a7c-d3a0-4c26-82a4-2676df944503 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:06.091326 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac451a7c-d3a0-4c26-82a4-2676df944503 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:06.091601 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac451a7c-d3a0-4c26-82a4-2676df944503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:06.101489 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac451a7c-d3a0-4c26-82a4-2676df944503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:06.102979 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac451a7c-d3a0-4c26-82a4-2676df944503 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:06.112882 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1383/2749] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:31:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:31:06.397520 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65a2e7-3298-48e5-aac5-419edd0ac52b None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:06.399016 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-cf65a2e7-3298-48e5-aac5-419edd0ac52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:06.411006 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65a2e7-3298-48e5-aac5-419edd0ac52b None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:06.415628 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da511d1-e876-42c1-a7d2-eeab4e5c4bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:06.417035 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da511d1-e876-42c1-a7d2-eeab4e5c4bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:06.417314 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da511d1-e876-42c1-a7d2-eeab4e5c4bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:06.417585 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da511d1-e876-42c1-a7d2-eeab4e5c4bc0 admin admin] PATH_INFO: `/v3/projects/c3238a04da17438785c20d6ab3ea16ce` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:06.418822 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da511d1-e876-42c1-a7d2-eeab4e5c4bc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3238a04da17438785c20d6ab3ea16ce)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:06.420744 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da511d1-e876-42c1-a7d2-eeab4e5c4bc0 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:06.439921 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:06.477645 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1da511d1-e876-42c1-a7d2-eeab4e5c4bc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3238a04da17438785c20d6ab3ea16ce', 'request_id': 'req-1da511d1-e876-42c1-a7d2-eeab4e5c4bc0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:06.484480 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1da511d1-e876-42c1-a7d2-eeab4e5c4bc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3238a04da17438785c20d6ab3ea16ce', 'request_id': 'req-1da511d1-e876-42c1-a7d2-eeab4e5c4bc0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:06.492349 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1da511d1-e876-42c1-a7d2-eeab4e5c4bc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3238a04da17438785c20d6ab3ea16ce', 'request_id': 'req-1da511d1-e876-42c1-a7d2-eeab4e5c4bc0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:06.504184 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1da511d1-e876-42c1-a7d2-eeab4e5c4bc0 admin admin] The token cache is being invalidate because project c3238a04da17438785c20d6ab3ea16ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:31:06.504462 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1da511d1-e876-42c1-a7d2-eeab4e5c4bc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:06.505128 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1da511d1-e876-42c1-a7d2-eeab4e5c4bc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:06.506746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1367/2750] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:31:06 2022] DELETE /identity/v3/projects/c3238a04da17438785c20d6ab3ea16ce => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:06.510988 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac451a7c-d3a0-4c26-82a4-2676df944503 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:06.520839 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac451a7c-d3a0-4c26-82a4-2676df944503 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:06.580589 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ca785-fa4e-4906-ad8d-b4a4eb40c569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:06.581505 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ca785-fa4e-4906-ad8d-b4a4eb40c569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:06.581789 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ca785-fa4e-4906-ad8d-b4a4eb40c569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:06.582094 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ca785-fa4e-4906-ad8d-b4a4eb40c569 admin admin] PATH_INFO: `/v3/users/01da2c7540d9412e9726b716ae49216a` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:06.590632 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ca785-fa4e-4906-ad8d-b4a4eb40c569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01da2c7540d9412e9726b716ae49216a)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:06.590632 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ca785-fa4e-4906-ad8d-b4a4eb40c569 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:06.602729 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:06.648791 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-751ca785-fa4e-4906-ad8d-b4a4eb40c569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01da2c7540d9412e9726b716ae49216a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:06.667974 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-751ca785-fa4e-4906-ad8d-b4a4eb40c569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01da2c7540d9412e9726b716ae49216a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:06.667974 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-751ca785-fa4e-4906-ad8d-b4a4eb40c569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01da2c7540d9412e9726b716ae49216a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:06.667974 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-751ca785-fa4e-4906-ad8d-b4a4eb40c569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01da2c7540d9412e9726b716ae49216a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:06.683159 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-751ca785-fa4e-4906-ad8d-b4a4eb40c569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01da2c7540d9412e9726b716ae49216a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:06.699809 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1384/2751] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:31:06 2022] DELETE /identity/v3/users/01da2c7540d9412e9726b716ae49216a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:31:07.052246 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da511d1-e876-42c1-a7d2-eeab4e5c4bc0 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:07.053785 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1da511d1-e876-42c1-a7d2-eeab4e5c4bc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:07.076042 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da511d1-e876-42c1-a7d2-eeab4e5c4bc0 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:07.176126 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721b3a9-77f7-48f5-8bc4-b52068fafe98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:07.176996 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721b3a9-77f7-48f5-8bc4-b52068fafe98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:07.177276 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721b3a9-77f7-48f5-8bc4-b52068fafe98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:07.177547 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721b3a9-77f7-48f5-8bc4-b52068fafe98 admin admin] PATH_INFO: `/v3/projects/e2d6d78d76d04775a319544e6208ffdf` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:07.179244 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721b3a9-77f7-48f5-8bc4-b52068fafe98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2d6d78d76d04775a319544e6208ffdf)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:07.181515 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721b3a9-77f7-48f5-8bc4-b52068fafe98 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:07.239410 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d721b3a9-77f7-48f5-8bc4-b52068fafe98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2d6d78d76d04775a319544e6208ffdf', 'request_id': 'req-d721b3a9-77f7-48f5-8bc4-b52068fafe98'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:07.245742 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d721b3a9-77f7-48f5-8bc4-b52068fafe98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2d6d78d76d04775a319544e6208ffdf', 'request_id': 'req-d721b3a9-77f7-48f5-8bc4-b52068fafe98'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:07.253229 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d721b3a9-77f7-48f5-8bc4-b52068fafe98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2d6d78d76d04775a319544e6208ffdf', 'request_id': 'req-d721b3a9-77f7-48f5-8bc4-b52068fafe98'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:07.264482 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d721b3a9-77f7-48f5-8bc4-b52068fafe98 admin admin] The token cache is being invalidate because project e2d6d78d76d04775a319544e6208ffdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:31:07.264772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d721b3a9-77f7-48f5-8bc4-b52068fafe98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:07.265413 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d721b3a9-77f7-48f5-8bc4-b52068fafe98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:07.267062 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1368/2752] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:31:07 2022] DELETE /identity/v3/projects/e2d6d78d76d04775a319544e6208ffdf => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:07.272972 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e467690-c91f-4ebb-b77f-256473586de7 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:07.273520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e467690-c91f-4ebb-b77f-256473586de7 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:07.273635 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e467690-c91f-4ebb-b77f-256473586de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:07.292794 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-1e467690-c91f-4ebb-b77f-256473586de7 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:07.294055 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-1e467690-c91f-4ebb-b77f-256473586de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:07.359658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1385/2753] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:07.368094 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979114df-6947-48e0-a1e1-da164c6e94bb None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:07.368383 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979114df-6947-48e0-a1e1-da164c6e94bb None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:07.368658 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979114df-6947-48e0-a1e1-da164c6e94bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:07.387952 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-979114df-6947-48e0-a1e1-da164c6e94bb None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:07.389126 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-979114df-6947-48e0-a1e1-da164c6e94bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:07.397360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1369/2754] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:07.401696 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e467690-c91f-4ebb-b77f-256473586de7 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:07.412052 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e467690-c91f-4ebb-b77f-256473586de7 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:07.416780 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ffb53d-4579-4df1-90e8-3f5ea5771f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:07.417475 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffb53d-4579-4df1-90e8-3f5ea5771f33 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:07.417758 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffb53d-4579-4df1-90e8-3f5ea5771f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:07.418066 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffb53d-4579-4df1-90e8-3f5ea5771f33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:07.418793 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ffb53d-4579-4df1-90e8-3f5ea5771f33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:31:07.419130 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ffb53d-4579-4df1-90e8-3f5ea5771f33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:07.420780 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ffb53d-4579-4df1-90e8-3f5ea5771f33 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:07.433847 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1386/2755] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:31:07.438209 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979114df-6947-48e0-a1e1-da164c6e94bb None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:07.448130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979114df-6947-48e0-a1e1-da164c6e94bb None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:07.452899 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98f53f-8371-44a7-890a-f98b49605857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:07.453551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98f53f-8371-44a7-890a-f98b49605857 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:07.453850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98f53f-8371-44a7-890a-f98b49605857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:07.454150 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98f53f-8371-44a7-890a-f98b49605857 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:07.454869 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98f53f-8371-44a7-890a-f98b49605857 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:07.456779 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98f53f-8371-44a7-890a-f98b49605857 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:07.490010 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1370/2756] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:31:07 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:31:07.495138 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ffb53d-4579-4df1-90e8-3f5ea5771f33 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:07.509217 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ffb53d-4579-4df1-90e8-3f5ea5771f33 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:07.579484 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da5006-5991-40ee-a792-6fb6eb0a1be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:07.580199 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da5006-5991-40ee-a792-6fb6eb0a1be5 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:07.580483 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da5006-5991-40ee-a792-6fb6eb0a1be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:07.580761 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da5006-5991-40ee-a792-6fb6eb0a1be5 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:07.581460 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da5006-5991-40ee-a792-6fb6eb0a1be5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:07.583456 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da5006-5991-40ee-a792-6fb6eb0a1be5 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:07.605001 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1387/2757] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:31:07 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:31:07.609039 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98f53f-8371-44a7-890a-f98b49605857 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:07.620003 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98f53f-8371-44a7-890a-f98b49605857 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:07.624711 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e21a25-5df6-488c-8467-c87f27649db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:07.625373 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e21a25-5df6-488c-8467-c87f27649db2 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:07.625656 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e21a25-5df6-488c-8467-c87f27649db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:07.625968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e21a25-5df6-488c-8467-c87f27649db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:07.626891 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e21a25-5df6-488c-8467-c87f27649db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:07.628469 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e21a25-5df6-488c-8467-c87f27649db2 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:07.630054 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:07.642943 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1371/2758] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:31:07.646760 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da5006-5991-40ee-a792-6fb6eb0a1be5 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:07.657138 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da5006-5991-40ee-a792-6fb6eb0a1be5 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:07.661855 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3a284-90a8-4138-ab3d-3f921333ad6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:07.662589 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3a284-90a8-4138-ab3d-3f921333ad6a admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:07.662821 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3a284-90a8-4138-ab3d-3f921333ad6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:07.663098 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3a284-90a8-4138-ab3d-3f921333ad6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:07.663825 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c3a284-90a8-4138-ab3d-3f921333ad6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:07.665462 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c3a284-90a8-4138-ab3d-3f921333ad6a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:07.671326 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:07.679381 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1388/2759] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:31:07.681811 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e21a25-5df6-488c-8467-c87f27649db2 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:07.692570 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e21a25-5df6-488c-8467-c87f27649db2 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:07.697337 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4ec81-e0cd-4d43-9a30-5237cb2f5823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:07.699235 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4ec81-e0cd-4d43-9a30-5237cb2f5823 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:07.699735 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4ec81-e0cd-4d43-9a30-5237cb2f5823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:07.700220 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4ec81-e0cd-4d43-9a30-5237cb2f5823 admin admin] PATH_INFO: `/v3/projects/b4f2a75151fa4d2db1fd523bef52cbca/users/ceb69d3800c64f308ef709148492bffa/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:07.717078 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4ec81-e0cd-4d43-9a30-5237cb2f5823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4f2a75151fa4d2db1fd523bef52cbca, user_id=ceb69d3800c64f308ef709148492bffa, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:07.719779 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4ec81-e0cd-4d43-9a30-5237cb2f5823 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:07.736059 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1372/2760] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:31:07 2022] PUT /identity/v3/projects/b4f2a75151fa4d2db1fd523bef52cbca/users/ceb69d3800c64f308ef709148492bffa/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:07.757026 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec5ad9-4123-4b3f-b125-2d4f95394b91 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:07.757533 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec5ad9-4123-4b3f-b125-2d4f95394b91 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:07.758078 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec5ad9-4123-4b3f-b125-2d4f95394b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:07.794295 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-c8ec5ad9-4123-4b3f-b125-2d4f95394b91 None None] MFA Rules not processed for user `ceb69d3800c64f308ef709148492bffa`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:07.795509 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c8ec5ad9-4123-4b3f-b125-2d4f95394b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:07.871304 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1389/2761] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:07.876008 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4ec81-e0cd-4d43-9a30-5237cb2f5823 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:07.942307 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4ec81-e0cd-4d43-9a30-5237cb2f5823 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:07.947050 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04d807-5e9b-45d2-ac96-92a4d9a87142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:07.947712 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04d807-5e9b-45d2-ac96-92a4d9a87142 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:07.947994 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04d807-5e9b-45d2-ac96-92a4d9a87142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:07.948267 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04d807-5e9b-45d2-ac96-92a4d9a87142 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:07.948951 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04d807-5e9b-45d2-ac96-92a4d9a87142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:07.951004 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04d807-5e9b-45d2-ac96-92a4d9a87142 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:07.988720 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1373/2762] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:31:07 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:31:07.993181 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec5ad9-4123-4b3f-b125-2d4f95394b91 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:08.005974 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec5ad9-4123-4b3f-b125-2d4f95394b91 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:08.067412 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c49cd5-0803-4e0d-bfaa-155cb5ef8df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:08.068090 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c49cd5-0803-4e0d-bfaa-155cb5ef8df6 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:08.068374 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c49cd5-0803-4e0d-bfaa-155cb5ef8df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:08.068644 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c49cd5-0803-4e0d-bfaa-155cb5ef8df6 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:08.069328 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c49cd5-0803-4e0d-bfaa-155cb5ef8df6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:08.071280 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c49cd5-0803-4e0d-bfaa-155cb5ef8df6 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:08.093050 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1390/2763] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:31:07 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:31:08.098801 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04d807-5e9b-45d2-ac96-92a4d9a87142 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:08.111602 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04d807-5e9b-45d2-ac96-92a4d9a87142 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:08.118968 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceccfa9-388f-4b15-ade2-3a767fd8f37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:08.119669 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceccfa9-388f-4b15-ade2-3a767fd8f37e admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:08.119947 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceccfa9-388f-4b15-ade2-3a767fd8f37e admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:08.120223 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceccfa9-388f-4b15-ade2-3a767fd8f37e admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:08.121015 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceccfa9-388f-4b15-ade2-3a767fd8f37e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:08.122670 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceccfa9-388f-4b15-ade2-3a767fd8f37e admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:08.143261 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1374/2764] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:31:08.147508 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c49cd5-0803-4e0d-bfaa-155cb5ef8df6 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:08.160515 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c49cd5-0803-4e0d-bfaa-155cb5ef8df6 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:08.167500 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd887f-7552-46c5-b8aa-046857c2ec10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:08.171535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd887f-7552-46c5-b8aa-046857c2ec10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:08.171535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd887f-7552-46c5-b8aa-046857c2ec10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:08.171535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd887f-7552-46c5-b8aa-046857c2ec10 admin admin] PATH_INFO: `/v3/projects/33341dc6cd0b492189ae9d4d2c566419/users/8ce36121e093458db7ee448c2cfb80d2/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:08.186644 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd887f-7552-46c5-b8aa-046857c2ec10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33341dc6cd0b492189ae9d4d2c566419, user_id=8ce36121e093458db7ee448c2cfb80d2, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:08.189453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd887f-7552-46c5-b8aa-046857c2ec10 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:08.204995 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1391/2765] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:31:08 2022] PUT /identity/v3/projects/33341dc6cd0b492189ae9d4d2c566419/users/8ce36121e093458db7ee448c2cfb80d2/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:08.214257 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceccfa9-388f-4b15-ade2-3a767fd8f37e admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:08.225724 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceccfa9-388f-4b15-ade2-3a767fd8f37e admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:08.306415 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88be009-2828-44a3-a635-64e5cbb04e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:08.307912 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88be009-2828-44a3-a635-64e5cbb04e94 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:08.308200 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88be009-2828-44a3-a635-64e5cbb04e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:08.308474 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88be009-2828-44a3-a635-64e5cbb04e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:08.309256 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88be009-2828-44a3-a635-64e5cbb04e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:08.311071 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88be009-2828-44a3-a635-64e5cbb04e94 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:08.325005 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1375/2766] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:31:08.329189 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd887f-7552-46c5-b8aa-046857c2ec10 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:08.341562 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd887f-7552-46c5-b8aa-046857c2ec10 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:08.346900 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab29da1-b71d-4fd0-a851-072e642abd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:08.347826 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab29da1-b71d-4fd0-a851-072e642abd1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:08.348110 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab29da1-b71d-4fd0-a851-072e642abd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:08.348386 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab29da1-b71d-4fd0-a851-072e642abd1c admin admin] PATH_INFO: `/v3/projects/33341dc6cd0b492189ae9d4d2c566419/users/8ce36121e093458db7ee448c2cfb80d2/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:08.350527 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab29da1-b71d-4fd0-a851-072e642abd1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=33341dc6cd0b492189ae9d4d2c566419, user_id=8ce36121e093458db7ee448c2cfb80d2, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:08.353266 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab29da1-b71d-4fd0-a851-072e642abd1c admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:08.368720 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1392/2767] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:31:08 2022] PUT /identity/v3/projects/33341dc6cd0b492189ae9d4d2c566419/users/8ce36121e093458db7ee448c2cfb80d2/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:31:08.379635 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb2aa1-f985-4f70-8867-d7e8e1c10b94 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:08.379969 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb2aa1-f985-4f70-8867-d7e8e1c10b94 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:08.380300 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb2aa1-f985-4f70-8867-d7e8e1c10b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:08.413158 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-3efb2aa1-f985-4f70-8867-d7e8e1c10b94 None None] MFA Rules not processed for user `8ce36121e093458db7ee448c2cfb80d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:08.414383 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-3efb2aa1-f985-4f70-8867-d7e8e1c10b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:08.449027 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:08.491999 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1376/2768] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:08.506012 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab29da1-b71d-4fd0-a851-072e642abd1c admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:08.506012 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2ab29da1-b71d-4fd0-a851-072e642abd1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:08.559764 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:08.576108 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab29da1-b71d-4fd0-a851-072e642abd1c admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:08.579915 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a200a-b1d5-4276-878b-75acda012320 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:08.580578 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a200a-b1d5-4276-878b-75acda012320 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:08.580869 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a200a-b1d5-4276-878b-75acda012320 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:08.581150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a200a-b1d5-4276-878b-75acda012320 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:08.643351 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a200a-b1d5-4276-878b-75acda012320 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:08.645004 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a200a-b1d5-4276-878b-75acda012320 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:08.655166 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1393/2769] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:31:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:31:11.508928 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb2aa1-f985-4f70-8867-d7e8e1c10b94 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:11.510527 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-3efb2aa1-f985-4f70-8867-d7e8e1c10b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:11.589041 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb2aa1-f985-4f70-8867-d7e8e1c10b94 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:11.593784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355b5e0-6d28-4105-ac6c-383b724e43ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:11.594703 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355b5e0-6d28-4105-ac6c-383b724e43ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:11.594991 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355b5e0-6d28-4105-ac6c-383b724e43ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:11.595457 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355b5e0-6d28-4105-ac6c-383b724e43ad admin admin] PATH_INFO: `/v3/users/aa36e84afb124f31bdcff57d9d72a2d0` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:11.596843 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355b5e0-6d28-4105-ac6c-383b724e43ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa36e84afb124f31bdcff57d9d72a2d0)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:11.598859 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355b5e0-6d28-4105-ac6c-383b724e43ad admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:11.668429 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c355b5e0-6d28-4105-ac6c-383b724e43ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa36e84afb124f31bdcff57d9d72a2d0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:11.680915 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c355b5e0-6d28-4105-ac6c-383b724e43ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa36e84afb124f31bdcff57d9d72a2d0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:11.682717 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c355b5e0-6d28-4105-ac6c-383b724e43ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa36e84afb124f31bdcff57d9d72a2d0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:11.703556 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c355b5e0-6d28-4105-ac6c-383b724e43ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa36e84afb124f31bdcff57d9d72a2d0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:11.704684 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c355b5e0-6d28-4105-ac6c-383b724e43ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa36e84afb124f31bdcff57d9d72a2d0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:11.722611 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1377/2770] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:31:11 2022] DELETE /identity/v3/users/aa36e84afb124f31bdcff57d9d72a2d0 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:31:11.727408 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfeb17-6c9a-4a92-babf-3514236c4d56 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:11.727911 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfeb17-6c9a-4a92-babf-3514236c4d56 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:11.728034 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfeb17-6c9a-4a92-babf-3514236c4d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:11.746651 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-3ddfeb17-6c9a-4a92-babf-3514236c4d56 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:11.748008 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3ddfeb17-6c9a-4a92-babf-3514236c4d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:11.809671 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1394/2771] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:11.820270 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355b5e0-6d28-4105-ac6c-383b724e43ad admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:11.821742 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c355b5e0-6d28-4105-ac6c-383b724e43ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:11.875970 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:11.882206 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355b5e0-6d28-4105-ac6c-383b724e43ad admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:11.886829 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb37328-e68a-4545-b9d1-227c8d4d40f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:11.887489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb37328-e68a-4545-b9d1-227c8d4d40f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:11.887958 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb37328-e68a-4545-b9d1-227c8d4d40f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:11.888247 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb37328-e68a-4545-b9d1-227c8d4d40f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:11.897925 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb37328-e68a-4545-b9d1-227c8d4d40f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:11.899370 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb37328-e68a-4545-b9d1-227c8d4d40f1 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:11.910199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1378/2772] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:31:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:31:12.205323 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfeb17-6c9a-4a92-babf-3514236c4d56 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:12.206834 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3ddfeb17-6c9a-4a92-babf-3514236c4d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:12.221351 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfeb17-6c9a-4a92-babf-3514236c4d56 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:12.226084 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80429577-1480-424b-8de2-3d5c698c29b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:12.226964 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80429577-1480-424b-8de2-3d5c698c29b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:12.227252 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80429577-1480-424b-8de2-3d5c698c29b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:12.227528 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80429577-1480-424b-8de2-3d5c698c29b0 admin admin] PATH_INFO: `/v3/projects/01ddcf447eb14d488c321c57d1fadf05` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:12.228760 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80429577-1480-424b-8de2-3d5c698c29b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01ddcf447eb14d488c321c57d1fadf05)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:12.230955 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80429577-1480-424b-8de2-3d5c698c29b0 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:12.284312 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-80429577-1480-424b-8de2-3d5c698c29b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01ddcf447eb14d488c321c57d1fadf05', 'request_id': 'req-80429577-1480-424b-8de2-3d5c698c29b0'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:12.291988 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-80429577-1480-424b-8de2-3d5c698c29b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01ddcf447eb14d488c321c57d1fadf05', 'request_id': 'req-80429577-1480-424b-8de2-3d5c698c29b0'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:12.301360 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-80429577-1480-424b-8de2-3d5c698c29b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01ddcf447eb14d488c321c57d1fadf05', 'request_id': 'req-80429577-1480-424b-8de2-3d5c698c29b0'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:12.312834 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-80429577-1480-424b-8de2-3d5c698c29b0 admin admin] The token cache is being invalidate because project 01ddcf447eb14d488c321c57d1fadf05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:31:12.313123 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-80429577-1480-424b-8de2-3d5c698c29b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:12.313777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-80429577-1480-424b-8de2-3d5c698c29b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:12.315502 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1395/2773] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:31:12 2022] DELETE /identity/v3/projects/01ddcf447eb14d488c321c57d1fadf05 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:12.320562 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb37328-e68a-4545-b9d1-227c8d4d40f1 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:12.331726 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb37328-e68a-4545-b9d1-227c8d4d40f1 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:12.405144 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714126c7-42a1-4aa9-a8cd-785344748cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:12.406011 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714126c7-42a1-4aa9-a8cd-785344748cd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:12.406333 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714126c7-42a1-4aa9-a8cd-785344748cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:12.406610 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714126c7-42a1-4aa9-a8cd-785344748cd5 admin admin] PATH_INFO: `/v3/users/b0689710b1c1444bae1d67a283cfae34` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:12.407847 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714126c7-42a1-4aa9-a8cd-785344748cd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0689710b1c1444bae1d67a283cfae34)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:12.409797 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714126c7-42a1-4aa9-a8cd-785344748cd5 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:12.463170 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-714126c7-42a1-4aa9-a8cd-785344748cd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0689710b1c1444bae1d67a283cfae34'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:12.470620 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-714126c7-42a1-4aa9-a8cd-785344748cd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0689710b1c1444bae1d67a283cfae34'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:12.471371 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-714126c7-42a1-4aa9-a8cd-785344748cd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0689710b1c1444bae1d67a283cfae34'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:12.489519 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-714126c7-42a1-4aa9-a8cd-785344748cd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0689710b1c1444bae1d67a283cfae34'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:12.490670 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-714126c7-42a1-4aa9-a8cd-785344748cd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0689710b1c1444bae1d67a283cfae34'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:12.505586 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1379/2774] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:31:12 2022] DELETE /identity/v3/users/b0689710b1c1444bae1d67a283cfae34 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:12.790337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80429577-1480-424b-8de2-3d5c698c29b0 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:12.792450 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-80429577-1480-424b-8de2-3d5c698c29b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:12.813215 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80429577-1480-424b-8de2-3d5c698c29b0 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:12.842555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:12.888704 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd8a5a-ab59-4f54-8ed0-517036689464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:12.889947 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd8a5a-ab59-4f54-8ed0-517036689464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:12.890229 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd8a5a-ab59-4f54-8ed0-517036689464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:12.890502 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd8a5a-ab59-4f54-8ed0-517036689464 admin admin] PATH_INFO: `/v3/projects/6a1f06d8d86a49f281fa941a0e1f6973` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:12.891872 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd8a5a-ab59-4f54-8ed0-517036689464 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a1f06d8d86a49f281fa941a0e1f6973)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:12.893849 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd8a5a-ab59-4f54-8ed0-517036689464 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:12.956288 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-59dd8a5a-ab59-4f54-8ed0-517036689464 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a1f06d8d86a49f281fa941a0e1f6973', 'request_id': 'req-59dd8a5a-ab59-4f54-8ed0-517036689464'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:12.966991 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-59dd8a5a-ab59-4f54-8ed0-517036689464 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a1f06d8d86a49f281fa941a0e1f6973', 'request_id': 'req-59dd8a5a-ab59-4f54-8ed0-517036689464'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:12.977048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-59dd8a5a-ab59-4f54-8ed0-517036689464 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a1f06d8d86a49f281fa941a0e1f6973', 'request_id': 'req-59dd8a5a-ab59-4f54-8ed0-517036689464'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:12.988352 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-59dd8a5a-ab59-4f54-8ed0-517036689464 admin admin] The token cache is being invalidate because project 6a1f06d8d86a49f281fa941a0e1f6973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:31:12.988644 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-59dd8a5a-ab59-4f54-8ed0-517036689464 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:12.989293 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-59dd8a5a-ab59-4f54-8ed0-517036689464 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:12.990924 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1396/2775] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:31:12 2022] DELETE /identity/v3/projects/6a1f06d8d86a49f281fa941a0e1f6973 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:12.996511 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe0330-e842-42d6-9ab1-4e2afd8fd79e None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:12.997067 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe0330-e842-42d6-9ab1-4e2afd8fd79e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:12.997295 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe0330-e842-42d6-9ab1-4e2afd8fd79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:13.022119 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-babe0330-e842-42d6-9ab1-4e2afd8fd79e None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:13.023339 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-babe0330-e842-42d6-9ab1-4e2afd8fd79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:13.090421 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1380/2776] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:13.099513 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e879044-ead0-40ec-a435-1d8eb6315b22 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:13.099803 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e879044-ead0-40ec-a435-1d8eb6315b22 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:13.100081 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e879044-ead0-40ec-a435-1d8eb6315b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:13.120342 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-5e879044-ead0-40ec-a435-1d8eb6315b22 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:13.121582 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-5e879044-ead0-40ec-a435-1d8eb6315b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:13.130059 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1397/2777] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:13.134636 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe0330-e842-42d6-9ab1-4e2afd8fd79e None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:13.147663 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe0330-e842-42d6-9ab1-4e2afd8fd79e None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:13.152836 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d46cc-44ee-43f6-a76a-13dc49a53ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:13.153498 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d46cc-44ee-43f6-a76a-13dc49a53ceb admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:13.153777 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d46cc-44ee-43f6-a76a-13dc49a53ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:13.154079 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d46cc-44ee-43f6-a76a-13dc49a53ceb admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:13.154806 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d46cc-44ee-43f6-a76a-13dc49a53ceb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:31:13.155108 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d46cc-44ee-43f6-a76a-13dc49a53ceb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:13.156717 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d46cc-44ee-43f6-a76a-13dc49a53ceb admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:13.159489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:13.171154 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1381/2778] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:31:13.175670 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e879044-ead0-40ec-a435-1d8eb6315b22 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:13.185100 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e879044-ead0-40ec-a435-1d8eb6315b22 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:13.190125 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda01b19-f645-4566-918d-e184bbf89a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:13.190795 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda01b19-f645-4566-918d-e184bbf89a87 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:13.191073 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda01b19-f645-4566-918d-e184bbf89a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:13.191344 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda01b19-f645-4566-918d-e184bbf89a87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:13.192042 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda01b19-f645-4566-918d-e184bbf89a87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:13.194006 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda01b19-f645-4566-918d-e184bbf89a87 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:13.227030 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1398/2779] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:31:13 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:31:13.231567 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d46cc-44ee-43f6-a76a-13dc49a53ceb admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:13.242445 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d46cc-44ee-43f6-a76a-13dc49a53ceb admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:13.308373 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac0a61-5cc1-4350-b8cc-7447418b5a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:13.309174 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac0a61-5cc1-4350-b8cc-7447418b5a24 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:13.309341 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac0a61-5cc1-4350-b8cc-7447418b5a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:13.309622 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac0a61-5cc1-4350-b8cc-7447418b5a24 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:13.310392 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac0a61-5cc1-4350-b8cc-7447418b5a24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:13.312430 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac0a61-5cc1-4350-b8cc-7447418b5a24 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:13.342369 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1382/2780] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:31:13 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:31:13.346630 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda01b19-f645-4566-918d-e184bbf89a87 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:13.359328 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda01b19-f645-4566-918d-e184bbf89a87 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:13.369753 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cff8e2-0f91-4490-a4d3-3d7264ccb82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:13.370516 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cff8e2-0f91-4490-a4d3-3d7264ccb82b admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:13.370882 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cff8e2-0f91-4490-a4d3-3d7264ccb82b admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:13.371298 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cff8e2-0f91-4490-a4d3-3d7264ccb82b admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:13.372657 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cff8e2-0f91-4490-a4d3-3d7264ccb82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:13.375368 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cff8e2-0f91-4490-a4d3-3d7264ccb82b admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:13.394899 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1399/2781] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:31:13.401135 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac0a61-5cc1-4350-b8cc-7447418b5a24 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:13.416641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac0a61-5cc1-4350-b8cc-7447418b5a24 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:13.425677 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93ddc7-7dec-4dbb-b29d-8f42dc906b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:13.426400 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93ddc7-7dec-4dbb-b29d-8f42dc906b1e admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:13.426685 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93ddc7-7dec-4dbb-b29d-8f42dc906b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:13.426961 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93ddc7-7dec-4dbb-b29d-8f42dc906b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:13.427758 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93ddc7-7dec-4dbb-b29d-8f42dc906b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:13.429412 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93ddc7-7dec-4dbb-b29d-8f42dc906b1e admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:13.440555 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1383/2782] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:31:13.444809 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cff8e2-0f91-4490-a4d3-3d7264ccb82b admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:13.455249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cff8e2-0f91-4490-a4d3-3d7264ccb82b admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:13.464154 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71027454-0154-4ff9-b8ae-617cf552df5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:13.465068 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71027454-0154-4ff9-b8ae-617cf552df5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:13.465364 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71027454-0154-4ff9-b8ae-617cf552df5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:13.465630 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71027454-0154-4ff9-b8ae-617cf552df5a admin admin] PATH_INFO: `/v3/projects/b1e3824a17e54d6eb302105e21bd926b/users/6eb1711a675d47c995ca9d85eacf297a/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:13.482659 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71027454-0154-4ff9-b8ae-617cf552df5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1e3824a17e54d6eb302105e21bd926b, user_id=6eb1711a675d47c995ca9d85eacf297a, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:13.485329 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71027454-0154-4ff9-b8ae-617cf552df5a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:13.499165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1400/2783] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:31:13 2022] PUT /identity/v3/projects/b1e3824a17e54d6eb302105e21bd926b/users/6eb1711a675d47c995ca9d85eacf297a/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:13.509752 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72c01e-0945-4e96-8bdb-c152ad86db23 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:13.510070 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72c01e-0945-4e96-8bdb-c152ad86db23 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:13.510353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72c01e-0945-4e96-8bdb-c152ad86db23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:13.538867 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-9e72c01e-0945-4e96-8bdb-c152ad86db23 None None] MFA Rules not processed for user `6eb1711a675d47c995ca9d85eacf297a`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:13.540084 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-9e72c01e-0945-4e96-8bdb-c152ad86db23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:13.607133 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1384/2784] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:13.611783 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71027454-0154-4ff9-b8ae-617cf552df5a admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:13.665773 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:13.683076 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71027454-0154-4ff9-b8ae-617cf552df5a admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:13.688729 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f8738-ca5d-49e9-b40d-13d8ee77358e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:13.689423 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f8738-ca5d-49e9-b40d-13d8ee77358e admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:13.689704 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f8738-ca5d-49e9-b40d-13d8ee77358e admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:13.690010 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f8738-ca5d-49e9-b40d-13d8ee77358e admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:13.690733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f8738-ca5d-49e9-b40d-13d8ee77358e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:13.692756 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f8738-ca5d-49e9-b40d-13d8ee77358e admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:13.731081 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1401/2785] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:31:13 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:31:13.735060 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72c01e-0945-4e96-8bdb-c152ad86db23 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:13.746883 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72c01e-0945-4e96-8bdb-c152ad86db23 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:13.821787 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2391a-6e29-4782-8fe6-cdba7a178ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:13.822563 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2391a-6e29-4782-8fe6-cdba7a178ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:13.822850 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2391a-6e29-4782-8fe6-cdba7a178ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:13.823129 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2391a-6e29-4782-8fe6-cdba7a178ce8 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:13.823838 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a2391a-6e29-4782-8fe6-cdba7a178ce8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:13.826351 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a2391a-6e29-4782-8fe6-cdba7a178ce8 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:13.836025 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:13.851488 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1385/2786] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:31:13 2022] POST /identity/v3/users => generated 299 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:31:13.856128 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f8738-ca5d-49e9-b40d-13d8ee77358e admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:13.868541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f8738-ca5d-49e9-b40d-13d8ee77358e admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:13.874555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ada32-b08f-41c2-8498-8eaffb69b8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:13.875332 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ada32-b08f-41c2-8498-8eaffb69b8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:13.875621 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ada32-b08f-41c2-8498-8eaffb69b8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:13.875904 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ada32-b08f-41c2-8498-8eaffb69b8e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:13.876644 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ada32-b08f-41c2-8498-8eaffb69b8e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:13.878331 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ada32-b08f-41c2-8498-8eaffb69b8e2 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:13.890244 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1402/2787] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:31:13.894230 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2391a-6e29-4782-8fe6-cdba7a178ce8 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:13.904878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2391a-6e29-4782-8fe6-cdba7a178ce8 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:13.909765 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be5f20-7573-4d1f-b1d9-fd13b6d36c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:13.910728 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be5f20-7573-4d1f-b1d9-fd13b6d36c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:13.911021 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be5f20-7573-4d1f-b1d9-fd13b6d36c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:13.911305 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be5f20-7573-4d1f-b1d9-fd13b6d36c63 admin admin] PATH_INFO: `/v3/projects/210940735d5e42d18e215d616c7201db/users/5932843dba9143498e615055628cce97/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:13.929357 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be5f20-7573-4d1f-b1d9-fd13b6d36c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=210940735d5e42d18e215d616c7201db, user_id=5932843dba9143498e615055628cce97, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:13.932784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be5f20-7573-4d1f-b1d9-fd13b6d36c63 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:13.947240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1386/2788] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:31:13 2022] PUT /identity/v3/projects/210940735d5e42d18e215d616c7201db/users/5932843dba9143498e615055628cce97/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:13.951261 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ada32-b08f-41c2-8498-8eaffb69b8e2 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:13.962036 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ada32-b08f-41c2-8498-8eaffb69b8e2 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:14.023377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1362a-6d95-4755-8b93-083a0d733e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:14.024063 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1362a-6d95-4755-8b93-083a0d733e07 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:14.024345 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1362a-6d95-4755-8b93-083a0d733e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:14.024616 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1362a-6d95-4755-8b93-083a0d733e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:14.025365 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1362a-6d95-4755-8b93-083a0d733e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:14.027075 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1362a-6d95-4755-8b93-083a0d733e07 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:14.038370 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1403/2789] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:31:14.043246 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be5f20-7573-4d1f-b1d9-fd13b6d36c63 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:14.054656 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be5f20-7573-4d1f-b1d9-fd13b6d36c63 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:14.060183 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce265560-276c-4831-aba2-5beeeb39fa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:14.061092 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce265560-276c-4831-aba2-5beeeb39fa0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:14.061378 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce265560-276c-4831-aba2-5beeeb39fa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:14.061656 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce265560-276c-4831-aba2-5beeeb39fa0e admin admin] PATH_INFO: `/v3/projects/210940735d5e42d18e215d616c7201db/users/5932843dba9143498e615055628cce97/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:14.064892 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce265560-276c-4831-aba2-5beeeb39fa0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=210940735d5e42d18e215d616c7201db, user_id=5932843dba9143498e615055628cce97, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:14.067593 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce265560-276c-4831-aba2-5beeeb39fa0e admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:14.079177 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1387/2790] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:31:14 2022] PUT /identity/v3/projects/210940735d5e42d18e215d616c7201db/users/5932843dba9143498e615055628cce97/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:14.090377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8f039-fd06-47d6-bc58-65d604419f59 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:14.090665 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8f039-fd06-47d6-bc58-65d604419f59 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:14.090943 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8f039-fd06-47d6-bc58-65d604419f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:14.121714 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-a1e8f039-fd06-47d6-bc58-65d604419f59 None None] MFA Rules not processed for user `5932843dba9143498e615055628cce97`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:14.122985 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a1e8f039-fd06-47d6-bc58-65d604419f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:14.201152 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1404/2791] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:14.217172 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce265560-276c-4831-aba2-5beeeb39fa0e admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:14.219103 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ce265560-276c-4831-aba2-5beeeb39fa0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:14.282952 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce265560-276c-4831-aba2-5beeeb39fa0e admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:14.287186 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631e367-2a65-416a-b7da-e7694691560f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:14.287865 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631e367-2a65-416a-b7da-e7694691560f service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:14.288150 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631e367-2a65-416a-b7da-e7694691560f service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:14.288428 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631e367-2a65-416a-b7da-e7694691560f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:14.298852 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631e367-2a65-416a-b7da-e7694691560f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:14.300310 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631e367-2a65-416a-b7da-e7694691560f service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:14.311702 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1388/2792] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:31:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:31:14.902080 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8f039-fd06-47d6-bc58-65d604419f59 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:14.954113 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:14.976171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8f039-fd06-47d6-bc58-65d604419f59 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:14.980862 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672796ac-065b-452a-af87-79d871ad83d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:14.981672 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672796ac-065b-452a-af87-79d871ad83d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:14.981987 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672796ac-065b-452a-af87-79d871ad83d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:14.982270 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672796ac-065b-452a-af87-79d871ad83d8 admin admin] PATH_INFO: `/v3/users/6eb1711a675d47c995ca9d85eacf297a` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:14.983482 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672796ac-065b-452a-af87-79d871ad83d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eb1711a675d47c995ca9d85eacf297a)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:14.985414 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672796ac-065b-452a-af87-79d871ad83d8 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:15.037716 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-672796ac-065b-452a-af87-79d871ad83d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eb1711a675d47c995ca9d85eacf297a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:15.045051 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-672796ac-065b-452a-af87-79d871ad83d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eb1711a675d47c995ca9d85eacf297a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:15.046568 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-672796ac-065b-452a-af87-79d871ad83d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eb1711a675d47c995ca9d85eacf297a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:15.047069 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-672796ac-065b-452a-af87-79d871ad83d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eb1711a675d47c995ca9d85eacf297a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:15.065688 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-672796ac-065b-452a-af87-79d871ad83d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eb1711a675d47c995ca9d85eacf297a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:15.080749 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1405/2793] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:31:14 2022] DELETE /identity/v3/users/6eb1711a675d47c995ca9d85eacf297a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:15.085418 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f3dfa-2a86-4474-899c-1e280c2cb526 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:15.085989 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f3dfa-2a86-4474-899c-1e280c2cb526 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:15.085989 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f3dfa-2a86-4474-899c-1e280c2cb526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:15.106989 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-d27f3dfa-2a86-4474-899c-1e280c2cb526 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:15.108212 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d27f3dfa-2a86-4474-899c-1e280c2cb526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:15.189297 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1389/2794] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:15.199915 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672796ac-065b-452a-af87-79d871ad83d8 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:15.201738 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-672796ac-065b-452a-af87-79d871ad83d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:15.269814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672796ac-065b-452a-af87-79d871ad83d8 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:15.273639 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d0341-5b6d-4036-a3a0-92caf1e241c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:15.274355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d0341-5b6d-4036-a3a0-92caf1e241c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:15.274644 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d0341-5b6d-4036-a3a0-92caf1e241c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:15.274926 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d0341-5b6d-4036-a3a0-92caf1e241c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:15.285310 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d0341-5b6d-4036-a3a0-92caf1e241c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:15.286836 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d0341-5b6d-4036-a3a0-92caf1e241c9 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:15.297923 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1406/2795] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:31:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:31:15.617587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f3dfa-2a86-4474-899c-1e280c2cb526 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:15.619083 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d27f3dfa-2a86-4474-899c-1e280c2cb526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:15.632272 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f3dfa-2a86-4474-899c-1e280c2cb526 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:15.638025 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f161b-d0e8-430e-aad3-7b1783640e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:15.639324 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f161b-d0e8-430e-aad3-7b1783640e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:15.639623 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f161b-d0e8-430e-aad3-7b1783640e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:15.639905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f161b-d0e8-430e-aad3-7b1783640e9f admin admin] PATH_INFO: `/v3/projects/b1e3824a17e54d6eb302105e21bd926b` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:15.642077 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f161b-d0e8-430e-aad3-7b1783640e9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1e3824a17e54d6eb302105e21bd926b)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:15.644134 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f161b-d0e8-430e-aad3-7b1783640e9f admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:15.696953 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c68f161b-d0e8-430e-aad3-7b1783640e9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1e3824a17e54d6eb302105e21bd926b', 'request_id': 'req-c68f161b-d0e8-430e-aad3-7b1783640e9f'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:15.703607 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c68f161b-d0e8-430e-aad3-7b1783640e9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1e3824a17e54d6eb302105e21bd926b', 'request_id': 'req-c68f161b-d0e8-430e-aad3-7b1783640e9f'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:15.705365 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:DELETE=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:15.712088 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c68f161b-d0e8-430e-aad3-7b1783640e9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1e3824a17e54d6eb302105e21bd926b', 'request_id': 'req-c68f161b-d0e8-430e-aad3-7b1783640e9f'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:15.726428 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c68f161b-d0e8-430e-aad3-7b1783640e9f admin admin] The token cache is being invalidate because project b1e3824a17e54d6eb302105e21bd926b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:31:15.726700 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c68f161b-d0e8-430e-aad3-7b1783640e9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:15.727372 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c68f161b-d0e8-430e-aad3-7b1783640e9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:15.729528 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1390/2796] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:31:15 2022] DELETE /identity/v3/projects/b1e3824a17e54d6eb302105e21bd926b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:15.734189 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d0341-5b6d-4036-a3a0-92caf1e241c9 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:15.746394 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d0341-5b6d-4036-a3a0-92caf1e241c9 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:15.806867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93679748-1968-4002-b934-b429d393cb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:15.807659 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93679748-1968-4002-b934-b429d393cb4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:15.807942 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93679748-1968-4002-b934-b429d393cb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:15.808218 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93679748-1968-4002-b934-b429d393cb4f admin admin] PATH_INFO: `/v3/users/5932843dba9143498e615055628cce97` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:15.809466 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93679748-1968-4002-b934-b429d393cb4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5932843dba9143498e615055628cce97)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:15.811442 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93679748-1968-4002-b934-b429d393cb4f admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:15.817223 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:15.868515 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-93679748-1968-4002-b934-b429d393cb4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5932843dba9143498e615055628cce97'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:15.876197 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-93679748-1968-4002-b934-b429d393cb4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5932843dba9143498e615055628cce97'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:15.876922 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-93679748-1968-4002-b934-b429d393cb4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5932843dba9143498e615055628cce97'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:15.877538 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-93679748-1968-4002-b934-b429d393cb4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5932843dba9143498e615055628cce97'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:15.891341 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-93679748-1968-4002-b934-b429d393cb4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5932843dba9143498e615055628cce97'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:15.905457 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1407/2797] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:31:15 2022] DELETE /identity/v3/users/5932843dba9143498e615055628cce97 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:16.204100 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f161b-d0e8-430e-aad3-7b1783640e9f admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:16.206869 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c68f161b-d0e8-430e-aad3-7b1783640e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:16.221616 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f161b-d0e8-430e-aad3-7b1783640e9f admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:16.289125 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93679748-1968-4002-b934-b429d393cb4f admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:16.290567 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-93679748-1968-4002-b934-b429d393cb4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:16.297058 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7a10c-6d6f-4aff-8f00-a884e01b9570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:16.297978 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7a10c-6d6f-4aff-8f00-a884e01b9570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:16.298268 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7a10c-6d6f-4aff-8f00-a884e01b9570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:16.298547 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7a10c-6d6f-4aff-8f00-a884e01b9570 admin admin] PATH_INFO: `/v3/projects/210940735d5e42d18e215d616c7201db` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:16.299781 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7a10c-6d6f-4aff-8f00-a884e01b9570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=210940735d5e42d18e215d616c7201db)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:16.301718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7a10c-6d6f-4aff-8f00-a884e01b9570 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:16.357154 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93679748-1968-4002-b934-b429d393cb4f admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:16.358513 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-90c7a10c-6d6f-4aff-8f00-a884e01b9570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '210940735d5e42d18e215d616c7201db', 'request_id': 'req-90c7a10c-6d6f-4aff-8f00-a884e01b9570'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:16.368551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-90c7a10c-6d6f-4aff-8f00-a884e01b9570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '210940735d5e42d18e215d616c7201db', 'request_id': 'req-90c7a10c-6d6f-4aff-8f00-a884e01b9570'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:16.382136 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-90c7a10c-6d6f-4aff-8f00-a884e01b9570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '210940735d5e42d18e215d616c7201db', 'request_id': 'req-90c7a10c-6d6f-4aff-8f00-a884e01b9570'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:16.399377 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-90c7a10c-6d6f-4aff-8f00-a884e01b9570 admin admin] The token cache is being invalidate because project 210940735d5e42d18e215d616c7201db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:31:16.401083 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-90c7a10c-6d6f-4aff-8f00-a884e01b9570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:16.402100 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-90c7a10c-6d6f-4aff-8f00-a884e01b9570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:16.404046 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1391/2798] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:31:16 2022] DELETE /identity/v3/projects/210940735d5e42d18e215d616c7201db => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:16.411422 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94c9e8-dea0-4f56-9236-3ad0619b25c4 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:16.411840 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94c9e8-dea0-4f56-9236-3ad0619b25c4 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:16.412154 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94c9e8-dea0-4f56-9236-3ad0619b25c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:16.422080 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746428b-30db-4af9-842f-f45b7caee4c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:16.422861 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746428b-30db-4af9-842f-f45b7caee4c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:16.423215 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746428b-30db-4af9-842f-f45b7caee4c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:16.423560 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746428b-30db-4af9-842f-f45b7caee4c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:16.427549 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3746428b-30db-4af9-842f-f45b7caee4c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:16.440878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-ac94c9e8-dea0-4f56-9236-3ad0619b25c4 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:16.442665 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ac94c9e8-dea0-4f56-9236-3ad0619b25c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:16.497187 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:16.518897 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3746428b-30db-4af9-842f-f45b7caee4c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:16.520784 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3746428b-30db-4af9-842f-f45b7caee4c2 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:16.534484 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1408/2799] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:31:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:31:16.542012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1392/2800] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:16.609693 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8028d-359a-460b-9b7a-82b5c329d492 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:16.610038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8028d-359a-460b-9b7a-82b5c329d492 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:16.610323 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8028d-359a-460b-9b7a-82b5c329d492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:16.632664 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-3ac8028d-359a-460b-9b7a-82b5c329d492 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:16.637318 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3ac8028d-359a-460b-9b7a-82b5c329d492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:16.662530 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1409/2801] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:16.669326 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94c9e8-dea0-4f56-9236-3ad0619b25c4 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:16.690414 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94c9e8-dea0-4f56-9236-3ad0619b25c4 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:16.711695 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b8174-4679-466b-b48f-b2755ea071be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:16.715507 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b8174-4679-466b-b48f-b2755ea071be admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:16.716298 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b8174-4679-466b-b48f-b2755ea071be admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:16.718272 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b8174-4679-466b-b48f-b2755ea071be admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:16.719532 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b8174-4679-466b-b48f-b2755ea071be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:31:16.724016 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b8174-4679-466b-b48f-b2755ea071be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:16.728657 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b8174-4679-466b-b48f-b2755ea071be admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:16.750286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:16.767849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1393/2802] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:31:16.772985 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8028d-359a-460b-9b7a-82b5c329d492 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:16.805663 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8028d-359a-460b-9b7a-82b5c329d492 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:16.812124 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eabd30-9657-4d3f-bc00-76cf1c5aa5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:16.813099 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eabd30-9657-4d3f-bc00-76cf1c5aa5a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:16.813465 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eabd30-9657-4d3f-bc00-76cf1c5aa5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:16.813633 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eabd30-9657-4d3f-bc00-76cf1c5aa5a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:16.814394 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eabd30-9657-4d3f-bc00-76cf1c5aa5a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:16.816542 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eabd30-9657-4d3f-bc00-76cf1c5aa5a5 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:16.864075 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1410/2803] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:31:16 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:31:16.868857 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b8174-4679-466b-b48f-b2755ea071be admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:16.882015 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b8174-4679-466b-b48f-b2755ea071be admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:17.017721 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acac21a-b7e1-4430-a244-c0fd713ac1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:17.018964 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acac21a-b7e1-4430-a244-c0fd713ac1a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:17.019525 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acac21a-b7e1-4430-a244-c0fd713ac1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:17.020103 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acac21a-b7e1-4430-a244-c0fd713ac1a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:17.021613 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acac21a-b7e1-4430-a244-c0fd713ac1a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:17.025873 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acac21a-b7e1-4430-a244-c0fd713ac1a3 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:17.070060 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1394/2804] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:31:16 2022] POST /identity/v3/users => generated 287 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:31:17.076555 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eabd30-9657-4d3f-bc00-76cf1c5aa5a5 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:17.095673 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eabd30-9657-4d3f-bc00-76cf1c5aa5a5 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:17.112785 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b97f1-1f4e-4fe6-ba4b-df9103bfc867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:17.114259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b97f1-1f4e-4fe6-ba4b-df9103bfc867 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:17.114814 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b97f1-1f4e-4fe6-ba4b-df9103bfc867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:17.115620 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b97f1-1f4e-4fe6-ba4b-df9103bfc867 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:17.117154 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b97f1-1f4e-4fe6-ba4b-df9103bfc867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:17.120309 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b97f1-1f4e-4fe6-ba4b-df9103bfc867 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:17.137101 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1411/2805] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:31:17.141961 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acac21a-b7e1-4430-a244-c0fd713ac1a3 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:17.153398 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acac21a-b7e1-4430-a244-c0fd713ac1a3 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:17.158697 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83448c11-41fd-46c0-a0c4-cd92095429c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:17.159467 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83448c11-41fd-46c0-a0c4-cd92095429c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:17.159829 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83448c11-41fd-46c0-a0c4-cd92095429c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:17.160180 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83448c11-41fd-46c0-a0c4-cd92095429c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:17.161062 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83448c11-41fd-46c0-a0c4-cd92095429c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:17.162787 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83448c11-41fd-46c0-a0c4-cd92095429c3 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:17.185081 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1395/2806] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:31:17.186318 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b97f1-1f4e-4fe6-ba4b-df9103bfc867 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:17.197990 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b97f1-1f4e-4fe6-ba4b-df9103bfc867 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:17.203251 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebdd1b0-8c4c-46f8-a6f1-1b19c2041448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:17.204138 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdd1b0-8c4c-46f8-a6f1-1b19c2041448 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:17.204420 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdd1b0-8c4c-46f8-a6f1-1b19c2041448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:17.204819 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdd1b0-8c4c-46f8-a6f1-1b19c2041448 admin admin] PATH_INFO: `/v3/projects/a6ccf261fc9e4774a6b129712a9e2f9e/users/0df9c9e882994796a13d1f202ee7b25b/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:17.222112 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebdd1b0-8c4c-46f8-a6f1-1b19c2041448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ccf261fc9e4774a6b129712a9e2f9e, user_id=0df9c9e882994796a13d1f202ee7b25b, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:17.224953 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebdd1b0-8c4c-46f8-a6f1-1b19c2041448 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:17.245205 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1412/2807] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:31:17 2022] PUT /identity/v3/projects/a6ccf261fc9e4774a6b129712a9e2f9e/users/0df9c9e882994796a13d1f202ee7b25b/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:31:17.251046 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea62fc-8b58-40d8-8acf-e72cf796dd22 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:17.252031 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea62fc-8b58-40d8-8acf-e72cf796dd22 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:17.252487 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea62fc-8b58-40d8-8acf-e72cf796dd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:17.274123 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-64ea62fc-8b58-40d8-8acf-e72cf796dd22 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:17.275864 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-64ea62fc-8b58-40d8-8acf-e72cf796dd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:17.349103 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1396/2808] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:31:17.359652 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebdd1b0-8c4c-46f8-a6f1-1b19c2041448 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:17.361456 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0ebdd1b0-8c4c-46f8-a6f1-1b19c2041448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:17.423891 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebdd1b0-8c4c-46f8-a6f1-1b19c2041448 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:17.427750 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d7bf7-a45a-40f1-9e55-c1038427e9d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:17.428398 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d7bf7-a45a-40f1-9e55-c1038427e9d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:17.428682 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d7bf7-a45a-40f1-9e55-c1038427e9d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:17.428961 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d7bf7-a45a-40f1-9e55-c1038427e9d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:17.439709 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d7bf7-a45a-40f1-9e55-c1038427e9d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:17.441275 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d7bf7-a45a-40f1-9e55-c1038427e9d6 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:17.452524 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1413/2809] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:31:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:31:22.092068 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11acb2d-b868-424c-be19-9b33aebf4621 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:22.092619 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11acb2d-b868-424c-be19-9b33aebf4621 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:22.093001 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11acb2d-b868-424c-be19-9b33aebf4621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:22.139622 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-f11acb2d-b868-424c-be19-9b33aebf4621 None None] MFA Rules not processed for user `0df9c9e882994796a13d1f202ee7b25b`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:22.143210 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f11acb2d-b868-424c-be19-9b33aebf4621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:22.270347 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1397/2810] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:31:22.275123 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d7bf7-a45a-40f1-9e55-c1038427e9d6 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:22.287282 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d7bf7-a45a-40f1-9e55-c1038427e9d6 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:22.292749 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc48b5-f5c6-4aaa-af95-655ac1ea85d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:22.293527 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc48b5-f5c6-4aaa-af95-655ac1ea85d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:22.293935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc48b5-f5c6-4aaa-af95-655ac1ea85d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:22.294313 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc48b5-f5c6-4aaa-af95-655ac1ea85d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:22.295127 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc48b5-f5c6-4aaa-af95-655ac1ea85d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:22.297396 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc48b5-f5c6-4aaa-af95-655ac1ea85d2 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:22.331819 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1414/2811] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:31:22 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:31:22.336235 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11acb2d-b868-424c-be19-9b33aebf4621 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:22.349848 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11acb2d-b868-424c-be19-9b33aebf4621 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:22.360115 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:22.443551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc33ec-d147-46a0-9574-dc149025bcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:22.444153 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc33ec-d147-46a0-9574-dc149025bcfd admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:22.444447 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc33ec-d147-46a0-9574-dc149025bcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:22.444736 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc33ec-d147-46a0-9574-dc149025bcfd admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:22.445441 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc33ec-d147-46a0-9574-dc149025bcfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:22.448395 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc33ec-d147-46a0-9574-dc149025bcfd admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:22.474021 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1398/2812] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:31:22 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:31:22.478095 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc48b5-f5c6-4aaa-af95-655ac1ea85d2 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:22.492928 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc48b5-f5c6-4aaa-af95-655ac1ea85d2 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:22.499860 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01206f-196f-4d97-b632-af7a2195ca4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:22.501018 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01206f-196f-4d97-b632-af7a2195ca4b admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:22.501527 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01206f-196f-4d97-b632-af7a2195ca4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:22.502067 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01206f-196f-4d97-b632-af7a2195ca4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:22.503258 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01206f-196f-4d97-b632-af7a2195ca4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:22.507110 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01206f-196f-4d97-b632-af7a2195ca4b admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:22.520039 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1415/2813] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:31:22.524261 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc33ec-d147-46a0-9574-dc149025bcfd admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:22.536708 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc33ec-d147-46a0-9574-dc149025bcfd admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:22.545279 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362255a-ec27-45cd-a8c3-57a746dd5e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:22.547039 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362255a-ec27-45cd-a8c3-57a746dd5e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:22.547450 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362255a-ec27-45cd-a8c3-57a746dd5e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:22.547896 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362255a-ec27-45cd-a8c3-57a746dd5e01 admin admin] PATH_INFO: `/v3/projects/52150cfb2c0a4ade8bbe6dadbb8f5571/users/870ab7f1c0164491a6265c7eda811584/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:22.569197 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362255a-ec27-45cd-a8c3-57a746dd5e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52150cfb2c0a4ade8bbe6dadbb8f5571, user_id=870ab7f1c0164491a6265c7eda811584, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:22.574013 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362255a-ec27-45cd-a8c3-57a746dd5e01 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:22.594892 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1399/2814] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:31:22 2022] PUT /identity/v3/projects/52150cfb2c0a4ade8bbe6dadbb8f5571/users/870ab7f1c0164491a6265c7eda811584/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:22.599039 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01206f-196f-4d97-b632-af7a2195ca4b admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:22.613442 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01206f-196f-4d97-b632-af7a2195ca4b admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:22.720825 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:22.742929 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de76d6-ae11-49ef-8d59-c596dff2e1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:22.743850 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de76d6-ae11-49ef-8d59-c596dff2e1d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:22.744330 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de76d6-ae11-49ef-8d59-c596dff2e1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:22.744693 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de76d6-ae11-49ef-8d59-c596dff2e1d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:22.745539 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de76d6-ae11-49ef-8d59-c596dff2e1d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:22.747404 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de76d6-ae11-49ef-8d59-c596dff2e1d4 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:22.760406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1416/2815] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:31:22.764702 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362255a-ec27-45cd-a8c3-57a746dd5e01 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:22.781048 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362255a-ec27-45cd-a8c3-57a746dd5e01 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:22.787419 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9c525-2e6a-4289-9a4b-ad36cb78642f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:22.788404 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9c525-2e6a-4289-9a4b-ad36cb78642f admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:22.788688 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9c525-2e6a-4289-9a4b-ad36cb78642f admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:22.788967 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9c525-2e6a-4289-9a4b-ad36cb78642f admin admin] PATH_INFO: `/v3/projects/52150cfb2c0a4ade8bbe6dadbb8f5571/users/870ab7f1c0164491a6265c7eda811584/roles/431cef539cfb476aad50d2470e763b5f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:22.792038 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9c525-2e6a-4289-9a4b-ad36cb78642f admin admin] RBAC: Authorizing `identity:create_grant(project_id=52150cfb2c0a4ade8bbe6dadbb8f5571, user_id=870ab7f1c0164491a6265c7eda811584, role_id=431cef539cfb476aad50d2470e763b5f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:22.795235 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9c525-2e6a-4289-9a4b-ad36cb78642f admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:22.813206 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1400/2816] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:31:22 2022] PUT /identity/v3/projects/52150cfb2c0a4ade8bbe6dadbb8f5571/users/870ab7f1c0164491a6265c7eda811584/roles/431cef539cfb476aad50d2470e763b5f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:24.147067 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de76d6-ae11-49ef-8d59-c596dff2e1d4 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:24.149647 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-06de76d6-ae11-49ef-8d59-c596dff2e1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:24.178845 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de76d6-ae11-49ef-8d59-c596dff2e1d4 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:24.311737 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219801d-607b-4c15-8d81-a95c5a55eeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:24.313535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219801d-607b-4c15-8d81-a95c5a55eeef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:24.314666 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219801d-607b-4c15-8d81-a95c5a55eeef admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:24.315306 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219801d-607b-4c15-8d81-a95c5a55eeef admin admin] PATH_INFO: `/v3/users/ceb69d3800c64f308ef709148492bffa` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:24.317720 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219801d-607b-4c15-8d81-a95c5a55eeef admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceb69d3800c64f308ef709148492bffa)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:24.323133 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219801d-607b-4c15-8d81-a95c5a55eeef admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:24.444534 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4219801d-607b-4c15-8d81-a95c5a55eeef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceb69d3800c64f308ef709148492bffa'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:24.453666 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4219801d-607b-4c15-8d81-a95c5a55eeef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceb69d3800c64f308ef709148492bffa'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:24.456382 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4219801d-607b-4c15-8d81-a95c5a55eeef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceb69d3800c64f308ef709148492bffa'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:24.457058 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4219801d-607b-4c15-8d81-a95c5a55eeef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceb69d3800c64f308ef709148492bffa'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:24.480901 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4219801d-607b-4c15-8d81-a95c5a55eeef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceb69d3800c64f308ef709148492bffa'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:24.520184 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1417/2817] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:31:24 2022] DELETE /identity/v3/users/ceb69d3800c64f308ef709148492bffa => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:31:24.522257 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2c492-16a6-44c6-a079-589d359f75e0 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:24.523065 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2c492-16a6-44c6-a079-589d359f75e0 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:24.523230 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2c492-16a6-44c6-a079-589d359f75e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:24.569847 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-87f2c492-16a6-44c6-a079-589d359f75e0 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:24.574802 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-87f2c492-16a6-44c6-a079-589d359f75e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:24.734362 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1401/2818] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:31:24.746074 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219801d-607b-4c15-8d81-a95c5a55eeef admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:24.747690 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4219801d-607b-4c15-8d81-a95c5a55eeef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:24.927249 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219801d-607b-4c15-8d81-a95c5a55eeef admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:24.934968 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c8edf-6556-4ba2-a500-af8f0236baea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:24.938043 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c8edf-6556-4ba2-a500-af8f0236baea service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:24.938552 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c8edf-6556-4ba2-a500-af8f0236baea service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:24.939243 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c8edf-6556-4ba2-a500-af8f0236baea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:24.957273 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c8edf-6556-4ba2-a500-af8f0236baea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:24.960165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c8edf-6556-4ba2-a500-af8f0236baea service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:25.007233 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1418/2819] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:31:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:31:25.542366 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2c492-16a6-44c6-a079-589d359f75e0 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:25.543853 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-87f2c492-16a6-44c6-a079-589d359f75e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:25.565941 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2c492-16a6-44c6-a079-589d359f75e0 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:25.575931 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fc25f-cdf1-4f9c-a83a-83497e266ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:25.577360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fc25f-cdf1-4f9c-a83a-83497e266ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:25.577767 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fc25f-cdf1-4f9c-a83a-83497e266ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:25.578175 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fc25f-cdf1-4f9c-a83a-83497e266ea5 admin admin] PATH_INFO: `/v3/projects/b4f2a75151fa4d2db1fd523bef52cbca` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:25.580022 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0fc25f-cdf1-4f9c-a83a-83497e266ea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4f2a75151fa4d2db1fd523bef52cbca)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:25.582896 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0fc25f-cdf1-4f9c-a83a-83497e266ea5 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:25.646204 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-da0fc25f-cdf1-4f9c-a83a-83497e266ea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4f2a75151fa4d2db1fd523bef52cbca', 'request_id': 'req-da0fc25f-cdf1-4f9c-a83a-83497e266ea5'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:25.659815 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-da0fc25f-cdf1-4f9c-a83a-83497e266ea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4f2a75151fa4d2db1fd523bef52cbca', 'request_id': 'req-da0fc25f-cdf1-4f9c-a83a-83497e266ea5'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:25.666786 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:25.675626 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-da0fc25f-cdf1-4f9c-a83a-83497e266ea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4f2a75151fa4d2db1fd523bef52cbca', 'request_id': 'req-da0fc25f-cdf1-4f9c-a83a-83497e266ea5'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:25.693446 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-da0fc25f-cdf1-4f9c-a83a-83497e266ea5 admin admin] The token cache is being invalidate because project b4f2a75151fa4d2db1fd523bef52cbca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:31:25.694207 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-da0fc25f-cdf1-4f9c-a83a-83497e266ea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:25.695228 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-da0fc25f-cdf1-4f9c-a83a-83497e266ea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:25.697797 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1402/2820] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:31:25 2022] DELETE /identity/v3/projects/b4f2a75151fa4d2db1fd523bef52cbca => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:25.702377 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c8edf-6556-4ba2-a500-af8f0236baea service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:25.716645 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c8edf-6556-4ba2-a500-af8f0236baea service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:25.734065 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:25.804038 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2739d1-0437-43bc-8114-00c51a241552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:25.804942 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2739d1-0437-43bc-8114-00c51a241552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:25.805235 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2739d1-0437-43bc-8114-00c51a241552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:25.805507 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2739d1-0437-43bc-8114-00c51a241552 admin admin] PATH_INFO: `/v3/users/8ce36121e093458db7ee448c2cfb80d2` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:25.806900 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2739d1-0437-43bc-8114-00c51a241552 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ce36121e093458db7ee448c2cfb80d2)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:25.809057 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2739d1-0437-43bc-8114-00c51a241552 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:25.894503 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0f2739d1-0437-43bc-8114-00c51a241552 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ce36121e093458db7ee448c2cfb80d2'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:25.913274 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0f2739d1-0437-43bc-8114-00c51a241552 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ce36121e093458db7ee448c2cfb80d2'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:25.914745 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0f2739d1-0437-43bc-8114-00c51a241552 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ce36121e093458db7ee448c2cfb80d2'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:25.917632 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0f2739d1-0437-43bc-8114-00c51a241552 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ce36121e093458db7ee448c2cfb80d2'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:25.957422 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0f2739d1-0437-43bc-8114-00c51a241552 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ce36121e093458db7ee448c2cfb80d2'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:26.010120 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1419/2821] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:31:25 2022] DELETE /identity/v3/users/8ce36121e093458db7ee448c2cfb80d2 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:26.759121 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fc25f-cdf1-4f9c-a83a-83497e266ea5 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:26.763740 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-da0fc25f-cdf1-4f9c-a83a-83497e266ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:26.790417 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fc25f-cdf1-4f9c-a83a-83497e266ea5 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:26.876274 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412149b7-31ac-4021-a14e-e353dc882c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:26.877373 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412149b7-31ac-4021-a14e-e353dc882c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:26.877884 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412149b7-31ac-4021-a14e-e353dc882c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:26.878261 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412149b7-31ac-4021-a14e-e353dc882c62 admin admin] PATH_INFO: `/v3/projects/33341dc6cd0b492189ae9d4d2c566419` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:26.879718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412149b7-31ac-4021-a14e-e353dc882c62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33341dc6cd0b492189ae9d4d2c566419)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:26.881944 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412149b7-31ac-4021-a14e-e353dc882c62 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:27.006560 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-412149b7-31ac-4021-a14e-e353dc882c62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33341dc6cd0b492189ae9d4d2c566419', 'request_id': 'req-412149b7-31ac-4021-a14e-e353dc882c62'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:27.024215 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-412149b7-31ac-4021-a14e-e353dc882c62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33341dc6cd0b492189ae9d4d2c566419', 'request_id': 'req-412149b7-31ac-4021-a14e-e353dc882c62'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:27.047527 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-412149b7-31ac-4021-a14e-e353dc882c62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33341dc6cd0b492189ae9d4d2c566419', 'request_id': 'req-412149b7-31ac-4021-a14e-e353dc882c62'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:27.085134 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-412149b7-31ac-4021-a14e-e353dc882c62 admin admin] The token cache is being invalidate because project 33341dc6cd0b492189ae9d4d2c566419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:31:27.090620 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-412149b7-31ac-4021-a14e-e353dc882c62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:27.093504 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-412149b7-31ac-4021-a14e-e353dc882c62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:27.097456 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1403/2822] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:31:26 2022] DELETE /identity/v3/projects/33341dc6cd0b492189ae9d4d2c566419 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:27.103751 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a025d-413c-464b-a52f-2f077a1108d3 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:27.104703 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a025d-413c-464b-a52f-2f077a1108d3 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:27.105157 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a025d-413c-464b-a52f-2f077a1108d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:27.155778 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-9c9a025d-413c-464b-a52f-2f077a1108d3 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:27.157234 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9c9a025d-413c-464b-a52f-2f077a1108d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:27.285364 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1420/2823] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:27.301777 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfad43-e707-485b-b5d3-1643f4523f0b None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:27.303010 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfad43-e707-485b-b5d3-1643f4523f0b None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:27.303010 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfad43-e707-485b-b5d3-1643f4523f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:27.308328 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a025d-413c-464b-a52f-2f077a1108d3 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:27.311331 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9c9a025d-413c-464b-a52f-2f077a1108d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:27.334190 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a025d-413c-464b-a52f-2f077a1108d3 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:27.350371 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5cceb-3f68-46bd-803d-89e89d3e3f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:27.351015 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5cceb-3f68-46bd-803d-89e89d3e3f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:27.351336 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5cceb-3f68-46bd-803d-89e89d3e3f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:27.351660 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5cceb-3f68-46bd-803d-89e89d3e3f06 admin admin] PATH_INFO: `/v3/users/7ef7e1fae883462b8ea4acc42fef9ed3` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:27.353995 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5cceb-3f68-46bd-803d-89e89d3e3f06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ef7e1fae883462b8ea4acc42fef9ed3)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:27.354153 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-0fdfad43-e707-485b-b5d3-1643f4523f0b None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:27.355390 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0fdfad43-e707-485b-b5d3-1643f4523f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:27.356150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5cceb-3f68-46bd-803d-89e89d3e3f06 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:27.368282 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1404/2824] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:27.375405 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfad43-e707-485b-b5d3-1643f4523f0b None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:27.396758 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfad43-e707-485b-b5d3-1643f4523f0b None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:27.411189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28f670-e139-4a0d-94cf-1bd482a14f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:27.414095 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28f670-e139-4a0d-94cf-1bd482a14f50 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:27.414619 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28f670-e139-4a0d-94cf-1bd482a14f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:27.415099 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28f670-e139-4a0d-94cf-1bd482a14f50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:27.416903 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28f670-e139-4a0d-94cf-1bd482a14f50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:31:27.417387 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28f670-e139-4a0d-94cf-1bd482a14f50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:27.419825 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28f670-e139-4a0d-94cf-1bd482a14f50 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:27.436270 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:27.437771 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1405/2825] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:31:27.443647 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28f670-e139-4a0d-94cf-1bd482a14f50 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:27.461475 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28f670-e139-4a0d-94cf-1bd482a14f50 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:27.472370 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cf34b-e7b8-481e-9157-8ffd5c0fdd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:27.473204 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cf34b-e7b8-481e-9157-8ffd5c0fdd91 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:27.473973 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cf34b-e7b8-481e-9157-8ffd5c0fdd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:27.474263 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cf34b-e7b8-481e-9157-8ffd5c0fdd91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:27.475097 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0cf34b-e7b8-481e-9157-8ffd5c0fdd91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:27.477795 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0cf34b-e7b8-481e-9157-8ffd5c0fdd91 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:27.481975 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f1a5cceb-3f68-46bd-803d-89e89d3e3f06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ef7e1fae883462b8ea4acc42fef9ed3'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:27.491886 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f1a5cceb-3f68-46bd-803d-89e89d3e3f06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ef7e1fae883462b8ea4acc42fef9ed3'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:27.492887 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f1a5cceb-3f68-46bd-803d-89e89d3e3f06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ef7e1fae883462b8ea4acc42fef9ed3'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:27.494734 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f1a5cceb-3f68-46bd-803d-89e89d3e3f06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ef7e1fae883462b8ea4acc42fef9ed3'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:27.522424 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1406/2826] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:31:27 2022] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:31:27.527490 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cf34b-e7b8-481e-9157-8ffd5c0fdd91 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:27.535471 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f1a5cceb-3f68-46bd-803d-89e89d3e3f06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ef7e1fae883462b8ea4acc42fef9ed3'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:27.541203 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0e0cf34b-e7b8-481e-9157-8ffd5c0fdd91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:27.572172 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1421/2827] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:31:27 2022] DELETE /identity/v3/users/7ef7e1fae883462b8ea4acc42fef9ed3 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:27.579764 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2cbceb-0cf4-41dc-ac8b-de0950c2f391 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:27.580145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2cbceb-0cf4-41dc-ac8b-de0950c2f391 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:27.580486 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2cbceb-0cf4-41dc-ac8b-de0950c2f391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:27.629211 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:27.630982 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6e2cbceb-0cf4-41dc-ac8b-de0950c2f391 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:27.636733 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6e2cbceb-0cf4-41dc-ac8b-de0950c2f391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:27.700868 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cf34b-e7b8-481e-9157-8ffd5c0fdd91 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:27.772641 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1422/2828] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:27.784029 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2cbceb-0cf4-41dc-ac8b-de0950c2f391 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:27.785979 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6e2cbceb-0cf4-41dc-ac8b-de0950c2f391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:27.854457 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bcdc2-6e64-4d81-b593-04032d72def0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:27.855616 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bcdc2-6e64-4d81-b593-04032d72def0 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:27.855878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bcdc2-6e64-4d81-b593-04032d72def0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:27.856310 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bcdc2-6e64-4d81-b593-04032d72def0 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:27.857118 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bcdc2-6e64-4d81-b593-04032d72def0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:27.860485 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bcdc2-6e64-4d81-b593-04032d72def0 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:27.901346 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1407/2829] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:31:27 2022] POST /identity/v3/users => generated 293 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 08:31:27.908674 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2cbceb-0cf4-41dc-ac8b-de0950c2f391 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:27.910964 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bcdc2-6e64-4d81-b593-04032d72def0 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:27.922954 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d50e9d-e622-4991-850a-538f6e189ff4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:27.924086 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d50e9d-e622-4991-850a-538f6e189ff4 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:27.924592 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d50e9d-e622-4991-850a-538f6e189ff4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:27.925111 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d50e9d-e622-4991-850a-538f6e189ff4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:27.928434 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bcdc2-6e64-4d81-b593-04032d72def0 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:27.939440 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31421b6-d499-4664-913f-5b55df334e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:27.940240 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31421b6-d499-4664-913f-5b55df334e32 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:27.940527 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31421b6-d499-4664-913f-5b55df334e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:27.940804 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31421b6-d499-4664-913f-5b55df334e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:27.941497 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d50e9d-e622-4991-850a-538f6e189ff4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:27.941619 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31421b6-d499-4664-913f-5b55df334e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:27.943201 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31421b6-d499-4664-913f-5b55df334e32 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:27.943897 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d50e9d-e622-4991-850a-538f6e189ff4 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:27.961869 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1408/2830] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:31:27.965448 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31421b6-d499-4664-913f-5b55df334e32 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:27.978854 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1423/2831] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:31:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:31:28.006397 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31421b6-d499-4664-913f-5b55df334e32 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:28.012355 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17007d-4a57-441c-a178-fa86c64a5ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:28.013484 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17007d-4a57-441c-a178-fa86c64a5ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:28.014171 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17007d-4a57-441c-a178-fa86c64a5ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:28.014728 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17007d-4a57-441c-a178-fa86c64a5ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:28.016626 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17007d-4a57-441c-a178-fa86c64a5ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:28.018713 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17007d-4a57-441c-a178-fa86c64a5ea4 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:28.036139 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1409/2832] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:31:28.041123 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d50e9d-e622-4991-850a-538f6e189ff4 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:28.055944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d50e9d-e622-4991-850a-538f6e189ff4 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:28.066740 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bf90e-29ba-4d7e-96e2-b1b78ff4f5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:28.068689 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bf90e-29ba-4d7e-96e2-b1b78ff4f5f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:28.070597 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bf90e-29ba-4d7e-96e2-b1b78ff4f5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:28.091107 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bf90e-29ba-4d7e-96e2-b1b78ff4f5f1 admin admin] PATH_INFO: `/v3/projects/2f1692329dd9480db3efcec3ae60fa3c/users/460aa8a40e5548a691b339142507d6ed/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:28.139619 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5bf90e-29ba-4d7e-96e2-b1b78ff4f5f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f1692329dd9480db3efcec3ae60fa3c, user_id=460aa8a40e5548a691b339142507d6ed, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:28.142444 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5bf90e-29ba-4d7e-96e2-b1b78ff4f5f1 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:28.169354 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1424/2833] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:31:28 2022] PUT /identity/v3/projects/2f1692329dd9480db3efcec3ae60fa3c/users/460aa8a40e5548a691b339142507d6ed/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:28.250595 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4972b6-f53f-4d89-bc18-baccbdb67e47 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:28.251150 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4972b6-f53f-4d89-bc18-baccbdb67e47 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:28.251742 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4972b6-f53f-4d89-bc18-baccbdb67e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:28.322796 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-3d4972b6-f53f-4d89-bc18-baccbdb67e47 None None] MFA Rules not processed for user `460aa8a40e5548a691b339142507d6ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:28.324264 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-3d4972b6-f53f-4d89-bc18-baccbdb67e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:28.468315 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1410/2834] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:31:28.492512 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bf90e-29ba-4d7e-96e2-b1b78ff4f5f1 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:28.496784 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4972b6-f53f-4d89-bc18-baccbdb67e47 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:28.498696 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ee5bf90e-29ba-4d7e-96e2-b1b78ff4f5f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:28.501551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-3d4972b6-f53f-4d89-bc18-baccbdb67e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:28.579369 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:28.611547 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:28.654626 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4972b6-f53f-4d89-bc18-baccbdb67e47 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:28.662645 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bf90e-29ba-4d7e-96e2-b1b78ff4f5f1 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:28.663600 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5fc453-eb97-473c-ad6f-eced58ded3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:28.664615 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fc453-eb97-473c-ad6f-eced58ded3bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:28.665199 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fc453-eb97-473c-ad6f-eced58ded3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:28.665677 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fc453-eb97-473c-ad6f-eced58ded3bf admin admin] PATH_INFO: `/v3/projects/656757a74a704dcaa556c18d131c7571` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:28.666830 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5865cc-701a-41d8-91ba-216bba5cfb85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:28.667288 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5fc453-eb97-473c-ad6f-eced58ded3bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=656757a74a704dcaa556c18d131c7571)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:28.667472 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5865cc-701a-41d8-91ba-216bba5cfb85 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:28.667757 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5865cc-701a-41d8-91ba-216bba5cfb85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:28.668025 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5865cc-701a-41d8-91ba-216bba5cfb85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:28.672393 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5fc453-eb97-473c-ad6f-eced58ded3bf admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:28.687659 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5865cc-701a-41d8-91ba-216bba5cfb85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:28.690112 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5865cc-701a-41d8-91ba-216bba5cfb85 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:28.722195 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1425/2835] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:31:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:31:28.747573 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0f5fc453-eb97-473c-ad6f-eced58ded3bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '656757a74a704dcaa556c18d131c7571', 'request_id': 'req-0f5fc453-eb97-473c-ad6f-eced58ded3bf'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:28.758605 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0f5fc453-eb97-473c-ad6f-eced58ded3bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '656757a74a704dcaa556c18d131c7571', 'request_id': 'req-0f5fc453-eb97-473c-ad6f-eced58ded3bf'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:28.777541 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0f5fc453-eb97-473c-ad6f-eced58ded3bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '656757a74a704dcaa556c18d131c7571', 'request_id': 'req-0f5fc453-eb97-473c-ad6f-eced58ded3bf'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:28.795558 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0f5fc453-eb97-473c-ad6f-eced58ded3bf admin admin] The token cache is being invalidate because project 656757a74a704dcaa556c18d131c7571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:31:28.796346 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0f5fc453-eb97-473c-ad6f-eced58ded3bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:28.797654 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0f5fc453-eb97-473c-ad6f-eced58ded3bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:28.800029 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1411/2836] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:31:28 2022] DELETE /identity/v3/projects/656757a74a704dcaa556c18d131c7571 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:28.804766 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052586e-22f6-4984-b761-6e21ae7c52f6 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:28.805075 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052586e-22f6-4984-b761-6e21ae7c52f6 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:28.805294 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052586e-22f6-4984-b761-6e21ae7c52f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:28.838048 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-c052586e-22f6-4984-b761-6e21ae7c52f6 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:28.839562 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c052586e-22f6-4984-b761-6e21ae7c52f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:28.957880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1426/2837] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:28.962930 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d2971-b120-43a1-b28f-2882d8fc5680 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:28.964116 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d2971-b120-43a1-b28f-2882d8fc5680 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:28.964400 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d2971-b120-43a1-b28f-2882d8fc5680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:28.995772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-159d2971-b120-43a1-b28f-2882d8fc5680 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:28.998429 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-159d2971-b120-43a1-b28f-2882d8fc5680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:29.008982 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1412/2838] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:29.015747 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052586e-22f6-4984-b761-6e21ae7c52f6 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:29.044395 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052586e-22f6-4984-b761-6e21ae7c52f6 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:29.048421 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f31d4-6023-4836-ad67-8095a5c67d92 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:29.049226 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f31d4-6023-4836-ad67-8095a5c67d92 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:29.049644 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f31d4-6023-4836-ad67-8095a5c67d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:29.071281 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf9add-2d66-4eab-8d79-b215ffcf8b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:29.073620 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf9add-2d66-4eab-8d79-b215ffcf8b1b admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:29.074040 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf9add-2d66-4eab-8d79-b215ffcf8b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:29.074438 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf9add-2d66-4eab-8d79-b215ffcf8b1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:29.075395 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf9add-2d66-4eab-8d79-b215ffcf8b1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:31:29.075939 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf9add-2d66-4eab-8d79-b215ffcf8b1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:29.086770 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf9add-2d66-4eab-8d79-b215ffcf8b1b admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:29.128945 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1427/2839] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:31:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:31:29.130305 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf9add-2d66-4eab-8d79-b215ffcf8b1b admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:29.145425 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf9add-2d66-4eab-8d79-b215ffcf8b1b admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:29.153759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd59d3-1277-4086-a4c0-59f02cea5bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:29.154818 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd59d3-1277-4086-a4c0-59f02cea5bdb admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:29.155293 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd59d3-1277-4086-a4c0-59f02cea5bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:29.155934 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd59d3-1277-4086-a4c0-59f02cea5bdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:29.156885 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd59d3-1277-4086-a4c0-59f02cea5bdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:29.160052 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd59d3-1277-4086-a4c0-59f02cea5bdb admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:29.199989 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1428/2840] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:31:29 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:31:29.206614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd59d3-1277-4086-a4c0-59f02cea5bdb admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:29.300660 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd59d3-1277-4086-a4c0-59f02cea5bdb admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:29.308664 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd3546-810a-447e-bc22-916959ddd943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:29.310064 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd3546-810a-447e-bc22-916959ddd943 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:29.310888 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd3546-810a-447e-bc22-916959ddd943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:29.311400 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd3546-810a-447e-bc22-916959ddd943 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:29.312880 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd3546-810a-447e-bc22-916959ddd943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:29.315850 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd3546-810a-447e-bc22-916959ddd943 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:29.331613 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-544f31d4-6023-4836-ad67-8095a5c67d92 None None] MFA Rules not processed for user `870ab7f1c0164491a6265c7eda811584`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:29.333391 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-544f31d4-6023-4836-ad67-8095a5c67d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:29.356529 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1429/2841] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:31:29 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:31:29.360581 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd3546-810a-447e-bc22-916959ddd943 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:29.375826 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd3546-810a-447e-bc22-916959ddd943 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:29.393085 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64936210-bafd-4e32-95a0-fb3032b26c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:29.394140 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64936210-bafd-4e32-95a0-fb3032b26c02 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:29.394307 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64936210-bafd-4e32-95a0-fb3032b26c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:29.394588 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64936210-bafd-4e32-95a0-fb3032b26c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:29.395403 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64936210-bafd-4e32-95a0-fb3032b26c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:29.398392 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64936210-bafd-4e32-95a0-fb3032b26c02 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:29.415079 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1430/2842] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:31:29.417568 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64936210-bafd-4e32-95a0-fb3032b26c02 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:29.434851 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64936210-bafd-4e32-95a0-fb3032b26c02 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:29.442955 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1c73b-9860-401c-be0b-28cf01d8bac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:29.443774 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1c73b-9860-401c-be0b-28cf01d8bac5 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:29.444057 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1c73b-9860-401c-be0b-28cf01d8bac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:29.445259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1c73b-9860-401c-be0b-28cf01d8bac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:29.445259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1c73b-9860-401c-be0b-28cf01d8bac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:29.447781 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1c73b-9860-401c-be0b-28cf01d8bac5 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:29.454344 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:29.463222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1431/2843] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:31:29.467095 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1c73b-9860-401c-be0b-28cf01d8bac5 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:29.470358 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1413/2844] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:31:29.480065 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1c73b-9860-401c-be0b-28cf01d8bac5 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:29.486980 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f31d4-6023-4836-ad67-8095a5c67d92 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:29.487845 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dca8d5-75b3-4c6f-b12e-01f0661e02e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:29.490268 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dca8d5-75b3-4c6f-b12e-01f0661e02e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:29.490443 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-544f31d4-6023-4836-ad67-8095a5c67d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:29.490850 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dca8d5-75b3-4c6f-b12e-01f0661e02e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:29.491521 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dca8d5-75b3-4c6f-b12e-01f0661e02e1 admin admin] PATH_INFO: `/v3/projects/dd222ba8d8b8447594ee715381dcd847/users/0d6db2b2eb4845ed8cf6c81f8b1e913f/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:29.514453 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dca8d5-75b3-4c6f-b12e-01f0661e02e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd222ba8d8b8447594ee715381dcd847, user_id=0d6db2b2eb4845ed8cf6c81f8b1e913f, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:29.519399 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dca8d5-75b3-4c6f-b12e-01f0661e02e1 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:29.539136 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1432/2845] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:31:29 2022] PUT /identity/v3/projects/dd222ba8d8b8447594ee715381dcd847/users/0d6db2b2eb4845ed8cf6c81f8b1e913f/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:29.547724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d562c-8e65-41c6-b5c9-138663f0e4f2 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:29.547724 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d562c-8e65-41c6-b5c9-138663f0e4f2 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:29.548099 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d562c-8e65-41c6-b5c9-138663f0e4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:29.568685 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-398d562c-8e65-41c6-b5c9-138663f0e4f2 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:29.570120 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-398d562c-8e65-41c6-b5c9-138663f0e4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:29.571095 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:29.623771 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f31d4-6023-4836-ad67-8095a5c67d92 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:29.678375 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1433/2846] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:29.689496 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d562c-8e65-41c6-b5c9-138663f0e4f2 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:29.692016 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-398d562c-8e65-41c6-b5c9-138663f0e4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:29.748854 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70261536-df79-45e7-a5be-3b65e545a4f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:29.750849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70261536-df79-45e7-a5be-3b65e545a4f3 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:29.750849 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70261536-df79-45e7-a5be-3b65e545a4f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:29.751120 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70261536-df79-45e7-a5be-3b65e545a4f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:29.758166 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-70261536-df79-45e7-a5be-3b65e545a4f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:29.786289 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d562c-8e65-41c6-b5c9-138663f0e4f2 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:29.794156 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badca571-07d4-4c16-9145-36ad93cf97e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:29.795381 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badca571-07d4-4c16-9145-36ad93cf97e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:29.796224 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badca571-07d4-4c16-9145-36ad93cf97e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:29.796796 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badca571-07d4-4c16-9145-36ad93cf97e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:29.817535 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badca571-07d4-4c16-9145-36ad93cf97e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:29.821414 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badca571-07d4-4c16-9145-36ad93cf97e3 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:29.846521 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1434/2847] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:31:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:31:29.869654 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70261536-df79-45e7-a5be-3b65e545a4f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:29.872046 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70261536-df79-45e7-a5be-3b65e545a4f3 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:29.885067 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1414/2848] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:31:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:31:31.029084 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2476d0-4096-451c-b8ac-eda3a14ef4cc None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:31.030414 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2476d0-4096-451c-b8ac-eda3a14ef4cc None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:31.031128 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2476d0-4096-451c-b8ac-eda3a14ef4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:31.081700 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-4b2476d0-4096-451c-b8ac-eda3a14ef4cc None None] MFA Rules not processed for user `0d6db2b2eb4845ed8cf6c81f8b1e913f`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:31.084099 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4b2476d0-4096-451c-b8ac-eda3a14ef4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:31.210296 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1435/2849] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:31.223738 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70261536-df79-45e7-a5be-3b65e545a4f3 service nova] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:31.226865 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-70261536-df79-45e7-a5be-3b65e545a4f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:31.374135 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70261536-df79-45e7-a5be-3b65e545a4f3 service nova] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:31.379948 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954601c-7828-4dcc-b763-fc98144647d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:31.380770 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954601c-7828-4dcc-b763-fc98144647d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:31.381326 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954601c-7828-4dcc-b763-fc98144647d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:31.381463 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954601c-7828-4dcc-b763-fc98144647d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:31.392229 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954601c-7828-4dcc-b763-fc98144647d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:31.393697 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954601c-7828-4dcc-b763-fc98144647d9 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:31.406304 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1415/2850] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:31:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 08:31:31.534913 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa10e0-58ec-4bfc-9edb-c1308054c384 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:31.535305 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa10e0-58ec-4bfc-9edb-c1308054c384 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:31.535579 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa10e0-58ec-4bfc-9edb-c1308054c384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:31.555452 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-40aa10e0-58ec-4bfc-9edb-c1308054c384 None None] MFA Rules not processed for user `0df9c9e882994796a13d1f202ee7b25b`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:31.557430 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-40aa10e0-58ec-4bfc-9edb-c1308054c384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:31.569274 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1436/2851] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:31.863161 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954601c-7828-4dcc-b763-fc98144647d9 service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:31.864976 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2954601c-7828-4dcc-b763-fc98144647d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:31.884051 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954601c-7828-4dcc-b763-fc98144647d9 service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:31.890454 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ea629-288a-4838-aee6-d1215ba24f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:31.891392 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ea629-288a-4838-aee6-d1215ba24f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:31.892507 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ea629-288a-4838-aee6-d1215ba24f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:31.892966 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ea629-288a-4838-aee6-d1215ba24f19 admin admin] PATH_INFO: `/v3/users/460aa8a40e5548a691b339142507d6ed` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:31.894729 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ea629-288a-4838-aee6-d1215ba24f19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=460aa8a40e5548a691b339142507d6ed)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:31.896949 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ea629-288a-4838-aee6-d1215ba24f19 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:31.932713 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:31.966018 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-b68ea629-288a-4838-aee6-d1215ba24f19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '460aa8a40e5548a691b339142507d6ed'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:31.975969 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-b68ea629-288a-4838-aee6-d1215ba24f19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '460aa8a40e5548a691b339142507d6ed'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:31.978293 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-b68ea629-288a-4838-aee6-d1215ba24f19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '460aa8a40e5548a691b339142507d6ed'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:31.996944 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-b68ea629-288a-4838-aee6-d1215ba24f19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '460aa8a40e5548a691b339142507d6ed'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:31.998353 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-b68ea629-288a-4838-aee6-d1215ba24f19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '460aa8a40e5548a691b339142507d6ed'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:32.021917 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1416/2852] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:31:31 2022] DELETE /identity/v3/users/460aa8a40e5548a691b339142507d6ed => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:32.024623 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cafe9-e6f0-4aa1-97db-455e78808f50 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:32.024992 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cafe9-e6f0-4aa1-97db-455e78808f50 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:32.025345 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cafe9-e6f0-4aa1-97db-455e78808f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:32.031527 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:32.048270 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-a19cafe9-e6f0-4aa1-97db-455e78808f50 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:32.049646 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a19cafe9-e6f0-4aa1-97db-455e78808f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:32.143117 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1437/2853] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:32.156099 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ea629-288a-4838-aee6-d1215ba24f19 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:32.157643 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-b68ea629-288a-4838-aee6-d1215ba24f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:32.238902 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ea629-288a-4838-aee6-d1215ba24f19 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:32.241437 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa036bfa-2072-43ad-a3bf-ea32e300f236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:32.242131 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa036bfa-2072-43ad-a3bf-ea32e300f236 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:32.242419 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa036bfa-2072-43ad-a3bf-ea32e300f236 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:32.242696 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa036bfa-2072-43ad-a3bf-ea32e300f236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:32.257217 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa036bfa-2072-43ad-a3bf-ea32e300f236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:32.260689 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa036bfa-2072-43ad-a3bf-ea32e300f236 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:32.271672 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1417/2854] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:31:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:31:32.599867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19cafe9-e6f0-4aa1-97db-455e78808f50 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:32.601959 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a19cafe9-e6f0-4aa1-97db-455e78808f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:32.616742 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19cafe9-e6f0-4aa1-97db-455e78808f50 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:32.622712 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1f442-94e4-41c9-a881-6a1ce4a2900a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:32.623854 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1f442-94e4-41c9-a881-6a1ce4a2900a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:32.624135 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1f442-94e4-41c9-a881-6a1ce4a2900a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:32.624410 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1f442-94e4-41c9-a881-6a1ce4a2900a admin admin] PATH_INFO: `/v3/projects/2f1692329dd9480db3efcec3ae60fa3c` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:32.625971 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1f442-94e4-41c9-a881-6a1ce4a2900a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f1692329dd9480db3efcec3ae60fa3c)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:32.628051 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1f442-94e4-41c9-a881-6a1ce4a2900a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:32.689645 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b4c1f442-94e4-41c9-a881-6a1ce4a2900a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f1692329dd9480db3efcec3ae60fa3c', 'request_id': 'req-b4c1f442-94e4-41c9-a881-6a1ce4a2900a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:32.698308 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b4c1f442-94e4-41c9-a881-6a1ce4a2900a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f1692329dd9480db3efcec3ae60fa3c', 'request_id': 'req-b4c1f442-94e4-41c9-a881-6a1ce4a2900a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:32.706868 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b4c1f442-94e4-41c9-a881-6a1ce4a2900a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f1692329dd9480db3efcec3ae60fa3c', 'request_id': 'req-b4c1f442-94e4-41c9-a881-6a1ce4a2900a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:32.719858 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b4c1f442-94e4-41c9-a881-6a1ce4a2900a admin admin] The token cache is being invalidate because project 2f1692329dd9480db3efcec3ae60fa3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:31:32.720244 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b4c1f442-94e4-41c9-a881-6a1ce4a2900a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:32.721167 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b4c1f442-94e4-41c9-a881-6a1ce4a2900a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:32.722809 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1438/2855] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:31:32 2022] DELETE /identity/v3/projects/2f1692329dd9480db3efcec3ae60fa3c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:32.728254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15983b7f-2489-4efd-848d-2a38c95d4112 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:32.728555 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15983b7f-2489-4efd-848d-2a38c95d4112 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:32.728835 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15983b7f-2489-4efd-848d-2a38c95d4112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:32.748269 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-15983b7f-2489-4efd-848d-2a38c95d4112 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:32.749493 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-15983b7f-2489-4efd-848d-2a38c95d4112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:32.817708 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1418/2856] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:32.827146 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d3b4f-a7b4-4ed8-ae5e-704b770ed07e None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:32.827146 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d3b4f-a7b4-4ed8-ae5e-704b770ed07e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:32.827146 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d3b4f-a7b4-4ed8-ae5e-704b770ed07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:32.847614 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e77d3b4f-a7b4-4ed8-ae5e-704b770ed07e None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:32.848843 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e77d3b4f-a7b4-4ed8-ae5e-704b770ed07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:32.857598 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1439/2857] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:32.862244 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15983b7f-2489-4efd-848d-2a38c95d4112 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:32.875478 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20223a-2903-4c81-9f00-44bc685108f2 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:32.875875 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20223a-2903-4c81-9f00-44bc685108f2 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:32.876182 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15983b7f-2489-4efd-848d-2a38c95d4112 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:32.876303 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20223a-2903-4c81-9f00-44bc685108f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:32.883375 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be140299-7068-449a-99df-11f77b273055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:32.884120 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be140299-7068-449a-99df-11f77b273055 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:32.884714 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be140299-7068-449a-99df-11f77b273055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:32.884991 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be140299-7068-449a-99df-11f77b273055 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:32.885750 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be140299-7068-449a-99df-11f77b273055 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 08:31:32.886097 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be140299-7068-449a-99df-11f77b273055 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:32.887766 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be140299-7068-449a-99df-11f77b273055 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:32.900206 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-0b20223a-2903-4c81-9f00-44bc685108f2 None None] MFA Rules not processed for user `0d6db2b2eb4845ed8cf6c81f8b1e913f`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:32.901593 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0b20223a-2903-4c81-9f00-44bc685108f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:32.903192 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1419/2858] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jun 4 08:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 08:31:32.908212 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be140299-7068-449a-99df-11f77b273055 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:32.932654 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be140299-7068-449a-99df-11f77b273055 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:32.939425 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e0594-d3c0-4714-9905-89d306c706da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:32.944012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e0594-d3c0-4714-9905-89d306c706da admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:32.944308 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e0594-d3c0-4714-9905-89d306c706da admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:32.944730 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e0594-d3c0-4714-9905-89d306c706da admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:32.945573 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e0594-d3c0-4714-9905-89d306c706da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:32.948992 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e0594-d3c0-4714-9905-89d306c706da admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:32.987424 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1420/2859] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jun 4 08:31:32 2022] POST /identity/v3/projects => generated 375 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:31:32.989176 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e0594-d3c0-4714-9905-89d306c706da admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:32.999764 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:33.026335 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1440/2860] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:33.105167 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e0594-d3c0-4714-9905-89d306c706da admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:33.118628 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b2ed4-1523-43b9-a539-f670c7f0050b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:33.119325 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b2ed4-1523-43b9-a539-f670c7f0050b admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:33.119600 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b2ed4-1523-43b9-a539-f670c7f0050b admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:33.119878 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b2ed4-1523-43b9-a539-f670c7f0050b admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:33.120581 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b2ed4-1523-43b9-a539-f670c7f0050b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:33.122618 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b2ed4-1523-43b9-a539-f670c7f0050b admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:33.158256 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1421/2861] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jun 4 08:31:32 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 08:31:33.159330 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20223a-2903-4c81-9f00-44bc685108f2 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:33.179022 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20223a-2903-4c81-9f00-44bc685108f2 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:33.185499 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96673a60-0b78-4b90-ba62-ef6d4f0eece8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:33.186346 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96673a60-0b78-4b90-ba62-ef6d4f0eece8 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:33.186863 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96673a60-0b78-4b90-ba62-ef6d4f0eece8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:33.187401 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96673a60-0b78-4b90-ba62-ef6d4f0eece8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:33.188393 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96673a60-0b78-4b90-ba62-ef6d4f0eece8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:33.190386 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96673a60-0b78-4b90-ba62-ef6d4f0eece8 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:33.215350 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1441/2862] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 08:31:33.216229 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b2ed4-1523-43b9-a539-f670c7f0050b admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:33.230160 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b2ed4-1523-43b9-a539-f670c7f0050b admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:33.249125 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10458e74-ed77-484b-ae5d-aed85dca6576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:33.250008 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10458e74-ed77-484b-ae5d-aed85dca6576 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:33.250254 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10458e74-ed77-484b-ae5d-aed85dca6576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:33.250539 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10458e74-ed77-484b-ae5d-aed85dca6576 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:33.251377 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10458e74-ed77-484b-ae5d-aed85dca6576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:33.258451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10458e74-ed77-484b-ae5d-aed85dca6576 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:33.288964 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1422/2863] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jun 4 08:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 08:31:33.295246 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96673a60-0b78-4b90-ba62-ef6d4f0eece8 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:33.314699 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96673a60-0b78-4b90-ba62-ef6d4f0eece8 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:33.320759 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0623910-a758-4188-8262-ee31e5d91693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:33.322505 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0623910-a758-4188-8262-ee31e5d91693 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:33.322811 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0623910-a758-4188-8262-ee31e5d91693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:33.323097 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0623910-a758-4188-8262-ee31e5d91693 admin admin] PATH_INFO: `/v3/projects/d184f89cae454990b26023745ea432fb/users/eb5493f30c694a32b5841791b34ff148/roles/314f0b44fb344a99bdda986e7b4ac3ab` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:33.340964 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:33.350098 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0623910-a758-4188-8262-ee31e5d91693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d184f89cae454990b26023745ea432fb, user_id=eb5493f30c694a32b5841791b34ff148, role_id=314f0b44fb344a99bdda986e7b4ac3ab)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:33.353056 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0623910-a758-4188-8262-ee31e5d91693 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:33.373567 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1442/2864] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jun 4 08:31:33 2022] PUT /identity/v3/projects/d184f89cae454990b26023745ea432fb/users/eb5493f30c694a32b5841791b34ff148/roles/314f0b44fb344a99bdda986e7b4ac3ab => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:33.386286 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbb3ed-9974-453a-993a-d89bc7f8c87b None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:33.386624 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbb3ed-9974-453a-993a-d89bc7f8c87b None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:33.386918 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbb3ed-9974-453a-993a-d89bc7f8c87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:33.418031 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-fdcbb3ed-9974-453a-993a-d89bc7f8c87b None None] MFA Rules not processed for user `eb5493f30c694a32b5841791b34ff148`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:33.419428 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-fdcbb3ed-9974-453a-993a-d89bc7f8c87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:33.497136 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1423/2865] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:33.509570 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0623910-a758-4188-8262-ee31e5d91693 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:33.511308 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d0623910-a758-4188-8262-ee31e5d91693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:33.590583 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0623910-a758-4188-8262-ee31e5d91693 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:33.594638 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7329c8c3-692b-4f5f-8ba8-9f12b4122a53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab0603fbcd54121b543fbf2a44fecf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:33.595305 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329c8c3-692b-4f5f-8ba8-9f12b4122a53 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:33.595591 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329c8c3-692b-4f5f-8ba8-9f12b4122a53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:33.595873 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329c8c3-692b-4f5f-8ba8-9f12b4122a53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:33.605889 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7329c8c3-692b-4f5f-8ba8-9f12b4122a53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:33.607872 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7329c8c3-692b-4f5f-8ba8-9f12b4122a53 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:33.616659 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1443/2866] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:31:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:31:34.284872 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbb3ed-9974-453a-993a-d89bc7f8c87b None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:34.286423 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-fdcbb3ed-9974-453a-993a-d89bc7f8c87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:34.380833 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbb3ed-9974-453a-993a-d89bc7f8c87b None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:34.387954 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31f1dd-f4f7-4500-8c03-9274949c5086 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fb6720f0d0141fea795cecfbf6f2538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:34.388621 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31f1dd-f4f7-4500-8c03-9274949c5086 service placement] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:34.388905 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31f1dd-f4f7-4500-8c03-9274949c5086 service placement] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:34.389182 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31f1dd-f4f7-4500-8c03-9274949c5086 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:34.391083 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ef31f1dd-f4f7-4500-8c03-9274949c5086 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:34.403946 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31f1dd-f4f7-4500-8c03-9274949c5086 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:34.406183 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31f1dd-f4f7-4500-8c03-9274949c5086 service placement] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:34.417592 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1424/2867] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:31:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:31:35.179712 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bc7ef-f334-40ce-b3de-ecfbd0b3b3a2 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:35.180551 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bc7ef-f334-40ce-b3de-ecfbd0b3b3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:35.180551 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bc7ef-f334-40ce-b3de-ecfbd0b3b3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:35.219274 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-d98bc7ef-f334-40ce-b3de-ecfbd0b3b3a2 None None] MFA Rules not processed for user `eb5493f30c694a32b5841791b34ff148`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:35.220527 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d98bc7ef-f334-40ce-b3de-ecfbd0b3b3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:35.244352 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1444/2868] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:31:44.412879 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=96,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:45.214040 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:52.590814 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99f020-4aa2-480e-b160-b3355f1b8bd3 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:52.591425 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99f020-4aa2-480e-b160-b3355f1b8bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:52.591876 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99f020-4aa2-480e-b160-b3355f1b8bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:52.612977 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-2c99f020-4aa2-480e-b160-b3355f1b8bd3 None None] MFA Rules not processed for user `aff5d82384e84b669eeb00089ab8e09a`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:52.614442 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2c99f020-4aa2-480e-b160-b3355f1b8bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:52.688588 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1425/2869] 10.222.0.57 () {58 vars in 1009 bytes} [Sat Jun 4 08:31:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:52.745400 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bc7ef-f334-40ce-b3de-ecfbd0b3b3a2 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:52.749207 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d98bc7ef-f334-40ce-b3de-ecfbd0b3b3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:52.854194 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bc7ef-f334-40ce-b3de-ecfbd0b3b3a2 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:52.859890 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1ad7b-bd06-4dbb-808e-dea2d77e2139 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05ea412cab4244c58a2670c66f5a311c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:52.860778 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1ad7b-bd06-4dbb-808e-dea2d77e2139 service swift] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:52.861070 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1ad7b-bd06-4dbb-808e-dea2d77e2139 service swift] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:52.861366 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1ad7b-bd06-4dbb-808e-dea2d77e2139 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:52.874888 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1ad7b-bd06-4dbb-808e-dea2d77e2139 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:52.878119 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1ad7b-bd06-4dbb-808e-dea2d77e2139 service swift] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:52.893498 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1445/2870] 10.222.0.57 () {60 vars in 1384 bytes} [Sat Jun 4 08:31:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 08:31:53.630483 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64901905-0802-44d4-a126-37debc154fa8 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:53.631272 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64901905-0802-44d4-a126-37debc154fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:53.631425 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64901905-0802-44d4-a126-37debc154fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:53.655624 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-64901905-0802-44d4-a126-37debc154fa8 None None] MFA Rules not processed for user `aff5d82384e84b669eeb00089ab8e09a`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:53.657772 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-64901905-0802-44d4-a126-37debc154fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:53.675932 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1426/2871] 10.222.0.57 () {58 vars in 967 bytes} [Sat Jun 4 08:31:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:53.694713 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1ad7b-bd06-4dbb-808e-dea2d77e2139 service swift] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:53.716397 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1ad7b-bd06-4dbb-808e-dea2d77e2139 service swift] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:53.728971 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7be61-483e-4d22-a6a9-73ed6b8fafb4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05ea412cab4244c58a2670c66f5a311c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:53.730508 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7be61-483e-4d22-a6a9-73ed6b8fafb4 service swift] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:53.731273 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7be61-483e-4d22-a6a9-73ed6b8fafb4 service swift] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:53.731719 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7be61-483e-4d22-a6a9-73ed6b8fafb4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:53.747482 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7be61-483e-4d22-a6a9-73ed6b8fafb4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:53.751009 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7be61-483e-4d22-a6a9-73ed6b8fafb4 service swift] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:53.761574 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1446/2872] 10.222.0.57 () {60 vars in 1384 bytes} [Sat Jun 4 08:31:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 08:31:53.994696 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ddbb6-8119-4f40-b3da-d9d430c970e5 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:53.995178 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ddbb6-8119-4f40-b3da-d9d430c970e5 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:53.995584 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ddbb6-8119-4f40-b3da-d9d430c970e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:54.017053 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-de0ddbb6-8119-4f40-b3da-d9d430c970e5 None None] MFA Rules not processed for user `aff5d82384e84b669eeb00089ab8e09a`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:54.018377 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-de0ddbb6-8119-4f40-b3da-d9d430c970e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:54.027847 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1427/2873] 10.222.0.57 () {58 vars in 1009 bytes} [Sat Jun 4 08:31:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:54.047745 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7be61-483e-4d22-a6a9-73ed6b8fafb4 service swift] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:54.060308 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7be61-483e-4d22-a6a9-73ed6b8fafb4 service swift] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:54.065732 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f62dc-5032-41b4-ac75-fafaa1f7df00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05ea412cab4244c58a2670c66f5a311c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:54.066545 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f62dc-5032-41b4-ac75-fafaa1f7df00 service swift] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:54.067046 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f62dc-5032-41b4-ac75-fafaa1f7df00 service swift] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:54.067317 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f62dc-5032-41b4-ac75-fafaa1f7df00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:54.088179 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f62dc-5032-41b4-ac75-fafaa1f7df00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:54.090348 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f62dc-5032-41b4-ac75-fafaa1f7df00 service swift] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:54.109351 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1447/2874] 10.222.0.57 () {60 vars in 1384 bytes} [Sat Jun 4 08:31:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 08:31:54.475794 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7efe083-43f1-4380-939d-9b90267bb5ea None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:54.476090 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7efe083-43f1-4380-939d-9b90267bb5ea None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:54.476587 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7efe083-43f1-4380-939d-9b90267bb5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:54.495595 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-b7efe083-43f1-4380-939d-9b90267bb5ea None None] MFA Rules not processed for user `aff5d82384e84b669eeb00089ab8e09a`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:54.496841 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-b7efe083-43f1-4380-939d-9b90267bb5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:54.505214 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1428/2875] 10.222.0.57 () {58 vars in 967 bytes} [Sat Jun 4 08:31:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:54.522737 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f62dc-5032-41b4-ac75-fafaa1f7df00 service swift] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:54.540355 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f62dc-5032-41b4-ac75-fafaa1f7df00 service swift] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:54.547094 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71094112-2f70-4a27-ad5e-718e678bb9e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05ea412cab4244c58a2670c66f5a311c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:54.547825 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71094112-2f70-4a27-ad5e-718e678bb9e0 service swift] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:54.548165 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71094112-2f70-4a27-ad5e-718e678bb9e0 service swift] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:54.548501 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71094112-2f70-4a27-ad5e-718e678bb9e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:54.558848 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71094112-2f70-4a27-ad5e-718e678bb9e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:54.561408 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71094112-2f70-4a27-ad5e-718e678bb9e0 service swift] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:54.580518 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1448/2876] 10.222.0.57 () {60 vars in 1384 bytes} [Sat Jun 4 08:31:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 04 08:31:56.894802 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7efe083-43f1-4380-939d-9b90267bb5ea None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:56.964130 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7efe083-43f1-4380-939d-9b90267bb5ea None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:56.968798 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c04d8-258a-40b3-9c26-a0cd9c6c9b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:56.969684 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c04d8-258a-40b3-9c26-a0cd9c6c9b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:56.970008 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c04d8-258a-40b3-9c26-a0cd9c6c9b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:56.970278 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c04d8-258a-40b3-9c26-a0cd9c6c9b66 admin admin] PATH_INFO: `/v3/users/eb5493f30c694a32b5841791b34ff148` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:56.971479 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c04d8-258a-40b3-9c26-a0cd9c6c9b66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb5493f30c694a32b5841791b34ff148)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:56.973420 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c04d8-258a-40b3-9c26-a0cd9c6c9b66 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:57.029654 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-060c04d8-258a-40b3-9c26-a0cd9c6c9b66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb5493f30c694a32b5841791b34ff148'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:57.036666 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-060c04d8-258a-40b3-9c26-a0cd9c6c9b66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb5493f30c694a32b5841791b34ff148'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:57.037352 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-060c04d8-258a-40b3-9c26-a0cd9c6c9b66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb5493f30c694a32b5841791b34ff148'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:57.051281 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-060c04d8-258a-40b3-9c26-a0cd9c6c9b66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb5493f30c694a32b5841791b34ff148'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:57.052023 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-060c04d8-258a-40b3-9c26-a0cd9c6c9b66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb5493f30c694a32b5841791b34ff148'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:57.065265 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1429/2877] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:31:56 2022] DELETE /identity/v3/users/eb5493f30c694a32b5841791b34ff148 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:31:57.070039 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8698116-a1de-4cb6-b050-d0ff7255dae9 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:57.070589 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8698116-a1de-4cb6-b050-d0ff7255dae9 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:57.070755 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8698116-a1de-4cb6-b050-d0ff7255dae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:57.090663 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f8698116-a1de-4cb6-b050-d0ff7255dae9 None None] MFA Rules not processed for user `1757b5d7af48479b9e3aef95e06a280d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:31:57.091884 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f8698116-a1de-4cb6-b050-d0ff7255dae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:57.154450 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1449/2878] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 08:31:57.163475 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c04d8-258a-40b3-9c26-a0cd9c6c9b66 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:57.165497 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-060c04d8-258a-40b3-9c26-a0cd9c6c9b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:57.172730 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:57.231273 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c04d8-258a-40b3-9c26-a0cd9c6c9b66 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:57.234986 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be5d32-48eb-49f3-90c1-043b2752c294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:57.235645 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be5d32-48eb-49f3-90c1-043b2752c294 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:57.235929 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be5d32-48eb-49f3-90c1-043b2752c294 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:57.236203 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be5d32-48eb-49f3-90c1-043b2752c294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:57.245971 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be5d32-48eb-49f3-90c1-043b2752c294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:57.247415 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be5d32-48eb-49f3-90c1-043b2752c294 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:57.258847 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1430/2879] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:31:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:31:57.452384 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8698116-a1de-4cb6-b050-d0ff7255dae9 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:31:57.453907 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f8698116-a1de-4cb6-b050-d0ff7255dae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:31:57.472966 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8698116-a1de-4cb6-b050-d0ff7255dae9 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:31:57.479757 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33a962-ccdf-450d-8815-a3823fa3ed79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:31:57.480746 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33a962-ccdf-450d-8815-a3823fa3ed79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:31:57.481145 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33a962-ccdf-450d-8815-a3823fa3ed79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:31:57.481436 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33a962-ccdf-450d-8815-a3823fa3ed79 admin admin] PATH_INFO: `/v3/projects/d184f89cae454990b26023745ea432fb` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:31:57.482884 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33a962-ccdf-450d-8815-a3823fa3ed79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d184f89cae454990b26023745ea432fb)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:31:57.484902 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33a962-ccdf-450d-8815-a3823fa3ed79 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:31:57.546167 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:31:57.555461 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1a33a962-ccdf-450d-8815-a3823fa3ed79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd184f89cae454990b26023745ea432fb', 'request_id': 'req-1a33a962-ccdf-450d-8815-a3823fa3ed79'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:57.567879 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1a33a962-ccdf-450d-8815-a3823fa3ed79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd184f89cae454990b26023745ea432fb', 'request_id': 'req-1a33a962-ccdf-450d-8815-a3823fa3ed79'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:57.583919 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1a33a962-ccdf-450d-8815-a3823fa3ed79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd184f89cae454990b26023745ea432fb', 'request_id': 'req-1a33a962-ccdf-450d-8815-a3823fa3ed79'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:57.605935 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1a33a962-ccdf-450d-8815-a3823fa3ed79 admin admin] The token cache is being invalidate because project d184f89cae454990b26023745ea432fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:31:57.606525 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1a33a962-ccdf-450d-8815-a3823fa3ed79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:57.607402 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1a33a962-ccdf-450d-8815-a3823fa3ed79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:31:57.609164 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1450/2880] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:31:57 2022] DELETE /identity/v3/projects/d184f89cae454990b26023745ea432fb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:32:06.309336 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be5d32-48eb-49f3-90c1-043b2752c294 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:32:06.318689 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be5d32-48eb-49f3-90c1-043b2752c294 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:32:06.373242 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2d616-bffc-43c1-8443-f5ea1f439e63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:32:06.373930 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2d616-bffc-43c1-8443-f5ea1f439e63 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:32:06.374220 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2d616-bffc-43c1-8443-f5ea1f439e63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:32:06.374506 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2d616-bffc-43c1-8443-f5ea1f439e63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:32:06.376350 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-36d2d616-bffc-43c1-8443-f5ea1f439e63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:32:06.444570 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2d616-bffc-43c1-8443-f5ea1f439e63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:32:06.446012 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2d616-bffc-43c1-8443-f5ea1f439e63 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:32:06.456205 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1431/2881] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:32:06 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:32:07.601037 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:32:16.451594 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=74 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:32:42.821588 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f879c93-db50-407a-900c-63ec21e86192 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:32:42.822236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f879c93-db50-407a-900c-63ec21e86192 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:32:42.822236 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f879c93-db50-407a-900c-63ec21e86192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:32:42.842073 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-1f879c93-db50-407a-900c-63ec21e86192 None None] MFA Rules not processed for user `0d6db2b2eb4845ed8cf6c81f8b1e913f`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 08:32:42.843305 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-1f879c93-db50-407a-900c-63ec21e86192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:32:42.900497 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1451/2882] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jun 4 08:32:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 08:32:51.576064 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2d616-bffc-43c1-8443-f5ea1f439e63 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:32:51.577513 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-36d2d616-bffc-43c1-8443-f5ea1f439e63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:32:51.589359 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2d616-bffc-43c1-8443-f5ea1f439e63 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:32:51.593333 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d888a-0e48-4b6b-b85f-b76dabd4f95c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:32:51.594150 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d888a-0e48-4b6b-b85f-b76dabd4f95c service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:32:51.594293 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d888a-0e48-4b6b-b85f-b76dabd4f95c service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:32:51.594575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d888a-0e48-4b6b-b85f-b76dabd4f95c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:32:51.596489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-fa0d888a-0e48-4b6b-b85f-b76dabd4f95c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:32:51.688907 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d888a-0e48-4b6b-b85f-b76dabd4f95c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:32:51.691137 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d888a-0e48-4b6b-b85f-b76dabd4f95c service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:32:51.716763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1432/2883] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:32:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:32:51.776821 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f879c93-db50-407a-900c-63ec21e86192 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:32:51.778347 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-1f879c93-db50-407a-900c-63ec21e86192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:32:51.791677 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f879c93-db50-407a-900c-63ec21e86192 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:32:51.795996 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c3f11-245d-4bb7-b499-218ffcecd4b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:32:51.796659 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c3f11-245d-4bb7-b499-218ffcecd4b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:32:51.796944 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c3f11-245d-4bb7-b499-218ffcecd4b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:32:51.797222 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c3f11-245d-4bb7-b499-218ffcecd4b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:32:51.799376 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-733c3f11-245d-4bb7-b499-218ffcecd4b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:32:51.814965 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c3f11-245d-4bb7-b499-218ffcecd4b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:32:51.816847 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c3f11-245d-4bb7-b499-218ffcecd4b4 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:32:51.830741 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1452/2884] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:32:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:32:57.465035 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d888a-0e48-4b6b-b85f-b76dabd4f95c service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:32:57.473813 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d888a-0e48-4b6b-b85f-b76dabd4f95c service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:32:57.478733 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c43ca-af9b-45a4-ba15-f3e0adce55a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:32:57.479378 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c43ca-af9b-45a4-ba15-f3e0adce55a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:32:57.479662 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c43ca-af9b-45a4-ba15-f3e0adce55a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:32:57.479939 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c43ca-af9b-45a4-ba15-f3e0adce55a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:32:57.481769 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-b96c43ca-af9b-45a4-ba15-f3e0adce55a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:32:57.551283 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c43ca-af9b-45a4-ba15-f3e0adce55a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:32:57.552750 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c43ca-af9b-45a4-ba15-f3e0adce55a5 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:32:57.563919 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1433/2885] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:32:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:33:01.824871 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=31 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:33:03.864299 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c3f11-245d-4bb7-b499-218ffcecd4b4 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:33:03.868233 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-733c3f11-245d-4bb7-b499-218ffcecd4b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:33:03.890391 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c3f11-245d-4bb7-b499-218ffcecd4b4 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:33:03.895408 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0afe1-5fcf-4332-be6d-c6ec102fcfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:33:03.896485 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0afe1-5fcf-4332-be6d-c6ec102fcfbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:33:03.896936 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0afe1-5fcf-4332-be6d-c6ec102fcfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:33:03.897366 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0afe1-5fcf-4332-be6d-c6ec102fcfbd admin admin] PATH_INFO: `/v3/users/0c58a96bc78b4fa3a643125a6140bb00` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:33:03.899284 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0afe1-5fcf-4332-be6d-c6ec102fcfbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c58a96bc78b4fa3a643125a6140bb00)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:33:03.901448 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0afe1-5fcf-4332-be6d-c6ec102fcfbd admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:33:03.978431 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-60a0afe1-5fcf-4332-be6d-c6ec102fcfbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c58a96bc78b4fa3a643125a6140bb00'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:33:03.985905 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-60a0afe1-5fcf-4332-be6d-c6ec102fcfbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c58a96bc78b4fa3a643125a6140bb00'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:33:03.986610 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-60a0afe1-5fcf-4332-be6d-c6ec102fcfbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c58a96bc78b4fa3a643125a6140bb00'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:33:03.987214 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-60a0afe1-5fcf-4332-be6d-c6ec102fcfbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c58a96bc78b4fa3a643125a6140bb00'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:33:04.001658 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-60a0afe1-5fcf-4332-be6d-c6ec102fcfbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c58a96bc78b4fa3a643125a6140bb00'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:33:04.016482 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1453/2886] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:33:03 2022] DELETE /identity/v3/users/0c58a96bc78b4fa3a643125a6140bb00 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:33:04.204847 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c43ca-af9b-45a4-ba15-f3e0adce55a5 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:33:04.216760 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c43ca-af9b-45a4-ba15-f3e0adce55a5 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:33:04.284577 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5537b-ed02-431c-adb8-2b3abe9f4161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:33:04.285446 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5537b-ed02-431c-adb8-2b3abe9f4161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:33:04.285732 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5537b-ed02-431c-adb8-2b3abe9f4161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:33:04.286040 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5537b-ed02-431c-adb8-2b3abe9f4161 admin admin] PATH_INFO: `/v3/projects/1cc798a91bd74226a144199bd78c2331` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:33:04.287360 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5537b-ed02-431c-adb8-2b3abe9f4161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cc798a91bd74226a144199bd78c2331)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:33:04.289551 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5537b-ed02-431c-adb8-2b3abe9f4161 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:33:04.313767 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:33:04.338292 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-07d5537b-ed02-431c-adb8-2b3abe9f4161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cc798a91bd74226a144199bd78c2331', 'request_id': 'req-07d5537b-ed02-431c-adb8-2b3abe9f4161'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:33:04.344557 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-07d5537b-ed02-431c-adb8-2b3abe9f4161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cc798a91bd74226a144199bd78c2331', 'request_id': 'req-07d5537b-ed02-431c-adb8-2b3abe9f4161'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:33:04.352165 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-07d5537b-ed02-431c-adb8-2b3abe9f4161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cc798a91bd74226a144199bd78c2331', 'request_id': 'req-07d5537b-ed02-431c-adb8-2b3abe9f4161'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:33:04.362943 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-07d5537b-ed02-431c-adb8-2b3abe9f4161 admin admin] The token cache is being invalidate because project 1cc798a91bd74226a144199bd78c2331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:33:04.363227 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-07d5537b-ed02-431c-adb8-2b3abe9f4161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:33:04.363875 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-07d5537b-ed02-431c-adb8-2b3abe9f4161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:33:04.365436 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1434/2887] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:33:04 2022] DELETE /identity/v3/projects/1cc798a91bd74226a144199bd78c2331 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:33:04.369964 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0afe1-5fcf-4332-be6d-c6ec102fcfbd admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:33:04.371365 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-60a0afe1-5fcf-4332-be6d-c6ec102fcfbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:33:04.385140 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0afe1-5fcf-4332-be6d-c6ec102fcfbd admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:33:04.442895 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebb463-ba17-4ac4-adf4-f212cfbe199a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:33:04.443788 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebb463-ba17-4ac4-adf4-f212cfbe199a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:33:04.444099 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebb463-ba17-4ac4-adf4-f212cfbe199a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:33:04.444381 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebb463-ba17-4ac4-adf4-f212cfbe199a admin admin] PATH_INFO: `/v3/users/f54e6322e5d34cf3bd23ff5646d7f2e4` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:33:04.446371 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebb463-ba17-4ac4-adf4-f212cfbe199a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f54e6322e5d34cf3bd23ff5646d7f2e4)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:33:04.448316 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebb463-ba17-4ac4-adf4-f212cfbe199a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:33:04.497892 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c0ebb463-ba17-4ac4-adf4-f212cfbe199a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f54e6322e5d34cf3bd23ff5646d7f2e4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:33:04.504958 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c0ebb463-ba17-4ac4-adf4-f212cfbe199a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f54e6322e5d34cf3bd23ff5646d7f2e4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:33:04.505684 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c0ebb463-ba17-4ac4-adf4-f212cfbe199a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f54e6322e5d34cf3bd23ff5646d7f2e4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:33:04.506320 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c0ebb463-ba17-4ac4-adf4-f212cfbe199a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f54e6322e5d34cf3bd23ff5646d7f2e4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:33:04.519505 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c0ebb463-ba17-4ac4-adf4-f212cfbe199a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f54e6322e5d34cf3bd23ff5646d7f2e4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:33:04.521242 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:33:04.534406 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1454/2888] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:33:04 2022] DELETE /identity/v3/users/f54e6322e5d34cf3bd23ff5646d7f2e4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:33:04.717919 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5537b-ed02-431c-adb8-2b3abe9f4161 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:33:04.719709 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-07d5537b-ed02-431c-adb8-2b3abe9f4161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:33:04.734390 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5537b-ed02-431c-adb8-2b3abe9f4161 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:33:04.794309 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef513a6b-1261-492e-afc3-a83a23f52c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:33:04.795432 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef513a6b-1261-492e-afc3-a83a23f52c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:33:04.795716 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef513a6b-1261-492e-afc3-a83a23f52c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:33:04.796023 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef513a6b-1261-492e-afc3-a83a23f52c46 admin admin] PATH_INFO: `/v3/projects/55fb1da014f74d59a0f46deaf02fa0f6` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:33:04.797227 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef513a6b-1261-492e-afc3-a83a23f52c46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55fb1da014f74d59a0f46deaf02fa0f6)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:33:04.799231 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef513a6b-1261-492e-afc3-a83a23f52c46 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:33:04.846941 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ef513a6b-1261-492e-afc3-a83a23f52c46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55fb1da014f74d59a0f46deaf02fa0f6', 'request_id': 'req-ef513a6b-1261-492e-afc3-a83a23f52c46'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:33:04.853746 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ef513a6b-1261-492e-afc3-a83a23f52c46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55fb1da014f74d59a0f46deaf02fa0f6', 'request_id': 'req-ef513a6b-1261-492e-afc3-a83a23f52c46'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:33:04.861979 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ef513a6b-1261-492e-afc3-a83a23f52c46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55fb1da014f74d59a0f46deaf02fa0f6', 'request_id': 'req-ef513a6b-1261-492e-afc3-a83a23f52c46'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:33:04.873505 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ef513a6b-1261-492e-afc3-a83a23f52c46 admin admin] The token cache is being invalidate because project 55fb1da014f74d59a0f46deaf02fa0f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:33:04.873796 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ef513a6b-1261-492e-afc3-a83a23f52c46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:33:04.874472 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ef513a6b-1261-492e-afc3-a83a23f52c46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:33:04.876023 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1435/2889] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:33:04 2022] DELETE /identity/v3/projects/55fb1da014f74d59a0f46deaf02fa0f6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:33:14.530768 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:33:14.870234 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:DELETE=14,keystone:SELECT=66,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:33:41.345967 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebb463-ba17-4ac4-adf4-f212cfbe199a admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:33:41.347874 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c0ebb463-ba17-4ac4-adf4-f212cfbe199a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:33:41.364267 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebb463-ba17-4ac4-adf4-f212cfbe199a admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:33:41.434817 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318d946-18fc-47ff-b50f-36aa859dbe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:33:41.435698 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318d946-18fc-47ff-b50f-36aa859dbe8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:33:41.435981 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318d946-18fc-47ff-b50f-36aa859dbe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:33:41.436259 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318d946-18fc-47ff-b50f-36aa859dbe8e admin admin] PATH_INFO: `/v3/users/0d6db2b2eb4845ed8cf6c81f8b1e913f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:33:41.437465 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318d946-18fc-47ff-b50f-36aa859dbe8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d6db2b2eb4845ed8cf6c81f8b1e913f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:33:41.439449 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318d946-18fc-47ff-b50f-36aa859dbe8e admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:33:41.493765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-8318d946-18fc-47ff-b50f-36aa859dbe8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d6db2b2eb4845ed8cf6c81f8b1e913f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:33:41.501359 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-8318d946-18fc-47ff-b50f-36aa859dbe8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d6db2b2eb4845ed8cf6c81f8b1e913f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:33:41.502130 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-8318d946-18fc-47ff-b50f-36aa859dbe8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d6db2b2eb4845ed8cf6c81f8b1e913f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:33:41.502765 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-8318d946-18fc-47ff-b50f-36aa859dbe8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d6db2b2eb4845ed8cf6c81f8b1e913f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:33:41.516130 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-8318d946-18fc-47ff-b50f-36aa859dbe8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d6db2b2eb4845ed8cf6c81f8b1e913f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:33:41.531687 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1455/2890] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:33:41 2022] DELETE /identity/v3/users/0d6db2b2eb4845ed8cf6c81f8b1e913f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:33:41.714311 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef513a6b-1261-492e-afc3-a83a23f52c46 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:33:41.715827 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ef513a6b-1261-492e-afc3-a83a23f52c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:33:41.729239 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef513a6b-1261-492e-afc3-a83a23f52c46 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:33:41.787543 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd2c06-13a0-4acc-acf7-bd28c23876e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:33:41.788580 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd2c06-13a0-4acc-acf7-bd28c23876e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:33:41.788819 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd2c06-13a0-4acc-acf7-bd28c23876e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:33:41.789095 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd2c06-13a0-4acc-acf7-bd28c23876e3 admin admin] PATH_INFO: `/v3/projects/dd222ba8d8b8447594ee715381dcd847` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:33:41.790328 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd2c06-13a0-4acc-acf7-bd28c23876e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd222ba8d8b8447594ee715381dcd847)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:33:41.792263 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd2c06-13a0-4acc-acf7-bd28c23876e3 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:33:41.841595 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-97fd2c06-13a0-4acc-acf7-bd28c23876e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd222ba8d8b8447594ee715381dcd847', 'request_id': 'req-97fd2c06-13a0-4acc-acf7-bd28c23876e3'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:33:41.847909 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-97fd2c06-13a0-4acc-acf7-bd28c23876e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd222ba8d8b8447594ee715381dcd847', 'request_id': 'req-97fd2c06-13a0-4acc-acf7-bd28c23876e3'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:33:41.855751 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-97fd2c06-13a0-4acc-acf7-bd28c23876e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd222ba8d8b8447594ee715381dcd847', 'request_id': 'req-97fd2c06-13a0-4acc-acf7-bd28c23876e3'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:33:41.866836 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-97fd2c06-13a0-4acc-acf7-bd28c23876e3 admin admin] The token cache is being invalidate because project dd222ba8d8b8447594ee715381dcd847 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:33:41.867125 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-97fd2c06-13a0-4acc-acf7-bd28c23876e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:33:41.867753 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-97fd2c06-13a0-4acc-acf7-bd28c23876e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:33:41.869322 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1436/2891] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:33:41 2022] DELETE /identity/v3/projects/dd222ba8d8b8447594ee715381dcd847 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 08:33:51.528069 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:33:51.863318 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:34:02.502539 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318d946-18fc-47ff-b50f-36aa859dbe8e admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:34:02.503992 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8318d946-18fc-47ff-b50f-36aa859dbe8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:34:02.563933 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318d946-18fc-47ff-b50f-36aa859dbe8e admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:34:02.615125 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0fd8c-0fe2-4227-b44c-76426419ea4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:34:02.615779 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0fd8c-0fe2-4227-b44c-76426419ea4a service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:34:02.616062 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0fd8c-0fe2-4227-b44c-76426419ea4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:34:02.616337 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0fd8c-0fe2-4227-b44c-76426419ea4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:34:02.618238 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8ab0fd8c-0fe2-4227-b44c-76426419ea4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:34:02.627654 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0fd8c-0fe2-4227-b44c-76426419ea4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:34:02.629078 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0fd8c-0fe2-4227-b44c-76426419ea4a service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:34:02.637669 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1456/2892] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:34:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:34:12.634108 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=46 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:34:29.820056 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd2c06-13a0-4acc-acf7-bd28c23876e3 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:34:29.821581 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-97fd2c06-13a0-4acc-acf7-bd28c23876e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:34:29.835464 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd2c06-13a0-4acc-acf7-bd28c23876e3 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:34:29.839530 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82abed-90e0-41e9-bd63-9364dbd3516a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:34:29.840172 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82abed-90e0-41e9-bd63-9364dbd3516a service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:34:29.840464 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82abed-90e0-41e9-bd63-9364dbd3516a service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:34:29.840765 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82abed-90e0-41e9-bd63-9364dbd3516a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:34:29.842824 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-de82abed-90e0-41e9-bd63-9364dbd3516a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:34:29.854020 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82abed-90e0-41e9-bd63-9364dbd3516a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:34:29.855384 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82abed-90e0-41e9-bd63-9364dbd3516a service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:34:29.863576 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1437/2893] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:34:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:34:29.968410 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0fd8c-0fe2-4227-b44c-76426419ea4a service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:34:29.978009 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0fd8c-0fe2-4227-b44c-76426419ea4a service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:34:29.981621 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea92169-b6b4-472c-84c1-ed797268ddc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:34:29.982287 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea92169-b6b4-472c-84c1-ed797268ddc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:34:29.982568 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea92169-b6b4-472c-84c1-ed797268ddc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:34:29.982842 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea92169-b6b4-472c-84c1-ed797268ddc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:34:29.984600 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-aea92169-b6b4-472c-84c1-ed797268ddc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:34:29.994806 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea92169-b6b4-472c-84c1-ed797268ddc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:34:29.996872 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea92169-b6b4-472c-84c1-ed797268ddc3 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:34:30.006142 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1457/2894] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:34:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:34:31.087487 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82abed-90e0-41e9-bd63-9364dbd3516a service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:34:31.096543 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82abed-90e0-41e9-bd63-9364dbd3516a service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:34:31.100380 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a485368-c1eb-47d8-98ed-0d59f2e38acd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fd5768a512c4177abae05f4ccd5c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:34:31.101026 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a485368-c1eb-47d8-98ed-0d59f2e38acd service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:34:31.101312 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a485368-c1eb-47d8-98ed-0d59f2e38acd service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:34:31.101588 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a485368-c1eb-47d8-98ed-0d59f2e38acd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:34:31.103439 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4a485368-c1eb-47d8-98ed-0d59f2e38acd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:34:31.185718 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a485368-c1eb-47d8-98ed-0d59f2e38acd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:34:31.187116 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a485368-c1eb-47d8-98ed-0d59f2e38acd service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:34:31.199885 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1438/2895] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:34:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:34:31.295323 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea92169-b6b4-472c-84c1-ed797268ddc3 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:34:31.296894 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-aea92169-b6b4-472c-84c1-ed797268ddc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:34:31.376867 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea92169-b6b4-472c-84c1-ed797268ddc3 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:34:31.382597 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fe474-95ea-4403-b50e-7aefda47aaa6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fb6720f0d0141fea795cecfbf6f2538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:34:31.383256 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fe474-95ea-4403-b50e-7aefda47aaa6 service placement] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:34:31.383573 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fe474-95ea-4403-b50e-7aefda47aaa6 service placement] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:34:31.383854 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fe474-95ea-4403-b50e-7aefda47aaa6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:34:31.385663 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c29fe474-95ea-4403-b50e-7aefda47aaa6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:34:31.398552 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fe474-95ea-4403-b50e-7aefda47aaa6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:34:31.400171 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fe474-95ea-4403-b50e-7aefda47aaa6 service placement] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:34:31.410460 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1458/2896] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:34:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:34:32.651706 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a485368-c1eb-47d8-98ed-0d59f2e38acd service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:34:32.653251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4a485368-c1eb-47d8-98ed-0d59f2e38acd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:34:32.670247 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a485368-c1eb-47d8-98ed-0d59f2e38acd service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:34:32.675954 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1dabe9-3287-47b8-9ce1-ec7c1152cfe9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:34:32.676613 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1dabe9-3287-47b8-9ce1-ec7c1152cfe9 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:34:32.676900 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1dabe9-3287-47b8-9ce1-ec7c1152cfe9 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:34:32.677178 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1dabe9-3287-47b8-9ce1-ec7c1152cfe9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:34:32.679641 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-9b1dabe9-3287-47b8-9ce1-ec7c1152cfe9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:34:32.692714 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1dabe9-3287-47b8-9ce1-ec7c1152cfe9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:34:32.694495 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1dabe9-3287-47b8-9ce1-ec7c1152cfe9 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:34:32.706027 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1439/2897] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:34:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:34:41.406152 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=38 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:34:42.701328 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=46 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:36:05.761498 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fe474-95ea-4403-b50e-7aefda47aaa6 service placement] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:36:05.844684 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fe474-95ea-4403-b50e-7aefda47aaa6 service placement] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:36:05.852499 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837498ac-5311-4ba2-9352-5108256d2852 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:36:05.853148 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837498ac-5311-4ba2-9352-5108256d2852 service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:36:05.853433 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837498ac-5311-4ba2-9352-5108256d2852 service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:36:05.853716 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837498ac-5311-4ba2-9352-5108256d2852 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:36:05.855776 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-837498ac-5311-4ba2-9352-5108256d2852 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:36:05.920595 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837498ac-5311-4ba2-9352-5108256d2852 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:36:05.922272 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837498ac-5311-4ba2-9352-5108256d2852 service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:36:05.935846 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1459/2898] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:36:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:36:08.085761 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1dabe9-3287-47b8-9ce1-ec7c1152cfe9 service nova] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:36:08.088909 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-9b1dabe9-3287-47b8-9ce1-ec7c1152cfe9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:36:08.193361 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1dabe9-3287-47b8-9ce1-ec7c1152cfe9 service nova] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:36:08.199251 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd30f4e-af64-4168-ab34-d54687cd4b28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e64d002241242928936dd0d991ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:36:08.199901 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd30f4e-af64-4168-ab34-d54687cd4b28 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:36:08.200187 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd30f4e-af64-4168-ab34-d54687cd4b28 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:36:08.200521 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd30f4e-af64-4168-ab34-d54687cd4b28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:36:08.202291 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ddd30f4e-af64-4168-ab34-d54687cd4b28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:36:08.214865 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd30f4e-af64-4168-ab34-d54687cd4b28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:36:08.216468 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd30f4e-af64-4168-ab34-d54687cd4b28 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:36:08.227491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1440/2899] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:36:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:36:12.779343 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837498ac-5311-4ba2-9352-5108256d2852 service nova] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:36:12.780776 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-837498ac-5311-4ba2-9352-5108256d2852 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:36:12.821085 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837498ac-5311-4ba2-9352-5108256d2852 service nova] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:36:12.827651 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8753f87-13d6-4990-b0bf-ba6e8e6e50af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fb6720f0d0141fea795cecfbf6f2538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:36:12.828585 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8753f87-13d6-4990-b0bf-ba6e8e6e50af service placement] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:36:12.829026 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8753f87-13d6-4990-b0bf-ba6e8e6e50af service placement] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:36:12.830226 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8753f87-13d6-4990-b0bf-ba6e8e6e50af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:36:12.832777 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f8753f87-13d6-4990-b0bf-ba6e8e6e50af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:36:12.851127 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8753f87-13d6-4990-b0bf-ba6e8e6e50af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:36:12.852923 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8753f87-13d6-4990-b0bf-ba6e8e6e50af service placement] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:36:12.871201 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1460/2900] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:36:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:36:16.043436 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd30f4e-af64-4168-ab34-d54687cd4b28 service nova] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:36:16.055451 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd30f4e-af64-4168-ab34-d54687cd4b28 service nova] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:36:16.060571 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b805a-5f2e-4b62-95f2-6f64aca3bd10 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fb6720f0d0141fea795cecfbf6f2538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:36:16.061227 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b805a-5f2e-4b62-95f2-6f64aca3bd10 service placement] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:36:16.061514 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b805a-5f2e-4b62-95f2-6f64aca3bd10 service placement] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:36:16.061871 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b805a-5f2e-4b62-95f2-6f64aca3bd10 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:36:16.063733 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-098b805a-5f2e-4b62-95f2-6f64aca3bd10 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:36:16.077135 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b805a-5f2e-4b62-95f2-6f64aca3bd10 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:36:16.079202 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b805a-5f2e-4b62-95f2-6f64aca3bd10 service placement] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:36:16.091343 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1441/2901] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:36:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:36:16.102723 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8753f87-13d6-4990-b0bf-ba6e8e6e50af service placement] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:36:16.104149 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f8753f87-13d6-4990-b0bf-ba6e8e6e50af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:36:16.211084 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8753f87-13d6-4990-b0bf-ba6e8e6e50af service placement] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:36:16.215712 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18654172-d7e7-4c97-a4d0-e4fd36a70d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:36:16.216753 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18654172-d7e7-4c97-a4d0-e4fd36a70d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:36:16.217054 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18654172-d7e7-4c97-a4d0-e4fd36a70d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:36:16.217331 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18654172-d7e7-4c97-a4d0-e4fd36a70d6b admin admin] PATH_INFO: `/v3/users/0df9c9e882994796a13d1f202ee7b25b` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:36:16.218520 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18654172-d7e7-4c97-a4d0-e4fd36a70d6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0df9c9e882994796a13d1f202ee7b25b)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:36:16.220458 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18654172-d7e7-4c97-a4d0-e4fd36a70d6b admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:36:16.234999 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:36:16.272819 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-18654172-d7e7-4c97-a4d0-e4fd36a70d6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0df9c9e882994796a13d1f202ee7b25b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:36:16.279837 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-18654172-d7e7-4c97-a4d0-e4fd36a70d6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0df9c9e882994796a13d1f202ee7b25b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:36:16.280527 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-18654172-d7e7-4c97-a4d0-e4fd36a70d6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0df9c9e882994796a13d1f202ee7b25b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:36:16.281150 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-18654172-d7e7-4c97-a4d0-e4fd36a70d6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0df9c9e882994796a13d1f202ee7b25b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:36:16.294221 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-18654172-d7e7-4c97-a4d0-e4fd36a70d6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0df9c9e882994796a13d1f202ee7b25b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:36:16.307817 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1461/2902] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:36:16 2022] DELETE /identity/v3/users/0df9c9e882994796a13d1f202ee7b25b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:36:16.494147 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b805a-5f2e-4b62-95f2-6f64aca3bd10 service placement] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:36:16.508484 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b805a-5f2e-4b62-95f2-6f64aca3bd10 service placement] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:36:16.568042 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd23bb-4661-4dda-808a-aaae14022dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:36:16.568910 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd23bb-4661-4dda-808a-aaae14022dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:36:16.569189 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd23bb-4661-4dda-808a-aaae14022dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:36:16.569461 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd23bb-4661-4dda-808a-aaae14022dfb admin admin] PATH_INFO: `/v3/projects/a6ccf261fc9e4774a6b129712a9e2f9e` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:36:16.570690 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd23bb-4661-4dda-808a-aaae14022dfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6ccf261fc9e4774a6b129712a9e2f9e)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:36:16.572590 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd23bb-4661-4dda-808a-aaae14022dfb admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:36:16.619561 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-05dd23bb-4661-4dda-808a-aaae14022dfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6ccf261fc9e4774a6b129712a9e2f9e', 'request_id': 'req-05dd23bb-4661-4dda-808a-aaae14022dfb'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:36:16.626191 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-05dd23bb-4661-4dda-808a-aaae14022dfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6ccf261fc9e4774a6b129712a9e2f9e', 'request_id': 'req-05dd23bb-4661-4dda-808a-aaae14022dfb'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:36:16.634411 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-05dd23bb-4661-4dda-808a-aaae14022dfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6ccf261fc9e4774a6b129712a9e2f9e', 'request_id': 'req-05dd23bb-4661-4dda-808a-aaae14022dfb'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:36:16.635763 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:36:16.648771 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-05dd23bb-4661-4dda-808a-aaae14022dfb admin admin] The token cache is being invalidate because project a6ccf261fc9e4774a6b129712a9e2f9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:36:16.649058 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-05dd23bb-4661-4dda-808a-aaae14022dfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:36:16.649735 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-05dd23bb-4661-4dda-808a-aaae14022dfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:36:16.651338 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1442/2903] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:36:16 2022] DELETE /identity/v3/projects/a6ccf261fc9e4774a6b129712a9e2f9e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:36:16.655412 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18654172-d7e7-4c97-a4d0-e4fd36a70d6b admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:36:16.659106 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-18654172-d7e7-4c97-a4d0-e4fd36a70d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:36:16.670360 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18654172-d7e7-4c97-a4d0-e4fd36a70d6b admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:36:16.727938 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61f54d-4edd-41c5-9bed-3cf4fe33ce5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:36:16.728821 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61f54d-4edd-41c5-9bed-3cf4fe33ce5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:36:16.729108 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61f54d-4edd-41c5-9bed-3cf4fe33ce5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:36:16.729386 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61f54d-4edd-41c5-9bed-3cf4fe33ce5d admin admin] PATH_INFO: `/v3/users/870ab7f1c0164491a6265c7eda811584` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:36:16.730594 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61f54d-4edd-41c5-9bed-3cf4fe33ce5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=870ab7f1c0164491a6265c7eda811584)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:36:16.732539 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61f54d-4edd-41c5-9bed-3cf4fe33ce5d admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:36:16.784700 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-cd61f54d-4edd-41c5-9bed-3cf4fe33ce5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '870ab7f1c0164491a6265c7eda811584'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:36:16.791590 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-cd61f54d-4edd-41c5-9bed-3cf4fe33ce5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '870ab7f1c0164491a6265c7eda811584'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:36:16.792280 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-cd61f54d-4edd-41c5-9bed-3cf4fe33ce5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '870ab7f1c0164491a6265c7eda811584'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:36:16.793159 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-cd61f54d-4edd-41c5-9bed-3cf4fe33ce5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '870ab7f1c0164491a6265c7eda811584'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:36:16.808458 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-cd61f54d-4edd-41c5-9bed-3cf4fe33ce5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '870ab7f1c0164491a6265c7eda811584'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:36:16.821496 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1462/2904] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jun 4 08:36:16 2022] DELETE /identity/v3/users/870ab7f1c0164491a6265c7eda811584 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:36:17.006814 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd23bb-4661-4dda-808a-aaae14022dfb admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:36:17.008510 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-05dd23bb-4661-4dda-808a-aaae14022dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:36:17.023489 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd23bb-4661-4dda-808a-aaae14022dfb admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:36:17.088547 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2a324-cada-4058-ba7f-8d11d91676cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757b5d7af48479b9e3aef95e06a280d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51efa731295b432199d02f2f22ada384', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:36:17.089575 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2a324-cada-4058-ba7f-8d11d91676cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:36:17.089898 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2a324-cada-4058-ba7f-8d11d91676cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:36:17.090177 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2a324-cada-4058-ba7f-8d11d91676cd admin admin] PATH_INFO: `/v3/projects/52150cfb2c0a4ade8bbe6dadbb8f5571` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:36:17.091570 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c2a324-cada-4058-ba7f-8d11d91676cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=52150cfb2c0a4ade8bbe6dadbb8f5571)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:36:17.093556 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c2a324-cada-4058-ba7f-8d11d91676cd admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:36:17.162155 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-50c2a324-cada-4058-ba7f-8d11d91676cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52150cfb2c0a4ade8bbe6dadbb8f5571', 'request_id': 'req-50c2a324-cada-4058-ba7f-8d11d91676cd'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:36:17.168908 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-50c2a324-cada-4058-ba7f-8d11d91676cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52150cfb2c0a4ade8bbe6dadbb8f5571', 'request_id': 'req-50c2a324-cada-4058-ba7f-8d11d91676cd'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:36:17.180298 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-50c2a324-cada-4058-ba7f-8d11d91676cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52150cfb2c0a4ade8bbe6dadbb8f5571', 'request_id': 'req-50c2a324-cada-4058-ba7f-8d11d91676cd'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:36:17.192310 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-50c2a324-cada-4058-ba7f-8d11d91676cd admin admin] The token cache is being invalidate because project 52150cfb2c0a4ade8bbe6dadbb8f5571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 08:36:17.192597 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-50c2a324-cada-4058-ba7f-8d11d91676cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:36:17.193250 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-50c2a324-cada-4058-ba7f-8d11d91676cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 08:36:17.194837 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1443/2905] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jun 4 08:36:17 2022] DELETE /identity/v3/projects/52150cfb2c0a4ade8bbe6dadbb8f5571 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 08:36:26.817949 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=74,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:36:27.188491 dv-cinder-836996-29-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:DELETE=9,keystone:SELECT=54,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 08:37:11.750788 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61f54d-4edd-41c5-9bed-3cf4fe33ce5d admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 08:37:11.752246 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-cd61f54d-4edd-41c5-9bed-3cf4fe33ce5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:37:11.824511 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61f54d-4edd-41c5-9bed-3cf4fe33ce5d admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 08:37:11.885732 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc1954-83f0-45cf-957f-8732598b5018 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fb6720f0d0141fea795cecfbf6f2538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '634c9a1745ef44c0ad66e02493d79af0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 08:37:11.886420 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc1954-83f0-45cf-957f-8732598b5018 service placement] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 08:37:11.886707 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc1954-83f0-45cf-957f-8732598b5018 service placement] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 08:37:11.886986 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc1954-83f0-45cf-957f-8732598b5018 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 08:37:11.888767 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4bbc1954-83f0-45cf-957f-8732598b5018 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 08:37:11.900138 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc1954-83f0-45cf-957f-8732598b5018 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 08:37:11.901731 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc1954-83f0-45cf-957f-8732598b5018 service placement] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 08:37:11.911837 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1463/2906] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jun 4 08:37:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 08:37:21.907541 dv-cinder-836996-29-iscsi devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=58 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}